- Should beta testers expect to be entertained?
- Can developers reasonably expect unpaid testers to endure boring content in order to make the game fun?
The more excited a tester is about a game, the more willing he or she will be to work, rather than just play, to help that game reach its potential. The less impressed a tester is with a beta, the more that tester will wonder if he or she made a mistake in signing up... and consider investing less work, less time, or quitting altogether.
Beta signups = blind contracts?
Certainly, disillusioned testers are still under a moral obligation to help test to one degree or another. But it can't be said that they knew full well what they were getting into, can it?
Trailers for box office films are often deceptive, despite the fact that a film trailer is the same basic type of experience as the full film (in both cases, the audience watches and listens). Interactive media, on the other hand, cannot be be comparably experienced through anything other than a demo (which is impossible for many MMOs and other games). Feature lists, FAQs, interviews, and trailers cannot ensure that the gamers who sign up for the beta test truly know that this is a game they're interested in.
Consequently, signups for beta testing are vague, largely blind, agreements. It's the equivalent of asking someone simply "Will you help me?" instead of "Will you help me to [a description of the task]?". Many testers who find that the beta doesn't match their expectations came into this position innocently (with no prior beta experience). Innocent or not, how critical can you be of someone for helping half-heartedly when that person had little knowledge of what he or she was getting into?
It seems the big question is: How far along should a game be before inviting outside testers?
I was fortunate enough to be involved in one of the early beta phases of EQ2's testing. The game was remarkably complete and functional at that time (at the early levels, at least). As a result, I was more enthusiastic in testing than usual. I reported more bugs, made more suggestions, and was basically a better tester than I was in other betas.
Are outside testers usually necessary to get the game to at least a marginally fun point in the game's evolution? I know there's much more involved than what I've covered here, but making beta fun as possible seems to be in the developer's interest.