Post subject: Quality control: to everyone planning on making a run
Former player
Joined: 4/16/2004
Posts: 1286
Location: Finland
I have been following the development of Bisqwit's site from the very beginning when he only had less than ten runs up. All of those runs were extremely well played and really looked like they were superhuman. I am sad to say that this is not the case anymore. The quality of the videos has come down greatly. People are simply making new runs and submitting them without even thinking the game through. The runs are not polished at all before submitting and some movies have such blunt and obvious mistakes that it just makes you want to cry. The amount of runs DOES NOT make up for their poor quality. So, I would like to say to everyone making or planning on making a run: The runs are not supposed to show just you playing through the game with mistakes corrected. They should be entertaining and awesome displays of impossible or near-impossible things. Here are some things that seem to have been forgotten when making a run: -Menu screens and the like should all be dealt with as fast as possible. Slowdown is exactly for this. You can scroll through menus with the greatest speed and accuracy possible and it requires only minimal effort but looks very cool and professional. Stupid mistakes like these that would've been easy to correct often give an amateurish image of the run. DO NOT settle for anything less than the fastest character switching or level selecting or whatever. Do it with 1% speed if you have to. -At some points it is easy to see that you are not doing something as fast as possible. These points should be eliminated. Let's take a Rockman game for example: When you shoot a boss, it starts flashing. For the rest of the fight, make sure that you shoot at it as soon as it stops flashing. If the flashing stops at some point, it means you could've done it faster. If you don't do this, it looks really bad. -Do not miss shots. You have the tools to undo missed shots. Why not use them? Missing shots gives a really lazy and sloppy image of the player. -In a sidescrolling game, don't go back. It also shows that something could've been done faster. Stopping is not a good idea either, not unless it's absolutely necessary. -Make precise jumps. Even if it doesn't improve your overall time, it looks very cool to always jump with the utmost precision. Just look at morimoto's Rockman and Rockman 2 vids. -Don't be afraid of rerecords. If you have something like 300 rerecords in a 20 minute game, it usually just tells that you have been sloppy. Use as many rerecords as you need to achieve the exact result you are looking for. Never settle for less. -Always remember to watch your run after you have completed a level. Correct your mistakes. DO NOT think that "oh well that only cost me .1 seconds, I won't bother with it". The goal here is PERFECTION, nothing less. If you will not put a 100% effort into the movie, it will probably look bad. And that's exactly the opposite of what we're trying to achieve here. These are just some additions I feel need to be said and I really hope that you put more thought into making your run after reading this. Watch Genisto's and Morimoto's runs. See their utter perfection in everything. mfried's SMB run and Bisqwit's Rockman run are fine examples, too. Learn from them and make your run. After finishing it, watch it 10 times and correct all your mistakes. This is all I ask.
Editor, Active player (296)
Joined: 3/8/2004
Posts: 7469
Location: Arzareth
I agree completely with Kyrsimys. When the submissions were fewer, I used to watch the submissions very carefully and complain to the author personally in constructive spirit of any signs of the "oh well, I don't care" attitude in the movie. Now I don't have enough time to do that for everyone - especially if I don't know the games beforehand. I just hope people would take the guidelines SERIOUSLY.
Former player
Joined: 3/8/2004
Posts: 1107
I agree. The judges need to be stricter, and only excellent movies should be accepted.
Former player
Joined: 3/8/2004
Posts: 706
do you think there should be a category of users qualified as judges? They could be people who are each specialized and educated about certain games and could really help ease the work load. That way only quality runs that pass the judges' approval would be passed on to and encoded by the movie publishers. Just an idea.
Editor, Active player (296)
Joined: 3/8/2004
Posts: 7469
Location: Arzareth
Deviance wrote:
do you think there should be a category of users qualified as judges? They could be people who are each specialized games and would really ease the work load. That way only quality runs that pass the judges' approval would be passed on to and encoded by the movie publishers. Just an idea.
Phil also suggested a voting system for the submissions. Something like a mixture of these two ideas could be useful.
Former player
Joined: 4/16/2004
Posts: 1286
Location: Finland
The idea of different judges for different genres sounds really good. As has been said, it's difficult to say anything about a movie of a game that one has never played or knows nothing about. I wonder if it would be difficult to find enough active and proficient people though.
Former player
Joined: 4/16/2004
Posts: 1276
Location: Uppsala, Sweden
?W?e?l?l? ?s?p?o?k?e?n? ?K?y?r?s?i?!? ? ? ? ?I? ?f?e?e?l? ?k?i?n?d?a? ?g?u?i?l?t?y? ?h?e?r?e?,? ?a?s? ?f?o?r? ?m?y? ?f?i?r?s?t? ?P?o?w?e?r? ?B?l?a?d?e? ?s?u?b?m?i?s?s?i?o?n?,? ?I? ?h?a?d? ?a? ?t?i?m?e? ?o?f? ?2?0?:?1?2? ?I? ?t?h?i?n?k? ?a?n?d? ?i?t? ?d?i?d?n??t? ?l?o?o?k?e?d? ?t?h?a?t? ?g?o?o?d? ?h?o?n?e?s?t?l?y?.? ?B?u?t? ?t?h?e?n? ?C?h?e?e?z? ?s?h?o?w?e?d? ?m?e?.?.? ?A?n?y?w?a?y?s?,? ?a?s? ?B?i?s?q?w?i?t? ?s?a?i?d?,? ?a?n?d? ?I? ?l?i?k?e?d? ?t?h?a?t? ?v?e?r?y? ?m?u?c?h?,? ?t?h?a?t? ?h?e? ?c?h?e?c?k?e?d? ?a?l?l? ?s?u?b?m?i?s?s?i?o?n?s? ?b?e?f?o?r?e? ?t?h?e?y? ?w?e?r?e? ?t?o? ?g?r?o?w?.? ?A?t? ?t?h?a?t? ?p?o?i?n?t? ?I? ?c?o?u?l?d? ?r?e?d?o? ?m?y? ?m?i?s?t?a?k?e?s? ?b?e?f?o?r?e? ?i?t? ?w?a?s? ?p?u?b?l?i?s?h?e?d?,? ?l?e?a?v?i?n?g? ?m?e? ?w?i?t?h? ?v?e?r?s?i?o?n? ?3?-?4? ?o?f? ?t?h?e? ?.?a?v?i? ?i?n?s?t?e?a?d? ?o?f? ?a? ?p?u?b?l?i?s?h?e?d? ?v?e?r?s?i?o?n? ?1?.? ? ? ? ?A?l?s?o?,? ?I? ?k?n?o?w? ?f?r?o?m? ?e?x?p?e?r?i?e?n?c?e? ?t?h?a?t? ?t?h?e? ?f?i?r?s?t? ?v?e?r?s?i?o?n? ?s?u?c?k?s?,? ?v?e?r?s?i?o?n? ?3?-?5? ?I?S? ?b?e?t?t?e?r?!? ?B?u?t?,? ?i?t??s? ?h?a?r?d? ?t?o? ?p?e?r?f?e?c?t? ?s?o?m?e?t?h?i?n?g? ?t?h?a?t? ?h?a?s? ?n?o? ?f?e?e?d?b?a?c?k?.? ?I? ?m?i?g?h?t? ?n?o?t? ?e?v?e?n? ?b?e? ?a?w?a?r?e? ?o?f? ?s?o?m?e? ?m?i?s?t?a?k?e?s? ?I? ?d?o? ?w?h?e?n? ?I? ?s?u?b?m?i?t? ?t?h?e? ?f?m?v?.? ? ? ? ?I? ?d?o?n??t? ?w?a?n?t? ?t?o? ?s?o?u?n?d? ?l?i?k?e? ?i?m? ?w?h?i?n?i?n?g? ?b?u?t? ?I? ?s?u?p?p?o?s?e? ?t?h?e?s?e? ?a?r?e? ?s?o?m?e? ?o?f? ?t?h?e? ?r?e?a?s?o?n?s? ?f?o?r? ?"?w?o?r?s?e?"? ?t?i?m?e? ?a?t?t?a?c?k?s? ?n?o?w?.? ?A?l?s?o?,? ?I? ?d?i?d? ?m?y? ?b?e?s?t? ?i?n? ?A?s?t?y?a?n?a?x? ?;?)? ?I?t??s? ?a? ?b?a?d? ?g?a?m?e?.?.?
/Walker Boh
Former player
Joined: 4/16/2004
Posts: 1286
Location: Finland
?[?q?u?o?t?e?:?7?8?8?5?f?c?5?0?d?9?=?"?W?a?l?k?e?r?B?o?h?"?]? ? ?A?l?s?o?,? ?I? ?k?n?o?w? ?f?r?o?m? ?e?x?p?e?r?i?e?n?c?e? ?t?h?a?t? ?t?h?e? ?f?i?r?s?t? ?v?e?r?s?i?o?n? ?s?u?c?k?s?,? ?v?e?r?s?i?o?n? ?3?-?5? ?I?S? ?b?e?t?t?e?r?!? ?B?u?t?,? ?i?t??s? ?h?a?r?d? ?t?o? ?p?e?r?f?e?c?t? ?s?o?m?e?t?h?i?n?g? ?t?h?a?t? ?h?a?s? ?n?o? ?f?e?e?d?b?a?c?k?.? ?I? ?m?i?g?h?t? ?n?o?t? ?e?v?e?n? ?b?e? ?a?w?a?r?e? ?o?f? ?s?o?m?e? ?m?i?s?t?a?k?e? ?I? ?d?o? ?w?h?e?n? ?I? ?s?u?b?m?i?t? ?t?h?e? ?f?m?v?.? ? ?[?/?q?u?o?t?e?:?7?8?8?5?f?c?5?0?d?9?]? ? ? ? ?T?h?i?s?,? ?I? ?b?e?l?i?e?v?e?,? ?i?s? ?w?h?a?t? ?t?h?e? ?W?o?r?k?b?e?n?c?h? ?f?o?r?u?m? ?i?s? ?d?e?s?i?g?n?e?d? ?f?o?r?.? ?I?n?s?t?e?a?d? ?o?f? ?u?s?i?n?g? ?i?t?,? ?p?e?o?p?l?e? ?j?u?s?t? ?s?u?b?m?i?t?t?e?d? ?t?h?e?i?r? ?v?e?r?s?i?o?n? ?1? ?m?o?v?i?e?s?,? ?w?h?i?c?h? ?i?n? ?m?y? ?o?p?i?n?i?o?n? ?a?r?e? ?s?t?i?l?l? ?i?n?c?o?m?p?l?e?t?e? ?a?n?d? ?i?n? ?t?h?e? ?p?r?o?c?e?s?s? ?o?f? ?t?a?k?i?n?g? ?t?h?e?i?r? ?f?i?n?a?l? ?f?o?r?m?.?
Former player
Joined: 6/27/2004
Posts: 550
Location: New York
While I haven't posting for long and only have been paying attention to time attacks since morimoto's SMB3 became widely popular, I've seen about 95% of the ones on this site and I feel that I can agree that some are just way worse than others, and I don't think I'm alone in that I can see where certain authors are just far more dedicated in achieving perfection, while at the same time keeping surprises coming. I don't think my "favorite" players are any different from the common ones, and they are clearly deserving of this. Part of the problem is also game choice. walkerboh you just mentioned that astyanax was not a very exciting game to watch, but I think that could have been somewhat premeditated ahead of time. To me, one of the most well chosen games recently was bucky o'hare, which along with super c is my favorite time attack in the past few weeks. Fast-paced, lots of variation with 4 unique characters, entertaining even in the areas where the speed of progression is fixed, and from what I remember mighty close to perfect. The only thing it was missing was familiarity, the thing that really pushed morimoto's mario 3 video to be so amazing at first. If one wants to be one of the names that's mentioned along with people like genisto and morimoto, they have to work for it.
Former player
Joined: 4/16/2004
Posts: 1276
Location: Uppsala, Sweden
?I? ?a?g?r?e?e? ?t?h?a?t? ?t?h?e? ?c?h?o?i?c?e? ?o?f? ?g?a?m?e?s? ?a?r?e? ?i?m?p?o?r?t?a?n?t?,? ?b?u?t? ?I?M?O? ?I? ?t?h?i?n?k? ?a?l?l? ?g?a?m?e?s? ?s?h?o?u?l?d? ?b?e? ?j?u?s?t? ?f?i?n?e? ?t?o? ?m?a?k?e? ?t?i?m?e? ?a?t?t?a?c?k?s? ?o?f?.? ?I? ?m?e?a?n?,? ?i?f? ?g?a?m?e?s? ?l?i?k?e? ?A?s?t?y?a?n?a?x? ?s?h?o?u?l?d?n??t? ?b?e? ?a?l?l?o?w?e?d? ?j?u?s?t? ?b?e?c?a?u?s?e? ?i?t??s? ?s?o?m?e?w?h?a?t? ?b?a?d?l?y? ?p?r?o?g?r?a?m?m?e?d? ?i?t? ?s?h?o?u?l?d? ?n?o?t? ?b?e? ?t?h?i?s? ?m?a?n?y? ?m?o?v?i?e?s? ?o?n? ?t?h?e? ?s?i?t?e? ?(?a?t?l?e?a?s?t? ?I? ?t?h?i?n?k?)?.? ?O?f? ?c?o?u?r?s?e? ?t?h?i?s? ?d?o?e?s?n??t? ?j?u?s?t?i?f?y? ?b?a?d? ?p?l?a?y?i?n?g? ?b?u?t? ?a?s? ?I? ?s?a?i?d?,? ?I?M?O? ?a?l?l? ?g?a?m?e?s? ?s?h?o?u?l?d? ?b?e? ?a?l?l?o?w?e?d?.? ? ? ? ?A?l?s?o? ?I? ?t?h?i?n?k? ?b?i?g?g?e?r? ?f?e?e?d?b?a?c?k? ?s?h?o?u?l?d? ?h?e?l?p? ?a?l?o?t?.? ?F?i?r?s?t? ?v?e?r?s?i?o?n? ?i?s? ?b?a?d?,? ?b?u?t? ?i?t??s? ?h?a?r?d? ?t?o? ?i?m?p?r?o?v?e? ?s?o?m?e?t?h?i?n?g? ?y?o?u? ?d?o?n??t? ?k?n?o?w? ?i?s? ?w?r?o?n?g?.? ? ? ? ?A?l?s?o? ?I? ?b?l?a?m?e? ?m?y? ?h?o?r?r?i?b?l?e? ?g?r?a?m?m?a?r? ?o?n? ?t?i?r?e?d?n?e?s?s?.?
/Walker Boh
Former player
Joined: 3/13/2004
Posts: 706
Location: Elyria/Oberlin, OH
Excellent thread here! One thing I can say...submitting movies to Bisqwit is the easiest way of allowing people to see them. Hell, I would've done that with my horrible first version of Castle of Dragon if the site accepted FCE Ultra. How about we make a thread listing sites where people are willing to host works in progress? That way, everyone can upload their movies to these places and most easily receive feedback. Thanks, Josh.
but then you take my 75 perchance chance of winning, if we was to go one-on-one, and then add 66 and two-thirds ch...percents...i got a 141 and two-thirds chance of winning at sacrifice
Joined: 5/17/2004
Posts: 106
Location: Göteborg, Sweden
I think a good, simple solution would be to add a "Publish This Run" flag to the submission form. If the submitter thinks his video is suitably perfected, he may check it. The mods then examine the run and uncheck or publish at their discretion. That way, people who just want somewhere to upload their test runs have space for it, and people who want to show their work to the world at large may do that to, all the while keeping admin overhead nice and tiny.
Former player
Joined: 7/11/2004
Posts: 72
Location: Adelaide
I'll host - Volkov
Joined: 5/1/2004
Posts: 64
Location: Finland
Good timing Kyrsimys, I was just about to make a thread about the entertainment level not being as high as it used to be. As in, Morimoto's original mario 3 run was very entertaining, awesome jumps and the 99 lives thing as well. Enjoyable to watch. Fast and entertaining. Now, most of the runs are aiming to be just fast (and as has been pointed, sloppy even in that) and not entertaining at all. Some sort of quality control would definitely be needed. That said, I think it was good to bring this up.
Former player
Joined: 3/8/2004
Posts: 1107
In addition to just telling people to make better runs, the judges also have to be more careful not to accept runs that aren't good. The bad runs that were already mistakenly accepted should be removed.
Former player
Joined: 3/8/2004
Posts: 706
should we start choosing judges then? It wouldn't be too difficult, for example the users already involved in ALttP planning would be ideal judges for that game, same goes for the users in the SMW thread etc.
Former player
Joined: 3/13/2004
Posts: 706
Location: Elyria/Oberlin, OH
One thing... To me, speed is primarily what this is about. I don't know about anyone else, but I view this work in the same way that the Doom speedrunning community does; that is, that the primary purpose is to show what the theoretical best possible time for each game is. I have no problem doing cool stuff if it fits within that goal, but I am not a fan of sacrificing speed for anything. Just my .02, Josh.
but then you take my 75 perchance chance of winning, if we was to go one-on-one, and then add 66 and two-thirds ch...percents...i got a 141 and two-thirds chance of winning at sacrifice
Former player
Joined: 3/8/2004
Posts: 706
Josh wrote:
I am not a fan of sacrificing speed for anything.
I agree. My way of looking at it is that tool-assisted runs should serve the speedrun player, but Bisqwit's site is also founded on the principle that tool-assisted runs should be entertaining. Be as entertaining as possible, as fast as possible.
Former player
Joined: 3/8/2004
Posts: 1107
I think the speed is the major thing that makes the movie entertaining, so you should never slow down just to be fancy.
Joined: 4/26/2004
Posts: 149
But you don't have to avoid being fancy to just to be fast. Some of the movies seem so focused on being fast, that they don't pull any stunts, even though they could.
Former player
Joined: 3/8/2004
Posts: 1107
The only stunts that should be pulled off are stunts that don't waste time, unless it's supposed to be a tricks video. For example, in my SMB video I did a cool looking stunt at the end of 8-3 that didn't waste time because I had to slow down anyway to avoid the fireworks. I also did some fancy enemy stomping, but that was ok since I was always running to the right at full speed the whole time.
Former player
Joined: 5/9/2004
Posts: 114
exactly right. there just need be two priorities: 1. Speed 2. Entertainment Speed is the most important, and if anything can be added to the movie without taking away from the speed, it should be done because it is possible.
Former player
Joined: 3/24/2004
Posts: 132
Location: Indiana
Michael Fried wrote:
I think the speed is the major thing that makes the movie entertaining, so you should never slow down just to be fancy.
But does a boring game done as fast as possible make a great video? No, IMO, and that to me is the biggest problem with most of the new videos coming out. The games themselves don't allow for any creative or extraordinary play. Game choice is probably the most important factor in making an entertaining video but many people just pick crap games that very few people are interested in. People aren't trying to make great movies, they're just trying to get movies on the site.
Editor, Active player (296)
Joined: 3/8/2004
Posts: 7469
Location: Arzareth
Michael Fried wrote:
I think the speed is the major thing that makes the movie entertaining, so you should never slow down just to be fancy.
When I make movies and when I watch movies, I tend to forgive a slowness of a few frames if you get a cool stunt in the exchange. However when I compare competing entries in the submission list, I don't have time to watch all of them, so I only compare the time and do the decision based on that.
Joined: 6/15/2004
Posts: 104
Location: Zürich / Switzerland
Hi,
kopernical wrote:
Game choice is probably the most important factor in making an entertaining video but many people just pick crap games that very few people are interested in. People aren't trying to make great movies, they're just trying to get movies on the site.
mmh... you may have a point here (thinking of "pearls" like Dragon's Lair, though the new run with the japanese version is much better, even though I think it's just famtasia running too fast - the sound seems faster too), but then again: Have you seen the Bucky o'Hare run? The game certainly isn't that well-known (though I remember really much wanting it for christmas or so back then when I was a kid), but the run was very entertaining none-the less. Very fast and some stunts here and there. Nice. So while the game choice indeed is a factor, the thing about quality and speed the others talked about is still the major factor. I for myself, if I may state my oppinion prefer watching stunts and stuff instead of pure speed, but watching the movies is always fun. It's just that I'd have more fun watching a long movie full of crazy looking stunts than a very short movie where the player just runs through the game. Philip