I guess it's got something to do with the lag. Imo, I've only ever gotten about 250-300k, and that's when I was on a good day. I usually get a 3-5 second lag, though. :s
When I did the minigame, I often tried to memorise the patterns, too. Oh, and it's still bugged where if, and only if, someone enters the first room/starts the minigame, all the doors reset.