We may are approaching the point that online games become just playing against bots. I would love to see arcades and gaming cafes back. Real human connection instead of playing against bots. Ironically. For many years. The internet was the place to play against humans. AI, decompilation, and other tech may turn that around.
I'd be curious to see how a model fares in VGC rules with open team sheets, since that's where you swap out information-hiding games for good old-fashioned mind games :P
> [...] and damage is random [...]
Not to nitpick, but since damage isn't truly random, did it take possible damage rolls into effect? Being able to tell whether your opponent has a damage-boosting item/ability matters a lot!
Would be interested on the results from running a similar experiment with more powerful models, though that's more of a curiosity thing than anything lol
At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are getting
We’ll probably see a lot more experiments and benchmarks like these in the near future
0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom
> but Jev cant communicate
However, it can chat https://news.ycombinator.com/item?id=49778162
Not very well of course :)