The Beyond the Imitation Game Benchmark (BIG-bench) pre-print is finally on arxiv! This is one of the most important recent developments in LLMs, and I’m very happy I contributed to it.