We’re starting to leave the territory where you’d test an LLM by e.g. “create an svg of pelican on a bicycle”. As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for
Andrej Karpathy adalah peneliti AI yang dikenal luas lewat perannya di OpenAI dan sebagai mantan Director of AI di Tesla. Pernyataannya layak disimak karena menyinggung pergeseran cara menguji kemampuan model bahasa besar.