It’ll be marketed as Skyrim with all LLM text and end up as Oblivion with prefab text chunks.
Even disregarding the fact that current LLMs can’t stop hallucinating and going off track (which seems to be an inherent property of the approach), they need crazy accounts of memory. If you don’t want the game to use a tiny model with a bad quantization, you can probably expect to spend at least 20 gigs of VRAM and a fair chunk of the GPU’s power on just the LLM.
What we might see is a game that uses a small neural net to match freeform player input to a dialogue tree. But that’s nothing like full LLM-driven dialogue.
It’ll be marketed as Skyrim with all LLM text and end up as Oblivion with prefab text chunks.
Even disregarding the fact that current LLMs can’t stop hallucinating and going off track (which seems to be an inherent property of the approach), they need crazy accounts of memory. If you don’t want the game to use a tiny model with a bad quantization, you can probably expect to spend at least 20 gigs of VRAM and a fair chunk of the GPU’s power on just the LLM.
What we might see is a game that uses a small neural net to match freeform player input to a dialogue tree. But that’s nothing like full LLM-driven dialogue.