Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
Crust First
May 1, 2013

Wrong lads.
The problem with LLMs is that they're basically confabulation engines. They can't not make things up. They don't know they're lying, they just have no concept of truth. This can work fine, in theory, if a player isn't going off the rails, but holy poo poo will they go full steam off a cliff alongside they player if the player is being deliberately antagonistic or they are just confused.

You can't really remove "hallucinations" from an LLM without making it just a text dump machine, because making things up is the entire point. I guess you could train an LLM on solely a complex and rich fully built out collection of text related only to the world you're building, so they don't have any other internal concepts to draw from, but lol at that happening.

Adbot
ADBOT LOVES YOU

Crust First
May 1, 2013

Wrong lads.

Cool Dad posted:

The thing is that LLM NPCs can't meaningfully engage with the world, so anything you do with them doesn't matter. Take that unreal demo video, one of the first things the AI does is suggest that you explore the city together, but it can't actually do that with you. It can't advance the story in an RPG, or give you items, or do anything it wasn't programmed to do.

This is sort of true and sort of false. You could obviously program a game that uses LLMs with specific phrases that can interact with things; convince an AI to hand over a thing it has, and the game gives it to you (some games without AI have used their conversation system to hand out items, in fact, leading to cases where naming yourself after an item means you get it every time an NPC says your name!). There's going to be weird edge cases you probably can't catch, like if you convince the AI to flush the thing down the toilet, it might say it does it but hey you didn't program for that so nothing actually happens. However, without severe restraints, you're going to end up with the character's mother being convinced to fight the final boss or whatever; I don't really think there's going to be an effective way to limit what an LLM controlled character can do in the face of a determined adversarial player.

Still, I think something like Goat Simulator or Untitled Goose Game but with AI could be really funny with the right setup.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply