LLMs can be setup in such a way where they remember previous prompts

All of that stuff is just added to their current prompt. That’s how that function works.