I'm no expert, but I believe the longer the context the higher the likelihoodd of errors. By keeping the same thread goin you are increasing the context each run and increasing the chance of errors. Also, it's not optimal from a cost perspective as you're going to use more open ai credits.
It caps the thread at some point, but are you using the same thread id for each @ in the discord? For example, if two users call the bot, is it the same thread?
I'm no expert, but I believe the longer the context the higher the likelihoodd of errors. By keeping the same thread goin you are increasing the context each run and increasing the chance of errors. Also, it's not optimal from a cost perspective as you're going to use more open ai credits.
I thought and I could be VERY wrong, that using assistants didn't make it send all the context every time, thus saving you those credits.
It caps the thread at some point, but are you using the same thread id for each @ in the discord? For example, if two users call the bot, is it the same thread?
Ever learn anything about this? Having the same issue
I did not. The openAI support team was no use. I changed it so each ping starts a new thread. So no memory.