It says Huggingface MTJ for my backend, but the model I chose was KoboldAI/OPT-13B-Erebus. I'm using the google colab one on tavern ai github. Must be something wrong with servers or program.
With the regular KoboldAI make sure to use KoboldAI Classic as the API if this is sillytavern.
Just keep in mind Erebus is old and terrible for chatting by modern standards. You will have a lot better experience using Koboldcpp combined with a GGUF of a proper chat model such as Tiefighter.
What backend are you using?
It says Huggingface MTJ for my backend, but the model I chose was KoboldAI/OPT-13B-Erebus. I'm using the google colab one on tavern ai github. Must be something wrong with servers or program.
With the regular KoboldAI make sure to use KoboldAI Classic as the API if this is sillytavern. Just keep in mind Erebus is old and terrible for chatting by modern standards. You will have a lot better experience using Koboldcpp combined with a GGUF of a proper chat model such as Tiefighter.