ClipAI - Knowledge Base (FAQ)
< All topics

"Unable to access non-serverless model" in Together.AI - what does it mean?

If you receive this response from Together AI:

Unable to access non-serverless model teknium/OpenHermes-2p5-Mistral-7B. Please visit https://api.together.ai/models/teknium/OpenHermes-2p5-Mistral-7B to create and start a new dedicated endpoint for the model.

(For example, here we used the OpenHermes-2p5-Mistral-7B model. However, the error could be any other.)

This means that you have chosen a rarely used model for which you need to pay for a separate server.

Together.ai has two types of models: serverless (standard, via API) and dedicated (for which you need to order servers from them and pay for the time of use). Accordingly, all you need to do to work with TogetherAI is to choose the serverless model.