Run Llama,Qwen,Gemma,Mistral, any warm/cold LLM. No GPU req.
Generate text and speech from audio input
Engage in conversation with GPT-4o Mini
Fast and free uncensored chatbot that just works.
Meta-Llama-3.1-8B-Instruct
Generate chat responses with Qwen AI
Chat with an AI to solve complex problems
Chat Long COT model that uses tags
Engage in chat with Llama-2 7B model
Interact with PDFs using a chatbot that understands text and images
Interact with multiple chatbots simultaneously
llama.cpp server hosting a reasoning model CPU only.
mistralai/Mistral-7B-Instruct-v0.3
Serverless TextGen Hub is a serverless platform designed to run advanced language models such as Llama, Qwen, Gemma, and Mistral. It allows users to deploy and interact with these models without requiring GPU support, making it accessible and cost-effective. The platform is tailored for creating customizable AI assistants that can be integrated into various applications, enabling seamless chatbot functionality and text generation capabilities.
What models are supported by Serverless TextGen Hub?
Serverless TextGen Hub supports a variety of models, including Llama, Qwen, Gemma, Mistral, and other warm/cold LLMs.
Do I need a GPU to run Serverless TextGen Hub?
No, Serverless TextGen Hub is designed to operate without requiring GPU support, making it accessible on standard computing resources.
How do I obtain API keys for the models?
API keys or model access tokens can be obtained from the respective model providers. Follow their instructions to set up and use the keys within Serverless TextGen Hub.