model,provider,cost_per_token,provider_pricing gpt-3.5-turbo,OpenAI,"$1 / 1M input tokens, $2 / 1M output tokens","$1 / 1M input tokens, $2 / 1M output tokens" gpt-4-turbo,OpenAI,"$10 / 1M input tokens, $30 / 1M output tokens","$10 / 1M input tokens, $30 / 1M output tokens" gpt-4,OpenAI,"$30 / 1M input tokens, $60 / 1M output tokens","$30 / 1M input tokens, $60 / 1M output tokens" llama-2-70b-chat,Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Mixtral-8x7B-Instruct-v0.1,Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens zephyr-7b-beta,Hugging Face Inference Endpoint,$0.25 / 1M tokens,$1.3 / hour Mistral-7B-Instruct-v0.2,Hugging Face Inference Endpoint,$0.13 / 1M tokens,$1.3 / hour TinyLlama/TinyLlama-1.1B-Chat-v1.0,Hugging Face Inference Endpoint,$0.068 / 1M tokens,$0.6 / hour gemini-pro,Google VertexAI,"$0.25 / 1M input tokens, $0.5 / 1M output tokens","$0.25 / 1M input characters, $0.5 / 1M output characters (60 queries per minute are free)" chat-bison (PaLM 2),Google VertexAI,"$0.25 / 1M input tokens, $0.5 / 1M output tokens","$0.25 / 1M input tokens, $0.5 / 1M output tokens" chat-bison-32k (PaLM 2 32K),Google VertexAI,"$0.25 / 1M input tokens, $0.5 / 1M output tokens","$0.25 / 1M input tokens, $0.5 / 1M output tokens" 01-ai Yi Chat (34B),Together AI,$0.8 / 1M tokens,$0.8 / 1M tokens Chronos Hermes (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Deepseek Coder Instruct (33B),Together AI,$0.8 / 1M tokens,$0.8 / 1M tokens Platypus2 Instruct (70B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens MythoMax-L2 (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Vicuna v1.5 (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Vicuna v1.5 (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Code Llama Instruct (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Code Llama Instruct (34B),Together AI,$0.8 / 1M tokens,$0.8 / 1M tokens Code Llama Instruct (70B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Code Llama Instruct (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens LLaMA-2 Chat (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens LLaMA-2 Chat (70B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens LLaMA-2 Chat (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Mistral (7B) Instruct,Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Mistral (7B) Instruct v0.2 (Together AI),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Mixtral-8x7B Instruct (46.7B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Nous Capybara v1.9 (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Nous Hermes 2 - Mixtral 8x7B-DPO (46.7B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Nous Hermes 2 - Mixtral 8x7B-SFT (46.7B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Nous Hermes LLaMA-2 (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Nous Hermes Llama-2 (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Nous Hermes-2 Yi (34B),Together AI,$0.8 / 1M tokens,$0.8 / 1M tokens OpenChat 3.5 (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens OpenOrca Mistral (7B) 8K,Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Qwen-Chat (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Qwen 1.5 Chat (0.5B),Together AI,$0.1 / 1M tokens,$0.1 / 1M tokens Qwen 1.5 Chat (1.8B),Together AI,$0.1 / 1M tokens,$0.1 / 1M tokens Qwen 1.5 Chat (4B),Together AI,$0.1 / 1M tokens,$0.1 / 1M tokens Qwen 1.5 Chat (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Qwen 1.5 Chat (14B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Qwen 1.5 Chat (72B),Together AI,$0.9 / 1M tokens,$0.9 / 1M tokens Snorkel Mistral PairRM DPO (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Alpaca (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens OpenHermes-2-Mistral (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens OpenHermes-2.5-Mistral (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens Falcon Instruct (40B),Together AI,$0.8 / 1M tokens,$0.8 / 1M tokens Falcon Instruct (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens LLaMA-2-7B-32K-Instruct (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens RedPajama-INCITE Chat (3B),Together AI,$0.1 / 1M tokens,$0.1 / 1M tokens RedPajama-INCITE Chat (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens StripedHyena Nous (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens ReMM SLERP L2 (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Toppy M (7B),Together AI,$0.2 / 1M tokens,$0.2 / 1M tokens WizardLM v1.2 (13B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens Upstage SOLAR Instruct v1 (11B),Together AI,$0.3 / 1M tokens,$0.3 / 1M tokens