Skip to main content

Frequently Asked Questions

Answers to common questions about AI models, benchmarks, pricing, and how to choose the right model for your task.

Getting Started

Models.wtf simplifies AI model selection for everyone. Flagship models from OpenAI, Anthropic, Google, xAI, and others are compared here across benchmarks, cost, and capability. The goal is to help you pick the right model for your task without needing a PhD in machine learning.
No. Everything on Models.wtf is written in plain language, with simple analogies and no jargon. The Learn section teaches you what an LLM is, what a context window means, and what benchmarks measure. Start there if you're new to AI.
Try the "Which model?" quiz first. It asks you who you are, what you're trying to do, and your budget, then recommends a model with reasoning you can verify. If you want to compare specific models, head to Compare. If you want to explore performance visually, try Graph.
ChatGPT is one AI model made by OpenAI. Models.wtf is an educational site that compares ChatGPT with Claude, Gemini, Grok, and open-source alternatives, showing you the pros and cons of each so you can pick the best fit for your task.

Model Selection

"Best" depends on your task. A top-performing reasoning model might be too slow and expensive for a chatbot. A cheap, fast model might struggle with complex logic. This site exists to help you match the model to your needs instead of chasing the highest benchmark score.
Both are excellent. Claude is made by Anthropic, GPT by OpenAI. Benchmark scores are close for many tasks. Claude may excel at long-context work and nuanced analysis. GPT may be faster for some use cases. Try both with your actual task and let the results pick the winner.
Yes. Open-source models like Llama, DeepSeek, and Mixtral can be cheaper and offer privacy (you run them yourself). But they're generally less capable than GPT or Claude. Pick open-source if cost or privacy wins out for your task. Compare them here to find the best match.
No. Some models, like GPT-5.6 Sol and Claude Sonnet 5, can access the web in real time and provide fresh information. Others (especially open-source models) cannot. If your task needs current news, stock prices, or live data, check whether the model has web access before choosing.
Reasoning models spend extra time "thinking" through hard problems before answering, like showing your work on a math exam. They're slower and more expensive, but much better at complex logic, coding, and tricky questions. Use them for hard problems; use faster models for simple ones.

Pricing

Powerful models cost more to run. A large, capable model requires more computing power per request than a smaller, faster one. You pay for that. Prices also vary by provider: OpenAI, Anthropic, Google, and others set their own rates. Compare prices on this site before committing.
Models are priced per token, which is roughly a word. Input tokens are your prompt, output tokens are the model's answer, and the two are often priced differently. Use the Calculator tool on this site. You paste your text, pick your model, and it shows the total cost. Providers add up the tokens across your API calls and bill the total.
Yes. Thinking tokens are billed at a premium because the model uses extra compute to reason through your question. GPT-5.6 Sol, for example, charges more per thinking token than regular tokens. If cost is tight, use thinking tokens sparingly, only for questions that truly need them.
Yes. Count how many requests you make per month, estimate tokens per request (use the Calculator), multiply by the model's price per token, and add any API overhead. Start with a pilot and track real spending. Most providers offer usage dashboards so you can see costs in real time.

Technical

The context window is how much text a model can "see" at once, measured in tokens. A 4K context window means the model sees about 4,000 words of history. If your task involves analyzing long documents or keeping long conversations, you need a large context window.
Only if your task needs it. If you're writing emails or answering quick questions, a 4K window is plenty. If you're analyzing 50-page legal documents or code repositories, you need 100K or more. Check your actual needs before paying extra for unused context.
A token is a chunk of text, roughly a word, but sometimes shorter since punctuation is often its own token. Models process and generate text one token at a time. Pricing is based on tokens, so more tokens mean more cost. The Calculator tool shows how many tokens your text contains.
Yes, open-source models like Llama can run on your computer. This gives you privacy (nothing leaves your machine) but requires strong hardware and is generally slower. Cloud models (ChatGPT, Claude) are faster but your data goes to their servers. Choose based on your privacy and performance needs.
An API (Application Programming Interface) lets your app send requests to a model and get answers back programmatically. Instead of typing into ChatGPT, your code calls the model directly, getting results your app can use instantly. Most AI companies offer APIs; this site compares their pricing and capabilities.

Benchmarks

Benchmarks are standardized tests that measure how well models perform on specific tasks, like math, coding, reading comprehension, and logic puzzles. Companies publish benchmark scores to show their model's strengths. A high score means good performance on that task.
Mostly, but keep a healthy skepticism. Benchmarks measure narrow tasks, like solving one math problem in a single shot. Real-world tasks are messier and require human judgment. A model with a 90% benchmark score might not always work best for your actual use case. Test it with your own data.
It depends on your task. For coding, AIME and GPQA matter. For reasoning, look at GSM8K or ARC. For language understanding, MMLU is common. This site lists which benchmarks are relevant for different tasks. Read the Learn section to understand what each benchmark measures.
Different companies use slightly different versions of benchmarks, test at different times, and may tweak parameters. Benchmark results also vary slightly each run because of randomness in the model. Small differences of one to three percent are usually noise, while bigger gaps are real.
As models improve and new benchmarks emerge, scores change constantly. Models.wtf updates its benchmark data regularly as providers publish new scores. Check the data refresh date at the bottom of the site to see how current the numbers are.