Head-to-Head Model Comparison

Claude 3.5 Haiku vs Gemini 2.0 Flash

Benchmarks, API Token Pricing, Context Window & Speed Comparison

Ditinjau oleh tim riset GetInfoUsPeninjauan terakhir: October 2026Kebijakan editorial
Bagikan
Related topics (12)
AI CompareAI BenchmarkToken PricingModel CostModel SpecsSWE-bench CodingModel VersusWhich AI ModelLLM Speed & LatencyReasoning ModelsExtended ThinkingPrompt Caching ROI
Claude 3.5 Haiku vs Gemini 2.0 Flash: Benchmarks, Pricing & Speed Comparison

Claude 3.5 Haiku dari Anthropic dan Gemini 2.0 Flash dari Google adalah dua model AI unggulan. Claude 3.5 Haiku menawarkan jendela konteks 200K token dengan harga $0.80/$4.00 per 1 juta token, sedangkan Gemini 2.0 Flash menyediakan konteks 1.05M token seharga $0.10/$0.40 per 1 juta token. Berikut perbandingan lengkap benchmark, latensi, dan biayanya.

Perbandingan Langsung (VS)

Ganti & Bandingkan Model Apa Saja

Select any AI models from our verified benchmark database to generate live side-by-side matrices.

Profile
Profile
Multi-Model Arena Stack:
5-Model Matrix Workbench
Popular Matchups:
Anthropic

Claude 3.5 Haiku

Model Agen Otonom & Alat

Claude 3.5 Haiku dari Anthropic adalah model AI yang dirancang untuk alur kerja agen otonom, pemanggilan alat (tool calling), dan otomatisasi multi-langkah, menghadirkan jendela konteks 200K, kecepatan 130 token/detik, indeks kecerdasan 36/

Intelligence Index36 / 100
Input Token:

$0.80 / 1M

Output Token:

$4.00 / 1M

Context Window:

200K tokens

SWE-bench Verified:

40.6%

Google

Gemini 2.0 Flash

Inferensi Super Cepat

Gemini 2.0 Flash dari Google adalah model AI yang dirancang untuk interaksi real-time dengan latensi sangat rendah dan routing bervolume tinggi, menghadirkan jendela konteks 1.0M, kecepatan 240 token/detik, indeks kecerdasan 40/100, serta t

Intelligence Index40 / 100
Input Token:

$0.10 / 1M

Output Token:

$0.40 / 1M

Context Window:

1.05M tokens

SWE-bench Verified:

42%

Perbedaan Utama Sekilas

  • Gemini 2.0 Flash is 9.0x cheaper for API usage (input + output tokens combined).
  • Gemini 2.0 Flash has a larger context window (1M vs 200K tokens).
  • Gemini 2.0 Flash is faster at 240 tok/s vs 130 tok/s.
  • Gemini 2.0 Flash leads on SWE-bench coding (42.0% vs 40.6%).
Need definitions for token pricing, context, or benchmarks?Explore AI Glossary →
FeatureClaude 3.5 HaikuGemini 2.0 Flash
Intelligence Index
Composite reasoning & knowledge score (0-100)
3640
Provider
AnthropicGoogle
Input Price
Cost per million input tokens
$0.80 / 1M$0.10 / 1M
Output Price
Cost per million output tokens
$4.00 / 1M$0.40 / 1M
Blended Price
Weighted 7:2:1 cache:input:output per 1M
$0.62 / 1M$0.08 / 1M
Context Window
Maximum input + output tokens
200K tokens~300 A4 pages of text1.05M tokens~1,573 A4 pages of text
Max Output Tokens
Per single request
8K8K
Throughput Speed
Tokens generated per second
130 tok/s240 tok/s
SWE-bench Verified
Real-world software engineering
40.6%42%
GPQA Diamond
Graduate-level reasoning
41.6%55.4%
Cached Input Price
Prompt caching discount per 1M tokens
$0.08 / 1M$0.03 / 1M

Siapa Unggul di Mana?

At-a-glance decision framework
Coding
Gemini 2.0 Flash
+1.4% SWE-bench lead
Cost
Gemini 2.0 Flash
9.0x cheaper monthly runtime
Speed
Gemini 2.0 Flash
+85% faster generation
Context
Gemini 2.0 Flash
1.05M tokens window

Skor Benchmark Terverifikasi

Official evaluation metrics verified by independent third-party research labs.

Claude 3.5 HaikuGemini 2.0 Flash
SWE-bench Verified (Autonomous Coding)

Industry benchmark evaluating real-world GitHub issue resolution and multi-file debugging.

40.6%vs42%
GPQA Diamond (Doctorate-Level Science & Math)

Challenging questions created by domain experts to test complex PhD-level reasoning.

41.6%vs55.4%
MMLU-Pro (Multi-task Language Understanding)

Hardened reasoning and academic knowledge benchmark with reduced lucky-guess probability.

69.2%vs71%
LMSYS Chatbot Arena Elo

Crowdsourced human preference evaluation based on blind, head-to-head model battles.

1260ptsvs1302pts
Humanity's Last Exam (Frontier Expert Knowledge)

Extremely difficult, closed-ended questions spanning the frontier of human expert knowledge.

6.7%vs8.9%
Terminal-Bench (Agentic Coding & Terminal Use)

Autonomous multi-step tasks executed inside a real command-line terminal environment.

26.8%vs27.7%
SciCode (Scientific Computing)

Research-grade coding problems drawn from real scientific and numerical workloads.

24.4%vs25.2%
LiveCodeBench (Competitive Coding)

Contamination-free competitive programming problems collected continuously over time.

43.6%vs44.9%
AIME (Advanced Math Competition)

American Invitational Mathematics Examination — multi-step Olympiad-level reasoning.

47.8%vs63.7%
Long-Context Reasoning

Accuracy when reasoning over very large inputs that fill the model context window.

62.3%vs63.9%
Generation Speed (Throughput)

Tokens emitted per second during active generation streaming.

130 tok/s vs240 tok/s

Latensi & Waktu Respons

Time to first token (TTFT) and estimated end-to-end response time for a typical 500-token response.

Time to First Token (TTFT)Lower is better
Claude 3.5 Haiku0.38s
Gemini 2.0 Flash0.28s
Est. End-to-End Response (500 tokens)TTFT + generation time
Claude 3.5 Haiku4.23s
Gemini 2.0 Flash2.36s

Simulator Biaya Token Interaktif

Adjust sliders to calculate projected monthly cloud API spending with prompt caching discounts.

100K / day
10K500K1M
30K / day
5K150K300K
50% cached
0% (Cold)50%90% (Warm)
Claude 3.5 Haiku Monthly API Bill
$4.92 / month
$0.8/1M in · $4/1M out
Gemini 2.0 Flash Monthly API Bill
$0.55 / month
$0.1/1M in · $0.4/1M out
Gemini 2.0 Flash saves approximately $4.37 / month (89%) under this workload.9.0x Savings

Claude 3.5 Haiku · Strengths & Key Advantages

  • Jendela konteks 200K dengan kapasitas output maksimum hingga 8K token (SWE-bench Verified 40.6% · GPQA Diamond 41.6%)
  • Kecepatan generasi tinggi 130 token/detik dengan latensi token pertama (TTFT) hanya 380 ms
  • Skema harga API kompetitif (tarif $0.8/$4 per 1M token) dengan dukungan cache prompt dan output JSON terstruktur
Considerations & Trade-offs
  • Model cloud proprietari tertutup; bobot model tidak dapat diunduh untuk penggunaan lokal offline
  • Pada tugas pembuktian ilmiah tingkat ekstrem, model penalaran berat kelas atas memberikan kedalaman lebih tinggi

Gemini 2.0 Flash · Strengths & Key Advantages

  • Jendela konteks 1.0M dengan kapasitas output maksimum hingga 8K token (SWE-bench Verified 42% · GPQA Diamond 55.4%)
  • Kecepatan generasi tinggi 240 token/detik dengan latensi token pertama (TTFT) hanya 280 ms
  • Skema harga API kompetitif (tarif $0.1/$0.4 per 1M token) dengan dukungan cache prompt dan output JSON terstruktur
Considerations & Trade-offs
  • Model cloud proprietari tertutup; bobot model tidak dapat diunduh untuk penggunaan lokal offline
  • Pada tugas pembuktian ilmiah tingkat ekstrem, model penalaran berat kelas atas memberikan kedalaman lebih tinggi

Token Use & Task Economics

Estimated cost and token consumption to complete one representative agentic task.

MetricClaude 3.5 HaikuGemini 2.0 Flash
Cost per Task
Estimated USD to finish one task
$0.90$0.13
Output Tokens / Task
Tokens generated per task
45K60K
Reasoning Tokens / Task
Thinking tokens burned per task
0K33K

Spesifikasi Teknis

Architecture, release timeline, capabilities, and modalities.

FeatureClaude 3.5 HaikuGemini 2.0 Flash
Official API Model ID (SDK)claude-3-5-haiku-20241101models/gemini-2-flash
API ProtocolAnthropic Messages API + AWS Bedrock + Vertex AIGoogle Gemini API (generateContent) + OpenAI-Compatible SDK
Release Date2024-112024-12
Knowledge CutoffJuly 2024August 2024
ArchitectureOptimized Lightweight TransformerMultimodal Flash MoE
ParametersConfidentialConfidential
Enterprise Rate Limits (RPM / TPM)4,000 – 10,000 RPM (Tier 4 + Priority Tier) · 800,000 – 2,000,000 TPM10,000 – 30,000 RPM (Tier 5 Enterprise) · 4,000,000 – 10,000,000 TPM
Long-Context Tier (>128K/200K)Standard rate up to 200K tokens; 2x input/output tier above 200K tokensStandard rate up to 200K tokens; 2x input/output tier above 200K tokens
Prompt Cache Policy & TTL$0.08/1M cached read (90% off); 5-min default & 1-hour extended TTLImplicit + Explicit Context Caching at $0.025/1M with configurable TTL
Computer Use / GUI AgentSupported (Screen coordinate grounding, browser & desktop GUI action loops)Supported (Screen coordinate grounding, browser & desktop GUI action loops)
MCP & Parallel Tool CallingNative MCP Client/Server ready · Parallel function calling · 100% Strict JSON SchemaNative MCP Client/Server ready · Parallel function calling · 100% Strict JSON Schema
Web Search Grounding & SandboxNative Web Search Citations + Code Execution Tool + MCP ConnectorsBuilt-in Google Search Grounding + Managed Python Code Execution Sandbox
Official Fine-Tuning SupportCustom Model Tuning via Amazon Bedrock & Prompt DistillationVertex AI Supervised Adapter Tuning & Context Distillation
Multimodal Token BillingText BPE (~4 chars/token) · Vision (~258–765 tokens per image tile)Text BPE (~4 chars/token) · Vision (~258–765 tokens per image tile) · Audio (~25–32 tokens/sec) · Video (~258–300 tokens/sec)
Quantization & Min GPU VRAMCloud-Hosted Proprietary (FP8 / BF16 Tensor Core Cluster) · Zero Local VRAM Required (100% Serverless Cloud API)Cloud-Hosted Proprietary (FP8 / BF16 Tensor Core Cluster) · Zero Local VRAM Required (100% Serverless Cloud API)
Safety & Frontier ClassificationAnthropic RSP ASL-2 / ASL-3 Constitutional Safety EvaluatedGoogle DeepMind Frontier Safety Framework Verified
Enterprise Compliance (ZDR/HIPAA/SOC2)SOC2 Type II · GDPR · Zero Data Retention (ZDR) & HIPAA BAA Available on Enterprise TierSOC2 Type II · GDPR · Zero Data Retention (ZDR) & HIPAA BAA Available on Enterprise Tier
Input Modalitiestext, visiontext, vision, audio, video
Output Modalitiestexttext

Claude 3.5 Haiku vs Gemini 2.0 Flash: Jawaban Cepat (FAQ)

Which is more intelligent, Claude 3.5 Haiku or Gemini 2.0 Flash?

Gemini 2.0 Flash is more intelligent. It scores 40 compared with 36 on the composite Intelligence Index.

Which model is faster?

Gemini 2.0 Flash is faster, generating 240 tokens per second compared with 130 tokens per second.

Which model is cheaper to run?

Gemini 2.0 Flash is cheaper at $0.08 per 1M tokens blended, compared with $0.62 (7:2:1 cache:input:output ratio).

Which model has lower latency?

Gemini 2.0 Flash has lower latency, with a time to first token of 0.28s compared with 0.38s.

Which model has a larger context window?

Gemini 2.0 Flash has a larger context window, supporting 1.05M tokens compared with 200K tokens.

Kesimpulan

Baik Claude 3.5 Haiku (Sangat cocok untuk alur kerja agen otonom, pemanggilan alat (tool calling), dan otomatisasi multi-langkah, sistem RAG perusahaan, dan integrasi API skala produksi.) maupun Gemini 2.0 Flash (Sangat cocok untuk interaksi real-time dengan latensi sangat rendah dan routing bervolume tinggi, sistem RAG perusahaan, dan integrasi API skala produksi.) sangat tangguh: Gemini 2.0 Flash unggul dalam penalaran dan pemrograman, Gemini 2.0 Flash memberikan kecepatan generasi token lebih tinggi, dan Gemini 2.0 Flash lebih hemat biaya untuk penggunaan API skala besar.

Pertanyaan Umum (FAQ)

Mana yang lebih baik untuk coding dan penalaran, Claude 3.5 Haiku atau Gemini 2.0 Flash?+

Dalam indeks kecerdasan gabungan dan benchmark coding, Gemini 2.0 Flash memimpin. Lihat skor SWE-bench dan GPQA di atas untuk detailnya.

Berapa perbandingan harga API Claude 3.5 Haiku vs Gemini 2.0 Flash?+

Claude 3.5 Haiku mengenakan biaya $0.80 / $4.00 per 1M token input/output, sedangkan Gemini 2.0 Flash sebesar $0.10 / $0.40. Secara keseluruhan, Gemini 2.0 Flash lebih hemat biaya.

Model mana yang memiliki jendela konteks lebih besar dan kecepatan lebih tinggi?+

Claude 3.5 Haiku mendukung konteks 200K token dibandingkan 1.05M token pada Gemini 2.0 Flash, sementara Gemini 2.0 Flash unggul dalam kecepatan output token per detik.

AI Terminology & Guide
Explore Glossary →

Understand key metrics like context window, token pricing, reasoning mode, and SWE-bench scores in our comprehensive AI glossary.

Benchmark scores, token prices, and rate limits evolve rapidly as AI labs release model updates. Always verify current specifications and pricing on the official provider documentation.

Sumber resmi: Dokumentasi API resmi Anthropic & Google serta evaluasi benchmark independen (2026).