benchmarks/web-search/multi-turn company search/cheapest search API
45 questions · multi-hop · 20 configurations

Cheapest web search API for research agents: cost per research task

Ranked on the multi-hop search task of the web search benchmark. Each question combines three or four constraints.

Perplexity (perplexity) is cheapest at $0.665 LLM $ / task quality on this run.

Ranked by LLM $ / task quality: model cost per run divided by F1. Search API list prices per 1,000 queries are in the FAQ below; they are excluded from the sort because they dominate and vary by tier.

Most accurate · Fastest · Cheapest · Find companies by criteria · Search + fetch · Full benchmark

open runner + judgePublic in openbenchmarks-labs/multi-turn-company-search.github →

Ranking, sorted by llm $ / task quality

Search-only, ranked by llm $ / task quality
ProviderEndpoint & configurationLLM $ / task qualityTask quality (F1)LLM $ / run
PerplexityPOST /searchsearch_context_size=low$0.66537.8%$0.252
FirecrawlPOST /v2/searchfirecrawl$0.71130.4%$0.216
Brave SearchGET /res/v1/web/searchbrave$0.73828.0%$0.207
TinyFishGET api.search.tinyfish.aitinyfish$0.78426.6%$0.209
NimblePOST /v2/searchsearch_depth=lite · full_content=false · focus=general$0.82524.1%$0.199
Parallel fastPOST /v1/search mode=fastparallel-fast$1.11038.0%$0.422
Exa deepPOST /search type=deepexa-deep$1.11945.4%$0.508
Parallel turboPOST /v1/search mode=turboparallel-turbo$1.12534.7%$0.391
Parallel advancedPOST /v1/search mode=advancedparallel-advanced$1.15444.2%$0.510
Exa instantPOST /search type=instantexa-instant$1.19343.3%$0.517
NimblePOST /v2/searchsearch_depth=standard · full_content=false · focus=general$1.27630.7%$0.392
Tavily basicPOST /search search_depth=basictavily-basic$1.29536.5%$0.473
Tavily advancedPOST /search search_depth=advancedtavily-advanced$1.72741.1%$0.709
Linkup fastPOST /v1/search depth=fastlinkup-fast$1.88141.1%$0.774
Linkup standardPOST /v1/search depth=standardlinkup-standard$1.91140.6%$0.776
Parallel basicPOST /v1/search mode=basicparallel-basic$1.98246.5%$0.922
YouPOST /v1/searchextraction_mode=highlights · knowledge=core$2.02538.1%$0.771
YouPOST /v1/searchextraction_mode=highlights$2.11938.6%$0.818
SeltzPOST /v1/search scope=companiesseltz-companies$9.95314.5%$1.446
SERP (RapidAPI)GET google-search74.p.rapidapi.comserp$18.5700.4%$0.069

LLM $ / run is model cost only; search API cost is excluded because it dominates. LLM $ / task quality divides that by F1 (task completion quality). Ranked by LLM $ / task quality.

Search plus fetch, same sort

Search plus fetch, ranked by llm $ / task quality
ProviderEndpoint & configurationLLM $ / task qualityTask quality (F1)LLM $ / run
FirecrawlPOST /v2/searchfirecrawl$0.71033.2%$0.236
TinyFishGET api.search.tinyfish.aitinyfish$0.71530.2%$0.216
Brave SearchGET /res/v1/web/searchbrave$0.73029.4%$0.215
NimblePOST /v2/searchsearch_depth=lite · full_content=false · focus=general · extract formats=[markdown]$0.88425.8%$0.228
PerplexityPOST /searchsearch_context_size=high$0.92146.6%$0.429
Exa deepPOST /search type=deepexa-deep$1.02248.2%$0.492
Parallel fastPOST /v1/search mode=fastparallel-fast$1.04439.3%$0.410
Parallel turboPOST /v1/search mode=turboparallel-turbo$1.06836.0%$0.385
Exa instantPOST /search type=instantexa-instant$1.16144.9%$0.521
Parallel advancedPOST /v1/search mode=advancedparallel-advanced$1.19842.2%$0.506
Tavily basicPOST /search search_depth=basictavily-basic$1.27538.1%$0.487
NimblePOST /v2/searchsearch_depth=standard · full_content=false · focus=general · extract formats=[markdown]$1.31531.3%$0.412
Tavily advancedPOST /search search_depth=advancedtavily-advanced$1.52841.0%$0.627
Linkup standardPOST /v1/search depth=standardlinkup-standard$1.86742.0%$0.784
Linkup fastPOST /v1/search depth=fastlinkup-fast$1.90939.9%$0.761
YouPOST /v1/searchextraction_mode=highlights$1.98738.5%$0.766
YouPOST /v1/searchextraction_mode=highlights · knowledge=core$2.04538.5%$0.788
Parallel basicPOST /v1/search mode=basicparallel-basic$2.23842.3%$0.947
SeltzPOST /v1/search scope=companiesseltz-companies$9.01516.3%$1.467
SERP (RapidAPI)GET google-search74.p.rapidapi.comserp—0.0%$0.069

LLM $ / run is model cost only; search API cost is excluded because it dominates. LLM $ / task quality divides that by F1 (task completion quality). Ranked by LLM $ / task quality.

Common questions

What is the cheapest web search API for research agents?

Perplexity (perplexity) is cheapest at $0.665 LLM $ / task quality (search-only): model cost per run divided by F1. Search API spend is excluded from the sort because it dominates and varies by tier; list prices are below.

What do these web search APIs cost per 1,000 queries?

Public list prices for the configurations measured: Perplexity (perplexity) $5 per 1,000 queries; Firecrawl (firecrawl) $5 per 1,000 queries; Brave Search (brave) $5 per 1,000 queries; TinyFish (tinyfish) $0 per 1,000 queries; Nimble (nimble-lite) $1.100 per 1,000 queries; Parallel fast (parallel-fast) $1 per 1,000 queries; Exa deep (exa-deep) $12 per 1,000 queries; Parallel turbo (parallel-turbo) $1 per 1,000 queries; Parallel advanced (parallel-advanced) $5 per 1,000 queries; Exa instant (exa-instant) $7 per 1,000 queries; Nimble (nimble-standard) $5 per 1,000 queries; Tavily basic (tavily-basic) $8 per 1,000 queries; Tavily advanced (tavily-advanced) $16 per 1,000 queries; Linkup fast (linkup-fast) $5 per 1,000 queries; Linkup standard (linkup-standard) $5 per 1,000 queries; Parallel basic (parallel-basic) $5 per 1,000 queries; You (you-highlights-core) $5 per 1,000 queries; You (you-highlights) $5 per 1,000 queries; Seltz (seltz-companies) $5 per 1,000 queries; SERP (RapidAPI) (serp) $3 per 1,000 queries. List price is what the vendor publishes for the tier used here; it excludes free allowances and volume discounts, and it is not the cost of a research task, which depends on how many searches the agent makes.