benchmarks/web-search/multi-turn company search/most accurate search API
45 questions · multi-hop · 20 configurations

Most accurate web search API for research agents: precision, recall and F1

Ranked on the multi-hop search task of the web search benchmark. Each question combines three or four constraints.

Parallel basic (parallel-basic) leads F1 at 50.2% on this run.

Most accurate for multi-hop company discovery. Read F1, then precision versus recall: padding lowers precision, omissions lower recall.

Most accurate · Fastest · Cheapest · Find companies by criteria · Search + fetch · Full benchmark

open runner + judgePublic in openbenchmarks-labs/multi-turn-company-search.github →

Ranking, sorted by f1

Search-only, ranked by f1
ProviderEndpoint & configurationF1PrecisionRecallExact setMedian timeMean turnsMedian task costAPI list price
Parallel basicPOST /v1/search mode=basicparallel-basic50.2 ± 2.390.0 ± 3.838.4 ± 2.57.5 ± 5.769.1 s7.5$1.180$0.070 search$1.110 token cost$0.005 / search
Exa deepPOST /search type=deepexa-deep45.5 ± 2.482.9 ± 3.333.9 ± 1.81.5 ± 1.389.6 s7.4$0.717$0.156 search$0.554 token cost$0.012 / search
Exa instantPOST /search type=instantexa-instant43.6 ± 0.681.9 ± 3.432.5 ± 0.93.1 ± 1.349.4 s7.3$0.627$0.091 search$0.532 token cost$0.007 / search
Parallel advancedPOST /v1/search mode=advancedparallel-advanced43.4 ± 3.686.6 ± 3.431.2 ± 4.02.1 ± 1.885.8 s7.4$0.615$0.070 search$0.561 token cost$0.005 / search
Tavily advancedPOST /search search_depth=advancedtavily-advanced42.0 ± 3.084.6 ± 5.430.6 ± 2.22.4 ± 0.092.1 s7.4$1.032$0.224 search$0.809 token cost$0.016 / search
Linkup fastPOST /v1/search depth=fastlinkup-fast41.3 ± 2.282.7 ± 0.930.4 ± 2.00.8 ± 1.363.8 s7.4$0.923$0.070 search$0.858 token cost$0.005 / search
Linkup standardPOST /v1/search depth=standardlinkup-standard40.8 ± 1.483.8 ± 6.830.0 ± 1.91.6 ± 2.772.4 s7.3$0.941$0.070 search$0.871 token cost$0.005 / search
Parallel fastPOST /v1/search mode=fastparallel-fast39.0 ± 5.581.6 ± 5.427.9 ± 4.41.4 ± 1.854.8 s7.7$0.469$0.014 search$0.455 token cost$0.001 / search
YouPOST /v1/searchextraction_mode=highlights38.6 ± 0.879.3 ± 4.928.3 ± 0.94.4 ± 0.048.2 s7.5$0.971$0.070 search$0.901 token cost$0.005 / search
YouPOST /v1/searchextraction_mode=highlights · knowledge=core38.1 ± 0.680.9 ± 1.627.4 ± 0.93.0 ± 1.347.6 s7.5$0.895$0.070 search$0.827 token cost$0.005 / search
PerplexityPOST /searchsearch_context_size=low37.8 ± 2.179.3 ± 5.726.8 ± 1.42.2 ± 2.248.9 s7.7$0.334$0.070 search$0.264 token cost$0.005 / search
Tavily basicPOST /search search_depth=basictavily-basic36.5 ± 3.282.5 ± 1.925.7 ± 2.71.5 ± 1.363.0 s7.7$0.615$0.112 search$0.504 token cost$0.008 / search
Parallel turboPOST /v1/search mode=turboparallel-turbo32.8 ± 3.576.7 ± 7.222.9 ± 2.80.0 ± 0.047.0 s7.6$0.420$0.014 search$0.408 token cost$0.001 / search
FirecrawlPOST /v2/searchfirecrawl30.8 ± 2.177.4 ± 5.121.1 ± 1.52.4 ± 0.075.0 s7.9$0.281$0.070 search$0.211 token cost$0.005 / search
NimblePOST /v2/searchsearch_depth=standard · full_content=false · focus=general30.7 ± 1.470.3 ± 3.321.3 ± 1.10.7 ± 1.353.0 s7.7$0.467$0.070 search$0.398 token cost$0.005 / search
Brave SearchGET /res/v1/web/searchbrave26.9 ± 0.764.5 ± 9.118.4 ± 0.50.8 ± 1.443.4 s8.0$0.265$0.070 search$0.200 token cost$0.005 / search
TinyFishGET api.search.tinyfish.aitinyfish26.6 ± 1.364.7 ± 1.517.9 ± 0.81.5 ± 1.364.2 s7.9$0.212$0.000 search$0.212 token cost$0 / search
NimblePOST /v2/searchsearch_depth=lite · full_content=false · focus=general24.1 ± 1.465.2 ± 2.316.1 ± 1.30.7 ± 1.367.2 s7.9$0.222$0.015 search$0.207 token cost$0.0011 / search
SeltzPOST /v1/search scope=companiesseltz-companies14.4 ± 1.040.6 ± 4.39.2 ± 0.70.0 ± 0.055.9 s7.4$1.751$0.070 search$1.681 token cost$0.005 / search
SERP (RapidAPI)GET google-search74.p.rapidapi.comserp0.4 ± 0.60.8 ± 1.30.3 ± 0.40.0 ± 0.031.4 s7.8$0.103$0.036 search$0.065 token cost$0.003 / search

F1, precision, recall, and exact-set accuracy are percentages reported as mean ± sample SD across three independent runs; each run aggregates all 45 questions. SD is measured in percentage points. Median time is the median end-to-end time across all runs for each vendor. Median task cost is the median of LLM $ plus search API $ per agent run. API list price is the PAYG unit rate of the search endpoint the harness calls.

Search plus fetch, same sort

Search plus fetch, ranked by f1
ProviderEndpoint & configurationF1PrecisionRecallExact setMedian timeMean turnsMedian task costAPI list price
Exa deepPOST /search type=deepexa-deep49.2 ± 2.189.8 ± 1.137.4 ± 2.23.2 ± 2.995.3 s7.5$0.685$0.156 search+fetch$0.526 token cost$0.012 / search$0.001 / fetch
PerplexityPOST /searchsearch_context_size=high46.6 ± 2.087.7 ± 5.934.7 ± 1.12.2 ± 2.253.9 s7.5$0.504$0.070 search+fetch$0.441 token cost$0.005 / search
Exa instantPOST /search type=instantexa-instant44.4 ± 1.385.7 ± 2.733.1 ± 1.35.3 ± 1.252.8 s7.5$0.654$0.091 search+fetch$0.564 token cost$0.007 / search$0.001 / fetch
Parallel advancedPOST /v1/search mode=advancedparallel-advanced43.8 ± 2.688.6 ± 4.631.7 ± 3.22.4 ± 2.379.5 s7.4$0.571$0.061 search+fetch$0.513 token cost$0.005 / search$0.001 / fetch
Tavily advancedPOST /search search_depth=advancedtavily-advanced42.4 ± 2.689.2 ± 7.230.7 ± 1.73.8 ± 0.091.2 s7.2$0.855$0.192 search+fetch$0.655 token cost$0.016 / search$0.0032 / fetch
Linkup standardPOST /v1/search depth=standardlinkup-standard41.8 ± 2.090.3 ± 2.030.4 ± 2.23.1 ± 3.480.2 s7.5$0.910$0.070 search+fetch$0.843 token cost$0.005 / search$0.001 / fetch
Parallel basicPOST /v1/search mode=basicparallel-basic41.2 ± 2.278.3 ± 5.030.1 ± 2.22.9 ± 2.467.0 s7.4$1.099$0.061 search+fetch$1.034 token cost$0.005 / search$0.001 / fetch
Linkup fastPOST /v1/search depth=fastlinkup-fast39.4 ± 1.384.7 ± 3.928.3 ± 1.40.8 ± 1.369.0 s7.4$0.914$0.061 search+fetch$0.844 token cost$0.005 / search$0.001 / fetch
YouPOST /v1/searchextraction_mode=highlights38.5 ± 1.685.2 ± 2.726.9 ± 1.70.7 ± 1.345.6 s7.4$0.864$0.065 search+fetch$0.795 token cost$0.005 / search$0.001 / fetch
YouPOST /v1/searchextraction_mode=highlights · knowledge=core38.5 ± 2.478.2 ± 2.528.3 ± 3.03.7 ± 1.348.5 s7.4$0.894$0.065 search+fetch$0.830 token cost$0.005 / search$0.001 / fetch
Tavily basicPOST /search search_depth=basictavily-basic38.1 ± 1.481.2 ± 5.927.8 ± 0.72.2 ± 0.062.0 s7.8$0.610$0.112 search+fetch$0.507 token cost$0.008 / search$0.0032 / fetch
Parallel turboPOST /v1/search mode=turboparallel-turbo37.8 ± 1.783.2 ± 3.426.1 ± 1.20.0 ± 0.047.2 s7.7$0.419$0.014 search+fetch$0.405 token cost$0.001 / search$0.001 / fetch
Parallel fastPOST /v1/search mode=fastparallel-fast36.0 ± 7.478.1 ± 14.125.3 ± 5.31.5 ± 2.355.9 s7.6$0.453$0.014 search+fetch$0.439 token cost$0.001 / search$0.001 / fetch
FirecrawlPOST /v2/searchfirecrawl33.5 ± 2.683.1 ± 0.422.9 ± 2.21.5 ± 1.381.9 s7.9$0.293$0.063 search+fetch$0.229 token cost$0.005 / search$0.0025 / fetch
NimblePOST /v2/searchsearch_depth=standard · full_content=false · focus=general · extract formats=[markdown]31.3 ± 1.873.2 ± 1.921.7 ± 1.61.5 ± 1.359.2 s7.9$0.424$0.424 token cost$0.005 / search
TinyFishGET api.search.tinyfish.aitinyfish30.2 ± 3.570.9 ± 11.320.9 ± 2.50.0 ± 0.063.4 s7.9$0.219$0.000 search+fetch$0.219 token cost$0 / search$0 / fetch
Brave SearchGET /res/v1/web/searchbrave29.1 ± 2.172.9 ± 6.220.1 ± 1.61.5 ± 1.344.9 s8.0$0.285$0.060 search+fetch$0.221 token cost$0.005 / search
NimblePOST /v2/searchsearch_depth=lite · full_content=false · focus=general · extract formats=[markdown]25.9 ± 1.967.0 ± 9.117.9 ± 1.41.6 ± 1.471.2 s8.0$0.226$0.226 token cost$0.0011 / search
SeltzPOST /v1/search scope=companiesseltz-companies16.5 ± 1.649.5 ± 3.910.3 ± 1.20.0 ± 0.059.6 s7.5$1.727$0.070 search+fetch$1.657 token cost$0.005 / search
SERP (RapidAPI)GET google-search74.p.rapidapi.comserp0.0 ± 0.00.0 ± 0.00.0 ± 0.00.0 ± 0.033.8 s7.8$0.102$0.039 search+fetch$0.066 token cost$0.003 / search

F1, precision, recall, and exact-set accuracy are percentages reported as mean ± sample SD across three independent runs; each run aggregates all 45 questions. SD is measured in percentage points. Median time is the median end-to-end time across all runs for each vendor. Median task cost is the median of LLM $ plus search/fetch API $ per agent run. API list price is the PAYG unit rate of the search (and fetch) endpoint the harness calls.

Common questions

What is the most accurate web search API for research agents?

Parallel basic (parallel-basic) leads F1 at 50.2% on 45 multi-constraint questions (search-only). Search+fetch is a separate ranking. This is multi-hop company discovery, not one-shot lookup; the lookup ranking is on the web search hub.

What do precision and recall mean in a web search API benchmark?

Every returned company is resolved to a canonical identity and compared with a human-reviewed gold set. Precision is the share of returned companies that satisfy every constraint; recall is the share of the gold set the agent recovered; F1 is their harmonic mean. An API can fail by padding (low precision) or by missing members (low recall), and the table shows both.