benchmarks/web-search/web search for coding agents/most accurate search API
100tasks · hard retrieval · search & fetch and search-only

Most accurate web search API for coding agents

Ranked on the hard retrieval task of the web search benchmark. A pass requires a grounded source URL from that run's search or fetch. Rankings do not transfer from factual lookup or multi-hop.

Exa deep leads search & fetch at 83.0%. Firecrawl leads search-only at 70.3%.

Most accurate for a coding-agent path. Search & fetch and search-only are separate rankings. Read Task completion on the board that matches whether the agent can open pages.

Most accurate · Fastest · Most token efficient · Full benchmark

open codeRunner and scoring are public in openbenchmarks-labs/web-search-for-coding-agents.github →

Ranking, sorted by task completion

Search & fetch, ranked by task completion
RankVendorEndpoint & configurationTask completionMedian task timeAvg search timeMedian task tokens
1Exa deepPOST /search type=deepPOST /contents83.0 ± 1.037s3.97s23,660
2Exa autoPOST /search type=autoPOST /contents81.7 ± 1.123s1.19s27,433
3Parallel advancedPOST /v1/search mode=advancedPOST /v1/extract79.3 ± 2.139s3.08s29,925
4FirecrawlPOST /v2/searchPOST /v2/scrape76.0 ± 1.034s2.81s17,379
5Parallel basicPOST /v1/search mode=basicPOST /v1/extract73.7 ± 2.337s1.70s41,475
6Tavily advancedPOST /search search_depth=advancedPOST /extract extract_depth=advanced60.0 ± 2.046s3.41s26,269
7Tavily basicPOST /search search_depth=basicPOST /extract extract_depth=basic59.0 ± 1.732s1.50s27,405
8Linkup standardPOST /v1/search depth=standardPOST /v1/fetch mode=standard48.3 ± 4.948s2.00s57,791

Search-only, same sort

Search-only, ranked by task completion
RankVendorEndpoint & configurationTask completionMedian task timeAvg search timeMedian task tokens
1FirecrawlPOST /v2/search70.3 ± 1.528s2.87s7,456
2Exa fastPOST /search type=fast66.3 ± 1.520s626ms22,344
3Parallel fastPOST /v1/search mode=fast63.0 ± 3.622s954ms14,747
4Exa instantPOST /search type=instant61.3 ± 2.921s447ms22,423
5Parallel turboPOST /v1/search mode=turbo55.3 ± 1.521s454ms17,820
6Tavily fastPOST /search search_depth=fast47.3 ± 2.522s282ms23,922
7Linkup fastPOST /v1/search depth=fast43.3 ± 1.127s1.39s24,057
8Brave SearchPOST /res/v1/llm/context43.0 ± 2.023s547ms21,000

Common questions

What is the most accurate web search API for coding agents?

Exa deep leads search & fetch at 83.0%. Firecrawl leads search-only at 70.3%. The two boards are separate rankings. This is hard retrieval, not a general best-search score.