benchmarks/web-search/web search for coding agents/most token efficient search API
100tasks · hard retrieval · search & fetch and search-only

Most token-efficient web search API for coding agents

Ranked on the hard retrieval task of the web search benchmark. A pass requires a grounded source URL from that run's search or fetch. Rankings do not transfer from factual lookup or multi-hop.

Firecrawl is most token-efficient on search & fetch at 17,379 tokens. Firecrawl is most token-efficient on search-only at 7,456 tokens.

Most token-efficient on this board is median task tokens, not search-API list price. Search & fetch and search-only are separate rankings.

Most accurate · Fastest · Most token efficient · Full benchmark

open codeRunner and scoring are public in openbenchmarks-labs/web-search-for-coding-agents.github →

Ranking, sorted by median task tokens

Search & fetch, ranked by median task tokens
RankVendorEndpoint & configurationTask completionMedian task timeAvg search timeMedian task tokens
1FirecrawlPOST /v2/searchPOST /v2/scrape76.0 ± 1.034s2.81s17,379
2Exa deepPOST /search type=deepPOST /contents83.0 ± 1.037s3.97s23,660
3Tavily advancedPOST /search search_depth=advancedPOST /extract extract_depth=advanced60.0 ± 2.046s3.41s26,269
4Tavily basicPOST /search search_depth=basicPOST /extract extract_depth=basic59.0 ± 1.732s1.50s27,405
5Exa autoPOST /search type=autoPOST /contents81.7 ± 1.123s1.19s27,433
6Parallel advancedPOST /v1/search mode=advancedPOST /v1/extract79.3 ± 2.139s3.08s29,925
7Parallel basicPOST /v1/search mode=basicPOST /v1/extract73.7 ± 2.337s1.70s41,475
8Linkup standardPOST /v1/search depth=standardPOST /v1/fetch mode=standard48.3 ± 4.948s2.00s57,791

Search-only, same sort

Search-only, ranked by median task tokens
RankVendorEndpoint & configurationTask completionMedian task timeAvg search timeMedian task tokens
1FirecrawlPOST /v2/search70.3 ± 1.528s2.87s7,456
2Parallel fastPOST /v1/search mode=fast63.0 ± 3.622s954ms14,747
3Parallel turboPOST /v1/search mode=turbo55.3 ± 1.521s454ms17,820
4Brave SearchPOST /res/v1/llm/context43.0 ± 2.023s547ms21,000
5Exa fastPOST /search type=fast66.3 ± 1.520s626ms22,344
6Exa instantPOST /search type=instant61.3 ± 2.921s447ms22,423
7Tavily fastPOST /search search_depth=fast47.3 ± 2.522s282ms23,922
8Linkup fastPOST /v1/search depth=fast43.3 ± 1.127s1.39s24,057

Common questions

What is the most token-efficient web search API for coding agents?

Firecrawl is most token-efficient on search & fetch at 17,379 tokens. Firecrawl is most token-efficient on search-only at 7,456 tokens. That is the LLM bill for the coding loop, not search-API list price.