benchmarks/web-search/web search for coding agents/most token efficient search API
100tasks · hard retrieval · search & fetch and search-only

Most token-efficient web search API for coding agents

Ranked on the hard retrieval task of the web search benchmark. A pass requires a grounded source URL from that run's search or fetch.

TinyFish is most token-efficient on search & fetch at 12,844 tokens. Firecrawl is most token-efficient on search-only at 7,456 tokens.

Most token-efficient on this board is median task tokens, not search-API list price. Search & fetch and search-only are separate rankings.

Most accurate · Fastest · Most token efficient · Full benchmark

Factual lookup (accuracy per 1,000 snippet tokens, web search APIs): most token-efficient for AI agents →

open codeRunner and scoring are public in openbenchmarks-labs/web-search-for-coding-agents.github →

Ranking, sorted by median task tokens

Top 8 by median task tokens
Search & fetch, ranked by median task tokens
RankVendorEndpoint & configurationTask completionMedian task timeMedian task costAvg search timeMedian task tokensAPI list price
1TinyFishGET api.search.tinyfish.aiGET api.fetch.tinyfish.ai format=markdown79.0 ± 2.024s$0.050$0.000 search+fetch$0.050 token cost1.32s12,844$0 / search$0 / fetch
2NimblePOST /v2/search search_depth=lite · full_content=false · focus=generalPOST /v2/extract formats=[markdown]60.3 ± 2.540s$0.054$0.054 token cost1.93s16,828$0.0011 / search
3FirecrawlPOST /v2/searchPOST /v2/scrape76.0 ± 1.034s$0.082$0.028 search+fetch$0.055 token cost2.81s17,379$0.005 / search$0.0025 / fetch
4PerplexityPOST /search search_context_size=highPOST /search search_context_size=high77.7 ± 1.522s$0.083$0.025 search+fetch$0.058 token cost991ms20,062$0.005 / search$0.005 / fetch
5Exa deepPOST /search type=deepPOST /contents83.0 ± 1.037s$0.127$0.057 search+fetch$0.070 token cost3.97s23,660$0.012 / search$0.001 / fetch
6Tavily advancedPOST /search search_depth=advancedPOST /extract extract_depth=advanced60.0 ± 2.046s$0.153$0.085 search+fetch$0.069 token cost3.41s26,269$0.016 / search$0.0032 / fetch
7Parallel advancedPOST /v1/search mode=advancedPOST /v1/extract77.0 ± 1.033s$0.096$0.019 search+fetch$0.077 token cost3.11s27,092$0.005 / search$0.001 / fetch
8Tavily basicPOST /search search_depth=basicPOST /extract extract_depth=basic59.0 ± 1.732s$0.113$0.043 search+fetch$0.070 token cost1.50s27,405$0.008 / search$0.0016 / fetch
9Exa autoPOST /search type=autoPOST /contents81.7 ± 1.123s$0.107$0.032 search+fetch$0.074 token cost1.19s27,433$0.007 / search$0.001 / fetch
10NimblePOST /v2/search search_depth=standard · full_content=false · focus=generalPOST /v2/extract formats=[markdown]45.0 ± 1.044s$0.078$0.078 token cost905ms28,586$0.005 / search
11Parallel basicPOST /v1/search mode=basicPOST /v1/extract76.0 ± 0.030s$0.107$0.023 search+fetch$0.084 token cost1.59s32,809$0.005 / search$0.001 / fetch
12YouPOST /v1/search extraction_mode=highlights · knowledge=corePOST /v1/contents54.0 ± 2.028s$0.117$0.026 search+fetch$0.091 token cost678ms37,453$0.005 / search$0.001 / fetch
13YouPOST /v1/search extraction_mode=highlightsPOST /v1/contents55.0 ± 1.727s$0.119$0.027 search+fetch$0.092 token cost638ms42,806$0.005 / search$0.001 / fetch
14Linkup standardPOST /v1/search depth=standardPOST /v1/fetch mode=standard48.3 ± 4.948s$0.147$0.038 search+fetch$0.108 token cost2.00s57,791$0.005 / search$0.005 / fetch

Search-only, same sort

Top 8 by median task tokens
Search-only, ranked by median task tokens
RankVendorEndpoint & configurationTask completionMedian task timeMedian task costAvg search timeMedian task tokensAPI list price
1FirecrawlPOST /v2/search70.3 ± 1.528s$0.059$0.025 search$0.034 token cost2.87s7,456$0.005 / search
2TinyFishGET api.search.tinyfish.ai59.3 ± 1.528s$0.035$0.000 search$0.035 token cost2.15s7,469$0 / search
3NimblePOST /v2/search search_depth=lite · full_content=false · focus=general46.7 ± 3.833s$0.043$0.005 search$0.037 token cost3.15s8,713$0.0011 / search
4PerplexityPOST /search search_context_size=low77.3 ± 2.118s$0.059$0.025 search$0.034 token cost957ms8,765$0.005 / search
5Parallel fastPOST /v1/search mode=fast66.7 ± 1.522s$0.054$0.005 search$0.049 token cost953ms12,460$0.001 / search
6BravePOST /res/v1/llm/context38.0 ± 2.620s$0.082$0.025 search$0.057 token cost523ms14,103$0.005 / search
7Parallel turboPOST /v1/search mode=turbo64.7 ± 2.119s$0.059$0.005 search$0.054 token cost333ms14,130$0.001 / search
8NimblePOST /v2/search search_depth=standard · full_content=false · focus=general42.3 ± 2.525s$0.079$0.025 search$0.054 token cost878ms14,859$0.005 / search
9Tavily basicPOST /search search_depth=basic51.0 ± 5.326s$0.097$0.040 search$0.057 token cost1.72s16,299$0.008 / search
10YouPOST /v1/search extraction_mode=highlights41.3 ± 3.124s$0.097$0.025 search$0.072 token cost596ms20,333$0.005 / search
11YouPOST /v1/search extraction_mode=highlights · knowledge=core38.3 ± 3.221s$0.096$0.025 search$0.071 token cost677ms20,786$0.005 / search
12Exa fastPOST /search type=fast66.3 ± 1.520s$0.103$0.035 search$0.068 token cost626ms22,344$0.007 / search
13Exa instantPOST /search type=instant61.3 ± 2.921s$0.105$0.035 search$0.070 token cost447ms22,423$0.007 / search
14Linkup fastPOST /v1/search depth=fast43.3 ± 1.127s$0.100$0.025 search$0.075 token cost1.39s24,057$0.005 / search

Common questions

What is the most token-efficient web search API for coding agents?

TinyFish is most token-efficient on search & fetch at 12,844 tokens. Firecrawl is most token-efficient on search-only at 7,456 tokens. That is the LLM bill for the coding loop, not search-API list price.