Tavily

{
  "query": "artificial intelligence trends 2024",
  "answer": "AI-generated summary of findings...",
  "results": [
    {
      "title": "AI Trends Report 2024",
      "url": "https://example.com/ai-trends",
      "content": "Summary of the page content...",
      "score": 0.95,
      "published_date": "2024-01-15",
      "raw_content": "Full HTML content (if requested)",
      "favicon": "https://example.com/favicon.ico"
    }
  ],
  "images": [
    {
      "url": "https://example.com/image.jpg",
      "description": "AI visualization"
    }
  ],
  "follow_up_questions": [
    "What are the key AI breakthroughs in healthcare?",
    "How is AI impacting software development?"
  ]
}

"Search for recent developments in the electric vehicle market, focusing on Tesla's competitors"

"Search news from the last 7 days about climate change policy"

"Find technical documentation about React hooks from the official React website"

{
  "results": [
    {
      "url": "https://example.com/article",
      "raw_content": "Extracted content in specified format...",
      "images": [
        "https://example.com/image1.jpg",
        "https://example.com/image2.jpg"
      ],
      "favicon": "https://example.com/favicon.ico"
    }
  ]
}

"Extract the content from these three blog posts: [url1], [url2], [url3]"

"Extract all content and images from this LinkedIn profile: [linkedin-url]" (use advanced depth)

"Get the full text content from this research paper: [pdf-url]"

{
  "base_url": "https://example.com",
  "results": [
    {
      "url": "https://example.com/page1",
      "raw_content": "Extracted page content...",
      "favicon": "https://example.com/favicon.ico"
    },
    {
      "url": "https://example.com/page2",
      "raw_content": "Extracted page content..."
    }
  ],
  "response_time": 3.5
}

"Crawl the React documentation starting from docs.react.dev and extract all content about hooks"

"Systematically crawl example.com/blog with max depth of 2 and extract all blog posts"

"Crawl the /api section of this documentation site and map all endpoints"

{
  "base_url": "https://example.com",
  "results": [
    "https://example.com/about",
    "https://example.com/products",
    "https://example.com/products/item1",
    "https://example.com/contact",
    "https://example.com/blog"
  ],
  "response_time": 2.1
}

"Map the structure of example.com to see all main sections and pages"

"Create a site map for docs.example.com focusing only on the /api paths"

"Map all product pages on this e-commerce site starting from /products"

429 Too Many Requests - Monthly quota exceeded

401 Unauthorized - Invalid API key

No relevant results found for query

["nytimes.com", "washingtonpost.com", "reuters.com"]

["https://nytimes.com", "www.washingtonpost.com", "https://www.reuters.com/"]

Server connection timeout or unavailable

"Compare [A] vs [B] based on [criteria] with recent data"
"What are the main differences between [A] and [B]?"
"Pros and cons of [topic] from expert perspectives"

"What are emerging trends in [industry] for 2024?"
"How has [topic] evolved over the past [timeframe]?"
"Latest developments in [field] according to recent research"

"What do leading experts say about [topic]?"
"Find recent expert opinions and analysis on [issue]"
"Search for thought leadership content about [subject]"

"Find statistics and data about [topic] from authoritative sources"
"What research and studies support [claim]?"
"Search for peer-reviewed evidence on [medical/scientific topic]"

"Latest news from the past 24 hours about [event]"
"Historical analysis of [topic] from 2020 to present"
"Track how [narrative/understanding] has changed over time"

"US market analysis of [product/service]"
"European regulations regarding [topic]"
"Search prioritizing sources from [country]"

"Find official documentation for [technical topic]"
"Search for case studies about [business challenge]"
"Locate white papers on [industry topic]"
"Find tutorial or how-to content for [skill]"

["/docs/.*"]           // Only documentation pages
["/api/v2/.*"]        // Specific API version
["/blog/\\d{4}/.*"]   // Blog posts with year
["/products/.*"]       // Product pages

["^docs\\.example\\.com$"]           // Exact subdomain
["^.*\\.example\\.com$"]             // All subdomains
["^(docs|api)\\.example\\.com$"]     // Specific subdomains

✅ Extract multiple URLs in one call:
"Extract content from these 5 URLs: [url1, url2, url3, url4, url5]"
→ 1 request

❌ Extract URLs separately:
5 separate extract calls
→ 5 requests

✅ Map first, then targeted crawl:
Map (1 request) → understand structure → focused crawl (1 request)
→ 2 requests total, but more efficient

❌ Blind crawling:
Large crawl with poor parameters → wasted pages
→ 1 request, but inefficient use