Decodo Launches API For AI Agents To Access Web Data
Decodo introduces a new API that simplifies web data access for AI startups, allowing them to focus on product development. This move may reduce the time and resources spent on building scraping infrastructure.
Original reporting · searchenginejournal.com
Original: “Decodo Launches Web Data API To Give AI Agents Web Access”
Read “Decodo Launches Web Data API To Give AI Agents Web Access” at Search Engine Journal →
How this was written. Content Delta wrote this article with a language model from Search Engine Journal’s reporting (model: @cf/meta/llama-3.3-70b-instruct-fp8-fast); it describes that reporting rather than adding to it. The original, linked above, is the full story.
Key points from Search Engine Journal’s report
- Decodo's Web Data API simplifies web data access for AI startups, allowing them to focus on product development.
- The API offers a single interface for scraping, mapping, crawling, and searching the web, reducing the need for separate contracts.
- The API supports Decodo's proxy network of over 125 million IPs spanning 195+ locations, which may help reduce the risk of bot detection.
- The API is already being used by teams for various workflows, such as converting documentation sites to clean Markdown and creating coding tools.
- Decodo is offering a free tier with a limited number of requests per month, allowing teams to test the API before deciding on a paid plan.
Decodo, a leading web data infrastructure provider, has announced the launch of its Web Data API, according to Search Engine Journal. This API is designed to streamline the process of scraping, mapping, crawling, and searching the web for AI startups building agents or retrieval pipelines.
The Web Data API offers a single interface for accessing fresh, structured web data, which is essential for AI models that require up-to-date information. Language models, for instance, train on a fixed information snapshot, but agents tracking companies or news feeds need the latest data.
Building and maintaining web scraping infrastructure can be time-consuming and may take away from product development. AI startups often have to run scrapers behind rotating IPs, navigate CAPTCHAs and bot detection, and clean up incomplete pages, which can be a significant challenge.
The Web Data API aims to eliminate this additional work by providing four endpoints on one account and one API key. This means that separate contracts for scraping, search, mapping, and crawling are no longer necessary, simplifying the procurement process.
Each endpoint addresses a distinct stage in the web data collection process, including scraping, searching, mapping, and crawling. The API also supports Decodo's proxy network of over 125 million IPs spanning 195+ locations, which may help reduce the risk of bot detection.
The new API is already being used by teams for various workflows, such as converting documentation sites to clean Markdown, creating coding tools, and locating documents on regulator sites. These workflows can be tailored to each user's needs, and the API may help reduce the need for separate scraping stacks.
Decodo is offering a free tier with a limited number of requests per month, which may allow teams to test the API before deciding on a paid plan. This free tier resets each month, giving teams the opportunity to run a pilot project and evaluate the API's fit within their existing stack.
Questions and answers
What is the Web Data API?
The Web Data API is a new API launched by Decodo that simplifies web data access for AI startups, allowing them to focus on product development.
How does the Web Data API work?
The API offers a single interface for scraping, mapping, crawling, and searching the web, reducing the need for separate contracts and simplifying the procurement process.
Is there a free tier available for the Web Data API?
Yes, Decodo is offering a free tier with a limited number of requests per month, allowing teams to test the API before deciding on a paid plan.
