Website Content Crawler
by apify · live from apify/website-content-crawler · website-content-crawler-pifazo.apimarketplace.io
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
- Runs
- 40.6M
- Users
- 150.1K
- 223 reviews
- 4.6
- Success (30d)
- 96%
Billed $168 once a year
100,000 run tokens are added to this product's wallet every period.
Billed monthly, cancel anytime
100,000 run tokens are added to this product's wallet every period.
One subscription, scoped to Website Content Crawler alone — no generic dashboard.
Want to look around first?
The demo account already owns this product — open its workspace, run the playground and browse the history without paying.
What a run costs
Tokens are spent at this API's real metered rate — nothing is marked up. When the balance runs out, runs pause instead of overspending.
- 100,000
- tokens every period
- —
- tokens per result
- —
- results included
Structured rows, ready for a warehouse or a spreadsheet.
| url | title | text | author | likes |
|---|---|---|---|---|
| https://example.com/website-content-crawler-pifazo/1qxr | forge beacon prism vector | forge beacon prism vector vertex harvest quantum signal cascade delta atlas nimbus | forge_467 | 3567 |
| https://example.com/website-content-crawler-pifazo/1qym | delta atlas nimbus insight | delta atlas nimbus insight summit pipeline orbit forge beacon prism vector vertex | delta_498 | 3598 |
| https://example.com/website-content-crawler-pifazo/1qzh | prism vector vertex harvest | prism vector vertex harvest quantum signal cascade delta atlas nimbus insight summit | prism_529 | 3629 |
curl -X POST https://www.datarouter.dev/s/website-content-crawler-pifazo/api/v1/runs \
-H "Authorization: Bearer $AM_KEY" \
-H "Content-Type: application/json" \
-d '{"input":{"maxItems":10},"wait":true}'