Firecrawl

Crawl and convert any website into clean markdown or structured data. It's also open-source

web scraping
Firecrawl

Introduction

🔥 Firecrawl

Crawl and convert any website into LLM-ready markdown or structured data. Built by Mendable.ai and the Firecrawl community. Includes powerful scraping, crawling and data extraction capabilities.

This repository is in its early development stages. We are still merging custom modules in the mono repo. It's not completely yet ready for full self-host deployment, but you can already run it locally.

What is Firecrawl?

Firecrawl is an API service that takes a URL, crawls it, and converts it into clean markdown or structured data. We crawl all accessible subpages and give you clean data for each. No sitemap required.

Details

Github

firecrawl

Submitter

Date

2024/06/23