lumpinif/deepcrawl：100% 免费且完全开源的边缘 Firecrawl 替代方案

项目介绍

lumpinif/deepcrawl 是一个托管在 GitHub 上的开源项目，主要使用 TypeScript 编写，采用 MIT License 许可证，目前获得 699 个 Star、82 次 Fork。

仓库全名: lumpinif/deepcrawl

README 摘要

Deepcrawl WARNING: DO NOT USE DEEPCRAWL IN PRODUCTION RIGHT NOW AS IT IS SUBJECT TO CHANGE AND STILL UNDER RAPID DEVELOPMENT. USE AT YOUR OWN RISK! 100% free and open-source Firecrawl alternative with better performance and flexibility. Ask DeepWiki about this repo NOTE: DeepCrawl doesn’t target anti-scraping or anti-bot purposes. It’s optimized for high‑frequency agent workloads that scrape public pages to extract…

完整内容见 GitHub 原始 README 或本页。

常见问题

deepcrawl 用什么语言开发？

主要使用 TypeScript 编写，采用 MIT License 许可证，目前有 699 个 Star。

deepcrawl 可以免费商用吗？

如何获取 deepcrawl 的源码？

可以直接克隆仓库：git clone https://github.com/lumpinif/deepcrawl.git，默认分支为 main；安装与运行步骤见仓库 README。

deepcrawl 最近还在维护吗？

仓库最近一次更新为 8月25日，当前有 2 个未关闭 Issue；Star 数为 699，可作为社区活跃度的参考。

关于

GitHub 原始描述（英文）

100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

ai-agent-tools ai-sdk better-auth cloudflare-workers crawling deepcrawl hono html-cleaner html-to-markdown links-extraction links-tree nextjs nextjs16 orpc typescript web-scraper web-scraping

MIT License
699 Stars
82 Forks
5 Watching

描述取自 GitHub 官方 API，保持仓库作者书写的原文。

简要分析

热度分

868

价值分

444

活跃状态

活跃

GitHub

语言占比

CSS

JavaScript

MDX

Shell

TypeScript

Release

[email protected]2月9日
[email protected]2025年10月24日

贡献者

lumpinif

github-actions[bot]

franky47

Deepcrawl

WARNING: DO NOT USE DEEPCRAWL IN PRODUCTION RIGHT NOW AS IT IS SUBJECT TO CHANGE AND STILL UNDER RAPID DEVELOPMENT. USE AT YOUR OWN RISK!

100% free and open-source Firecrawl alternative with better performance and flexibility.

Ask DeepWiki about this repo

shots

NOTE: DeepCrawl doesn’t target anti-scraping or anti-bot purposes. It’s optimized for high‑frequency agent workloads that scrape public pages to extract cleaned Markdown and a hierarchical links tree.

Deepcrawl is an agent-oriented website data context extraction platform. It extracts cleaned markdown of page content, agent-favoured hierarchical links tree, and metadata that LLMs can digest with minimal token cost to reduce context switching and hallucination.

Full Platform (Nextjs Dashboard, API Workers, Auth Workers, and Database) is open and transparent.

Documentation

Visit https://deepcrawl.dev/docs to view the documentation.

Contributing

Please read the contributing guide.

License

Open Source. Open Code - built with ❤️ by @felixLu.

Star History

暂无评论

deepcrawl