GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
集合主题趋势排行榜
#

crawl4ai

Website
Wikipedia
https://static.github-zh.com/github_avatars/kaymen99?size=40
kaymen99 / ai-web-scraper

#网络爬虫#AI web scraper built with Crawl4AI for extracting structured leads data from websites.

ai-agentsai-scrapingcrawl4ai大语言模型scraperweb-scraperweb-scraping
Python 44
7 个月前
https://static.github-zh.com/github_avatars/laurentvv?size=40
laurentvv / crawl4ai-mcp

Web crawling tool that integrates with AI assistants via the MCP

crawl4aimcpPythonai-toolsweb-crawler
Python 30
23 天前
https://static.github-zh.com/github_avatars/bigsk1?size=40
bigsk1 / supa-crawl-chat

#网络爬虫#Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!

crawl4aiopenai-apiSupabase爬虫embeddingsgpt-4opgvectorPostgreSQLStreamlitDockerFastAPIscraping
Python 20
1 个月前
https://static.github-zh.com/github_avatars/varunsaagar?size=40
varunsaagar / crawlwithagents

#网络爬虫#The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, ...

agents爬虫keyword-extraction大语言模型ollamaqwen2搜索引擎优化 (SEO)webscrapercrawl4ai
Python 17
1 年前
https://static.github-zh.com/github_avatars/oussemabenhassena5?size=40
oussemabenhassena5 / Crawl4DeepSeek

Crawl4DeepSeek = Crawl4AI + DeepSeek 🚀 Smart, efficient, and built for deep web exploration! 🌐🤖

crawl4aideepseekPythonwebscraping
Python 15
7 个月前
https://static.github-zh.com/github_avatars/NhanPhamThanh-IT?size=40
NhanPhamThanh-IT / Deepnews-Summarizer

#自然语言处理#A feature-rich web application for automated news scraping and summarization. It allows users to enter article URLs, fetches the full content, and generates concise summaries. The system supports both...

applicationFastAPIhuggingface-transformersPythonStreamlitcrawl4ai部署fine-tuning大语言模型自然语言处理render
Python 7
3 个月前
https://static.github-zh.com/github_avatars/GreatHayat?size=40
GreatHayat / yt-shorts-generator

Generate YouTube Shorts Video From an Article Link using Pydantic AI

agents人工智能aiagentaiagentscrawl4aidalle-3FFmpegPython
Python 7
7 个月前
https://static.github-zh.com/github_avatars/Karthick-840?size=40
Karthick-840 / Crawl4ai-RAG-with-Local-LLM

#大语言模型#A tool for scraping web documentation using Crawl4AI, converting it to Markdown, and preparing it for integration with local LLMs (like Ollama) to enhance their knowledge for learning and "vibe coding...

crawl4ai大语言模型ollamaragstarcoderweb-scraping-python
Python 6
2 个月前
https://static.github-zh.com/github_avatars/mzazakeith?size=40
mzazakeith / PuppetMaster

#网络爬虫#Puppeteer & Crawl4AI microservice for web automation, scraping, and AI processing with Bull queues

人工智能自动化crawl4ai爬虫datadata-extractionextraction大语言模型Puppeteerweb-automationgeminiopenaibullbullmqagentChromePlaywright
Python 5
3 个月前
https://static.github-zh.com/github_avatars/BjornMelin?size=40
BjornMelin / qdrant-neo4j-crawl4ai-mcp

MCP server combining Qdrant vector search, Neo4j knowledge graphs, and Crawl4AI web intelligence with agentic RAG capabilities. FastMCP 2.0 architecture with enterprise security, monitoring, and Kuber...

agentic-rag人工智能crawl4aifastmcpgraph-databasehybrid-searchKubernetesmcpmcp-serverNeo4jpydantic-v2qdrantrerankingsemantic-searchvector-database
Python 4
2 个月前
https://static.github-zh.com/github_avatars/drisskhattabi6?size=40
drisskhattabi6 / AI-Scraper

#网络爬虫#AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot

ai-scrapingcrawl4ai爬虫crawlingollamaollama-apiopenrouterscraperscrapingSeleniumselenium-pythonStreamlitstreamlit-webapp
Python 3
3 个月前
https://static.github-zh.com/github_avatars/kanwar19031?size=40
kanwar19031 / AI-ChatBot

A friendly AI chatbot that shares the wisdom of Utkarsh Classes by default, while letting you effortlessly transform any website into your personalized Q&A learning hub

crawl4aigemini-proStreamlit
Python 2
8 个月前
https://static.github-zh.com/github_avatars/f3riend?size=40
f3riend / manga-saver

Save manga as pdf

mangamanga-downloaderpdf-generationweasyprintcrawl4aidesktop-appcustomizableFastAPI
Python 2
2 个月前
https://static.github-zh.com/github_avatars/sadiuysal?size=40
sadiuysal / crawl4ai-mcp-server

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect...

ai-agentsclaude-codecrawl4aicursormcpmodel-context-protocolopenai-agentsopenai-agents-sdkweb-crawlingweb-scraping
Python 2
19 天前
https://static.github-zh.com/github_avatars/yashpinjarkar10?size=40
yashpinjarkar10 / Pinescript-Agent

PineScript Agentic RAG system that provides an interactive chat interface to answer questions about PineScript. It combines a Streamlit-based UI with an asynchronous AI agent to retrieve and summarize...

crawl4aigeminipydanticPythonStreamlit
Python 2
7 个月前
https://static.github-zh.com/github_avatars/sidhyaashu?size=40
sidhyaashu / scrapy-deepseek

Scrap any website using deepseek

deepseekPythoncrawl4aigroq
Python 1
7 个月前
https://static.github-zh.com/github_avatars/JamesN-dev?size=40
JamesN-dev / Scroll-Scribe

#大语言模型#ScrollScribe is a Python CLI toolkit that grab docs or index website pages and converts them into clean local Markdown using browser automation and LLM filtering, perfect for building RAG datasets.

crawl4aiPython大语言模型rag
Python 1
2 个月前
https://static.github-zh.com/github_avatars/Aparnap2?size=40
Aparnap2 / clarification_agent

an AI-powered agent that clarifies ambiguous user queries, gathers missing information, and provides actionable, context-aware responses. It leverages LangGraph to create a modular and extensible arch...

crawl4ailanggraphopenrouterPythonStreamlit
Python 1
15 天前
https://static.github-zh.com/github_avatars/Svantevith?size=40
Svantevith / talk-to-your-website

#大语言模型#RAG agent enhanced with LLM-optimized website crawler built using Crawl4AI, Langchain, ChromaDB and Ollama.

人工智能聊天机器人chromadbcrawl4aigenaigenerative-ailangchainlarge-language-models大语言模型机器学习ollamaPythonrag
Python 1
4 个月前
https://static.github-zh.com/github_avatars/sitammeur?size=40
sitammeur / crawl4ai-txtfy

Easily retrieve the full-text content from web pages using Crawl4AI.

flask-apihtml-css-javascriptpytestPythonTailwind CSScrawl4ai
Python 1
10 个月前
loading...