GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
集合主题趋势排行榜
#

spider

Website
Wikipedia
https://static.github-zh.com/github_avatars/NaiboWang?size=40
NaiboWang / EasySpider

#前端开发#A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。

code-free爬虫GUIlaymanspiderparametersWebinput-parameters前端HTMLbatch-processingbatch-scriptvisual可视化visualprogrammingscraperdata-collectionrpaRobotics
JavaScript 39.06 k
21 天前
https://static.github-zh.com/github_avatars/gocolly?size=40
gocolly / colly

#爬虫框架#一个快速优雅的Golang爬虫框架

Goscraper框架爬虫scrapingcrawlingspider
Go 24.32 k
5 天前
https://static.github-zh.com/github_avatars/facert?size=40
facert / awesome-spider

#网络爬虫#爬虫集合

spiderPythonAwesome Lists
22.64 k
2 年前
https://static.github-zh.com/github_avatars/jhao104?size=40
jhao104 / proxy_pool

#网络爬虫#Python ProxyPool for web spider

爬虫proxyspiderRedisHTTP
Python 22.45 k
4 个月前
https://static.github-zh.com/github_avatars/shengqiangzhang?size=40
shengqiangzhang / examples-of-web-crawlers

#网络爬虫#一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

爬虫spidertaobaotmallExamplePythonSeleniumpyquerystockfundmultithreadingWeChat
Python 14.24 k
1 年前
Evil0ctal/Douyin_TikTok_Download_API
https://static.github-zh.com/github_avatars/Evil0ctal?size=40
Evil0ctal / Douyin_TikTok_Download_API

#网络爬虫#🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具,支持API调用,在线批量解析及下载。

PythonpywebioTikTokdouyinAPIscraperFastAPIno-watermarkonline-parsingasyncdouyin-tiktok-apidouyin-tiktok-download爬虫spiderweb-scrapingtiktok-scraperdouyin-scraperdouyin-apitiktok-apitiktok-signature
Python 13.03 k
3 个月前
crawlab-team/crawlab
https://static.github-zh.com/github_avatars/crawlab-team?size=40
crawlab-team / crawlab

#网络爬虫#Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

webcrawlerscrapycrawlabspiders-managementGoscrapyd-uispider爬虫webspiderweb-crawlerDockerplatformcrawling-tasks
Go 11.77 k
2 天前
https://static.github-zh.com/github_avatars/s0md3v?size=40
s0md3v / Photon

#夺旗赛 (CTF) 和网络安全资源#Incredibly fast crawler designed for OSINT.

爬虫spiderPythonOSINTinformation-gathering
Python 11.65 k
3 个月前
https://static.github-zh.com/github_avatars/ssssssss-team?size=40
ssssssss-team / spider-flow

#网络爬虫#新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。

spider爬虫jsoupxpathweb-spiderwebspiderwebcrawlerweb-crawlerspider-flow
Java 10.01 k
2 年前
https://static.github-zh.com/github_avatars/guyueyingmu?size=40
guyueyingmu / avbook

#网络爬虫#AV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

javbusavmoojavlibraryspider爬虫Laravelscraperadultmagnet-linkmagnet数据库adult-videoguzzlehttp
PHP 9.71 k
1 年前
https://static.github-zh.com/github_avatars/kangvcar?size=40
kangvcar / InfoSpider

#网络爬虫#INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰,旨在安全快捷的帮助用户拿回自己的数据,工具代码开源,流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开...

PythoncrawlspiderSeleniumwxpythontkinter自动化hotmailChromecsdnoutlook
Python 8.01 k
9 天前
https://static.github-zh.com/github_avatars/andeya?size=40
andeya / pholcus

#网络爬虫#Pholcus is a distributed high-concurrency crawler software written in pure golang

spider
Go 7.6 k
3 年前
https://static.github-zh.com/github_avatars/luyishisi?size=40
luyishisi / Anti-Anti-Spider

#网络爬虫#越来越多的网站具有反爬虫特性,有的用图片隐藏关键数据,有的使用反人类的验证码,建立反反爬虫的代码仓库,通过与不同特性的网站做斗争(无恶意)提高技术。(欢迎提交难以采集的网站)(因工作原因,项目暂停)

Pythonspidergeek
Python 7.3 k
4 年前
https://static.github-zh.com/github_avatars/lorien?size=40
lorien / awesome-web-scraping

#网络爬虫#List of libraries, tools and APIs for web scraping and data processing.

web-scrapingcaptcha-recaptchacrawlingscrapingscraping-frameworkscraping-pythonscraping-toolwebscraping爬虫spider
Makefile 7.04 k
6 个月前
https://static.github-zh.com/github_avatars/ihmily?size=40
ihmily / DouyinLiveRecorder

#网络爬虫#可循环值守和多人录制的直播录制软件,支持抖音、TikTok、Youtube、快手、虎牙、斗鱼、B站、小红书、pandatv、sooplive、flextv、popkontv、twitcasting、winktv、百度、微博、酷狗、17Live、Twitch、Acfun、CHZZK、shopee等40+平台直播录制

douyin-livevideo-downloaderdouyin-apidouyulivelive-recorderspiderdouyinTikTokdouyuhuyaTwitchYouTube
Python 6.95 k
1 天前
https://static.github-zh.com/github_avatars/BruceDone?size=40
BruceDone / awesome-crawler

#网络爬虫#A collection of awesome web crawler,spider in different languages

web-crawler爬虫web-scraperspiderscraperAwesome Lists
6.8 k
1 年前
https://static.github-zh.com/github_avatars/bda-research?size=40
bda-research / node-crawler

#网络爬虫#Web Crawler/Spider for NodeJS + server-side jQuery ;-)

爬虫JavaScriptspiderextract-datacheeriojQueryNode.js
TypeScript 6.76 k
18 天前
https://static.github-zh.com/github_avatars/SpiderClub?size=40
SpiderClub / haipproxy

#网络爬虫#💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

high-availabilityscrapyipproxydistributedRedis爬虫schedulerspider
Python 5.48 k
2 年前
https://static.github-zh.com/github_avatars/tophubs?size=40
tophubs / TopList

#网络爬虫#今日热榜,一个获取各大热门网站热门头条的聚合网站,使用Go语言编写,多协程异步快速抓取信息,预览:https://mo.fish

hotGospidertoday-s-hot-listhotlist
Go 4.71 k
2 年前
https://static.github-zh.com/github_avatars/wechatsync?size=40
wechatsync / Wechatsync

#网络爬虫#一键同步文章到多个内容平台,支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台,一次发布,多平台同步发布。解放个人生产力

Chrome 插件ChromeMarkdownmultiplatformblogwriterwechat-official-accountspiderVue.js
JavaScript 4.31 k
1 个月前
loading...