功能:支持全站爬取,搜索爬取。想下载什么内容自己定制,目前版本不支持独立页面下载,后续可能会考虑支持,目前我的目标是为了爬取整个网站,所以单页面下载功能不一定会做,即使做了也不一定什么时候会上。 参数说明:
xiurenji.exe 可执行文件名称 帮助: -h 显示帮助说明 必选参数: -a 整站爬取 -q 搜索爬取,针对关键字搜索之后对于搜索结果页进行爬取 可选参数: -p 制定下载目录,默认下载路径为当前exe所在目录下的images文件夹
C:\Users\obaby>F:\Pycharm_Projects\meitulu-spider\dist\xiurenji\xiurenji.exe -q 丝袜 **************************************************************************************************** _ _ ____ ___ | |__ __ _| |__ _ _ / __ \ _ __ ___ __ _ _ __ ___ / _ \| '_ \ / _` | '_ \| | | |/ / _` | '_ ` _ \ / _` | '__/ __| | (_) | |_) | (_| | |_) | |_| | | (_| | | | | | | (_| | | \__ \ \___/|_.__/ \__,_|_.__/ \__, |\ \__,_|_| |_| |_|\__,_|_| |___/ |___/ \____/ 秀人集爬虫 Verson: 21.6.21 Blog: http://www.h4ck.org.cn **************************************************************************************************** **************************************************************************************************** [*] 2021-06-21 20:59:36 QRY: 丝袜 开始搜索...... **************************************************************************************************** [*] 2021-06-21 20:59:38 QRY: 搜索完成,一共 50页。 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=1 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=2 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=3 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=4 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=5 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=6 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=7 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=8 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=9 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=10 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=11 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=12 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=13 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=14 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=15 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=16 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=17 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=18 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=19 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=20 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=21 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=22 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=23 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=24 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=25 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=26 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=27 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=28 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=29 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=30 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=31 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=32 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=33 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=34 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=35 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=36 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=37 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=38 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=39 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=40 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=41 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=42 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=43 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=44 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=45 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=46 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=47 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=48 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=49 [*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=50 [*] 2021-06-21 20:59:38 QRY: 搜索完成,准备下载。 **************************************************************************************************** **************************************************************************************************** [*] 2021-06-21 20:59:39 PAGE: 开始分析页面链接 [*] 2021-06-21 20:59:39 PAGE: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=1 [*] 2021-06-21 20:59:39 DOWNLOAD: 开始下载:[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P [*] 2021-06-21 20:59:39 DOWNLOAD: http://www.xiurenji.cc/YouMi/8493.html [*] 2021-06-21 20:59:39 DOWNLOAD: 下载目录:[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P [*] 2021-06-21 20:59:40 IMG: 正在下载:http://www.xiurenji.cc/uploadfile/202106/21/7516653888.jpg [*] 2021-06-21 20:59:40 IMG: 图片保存路径:F:\Pycharm_Projects\meitulu-spider\dist\xiurenji\images/[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P\67ea4b8c9babc3539a65c22749e40cc3.jpg文件哈希:
名称: xiurenji.rar 大小: 8039801 字节 (7851 KiB) SHA256: 781AE36CA75D678974E152194BE0C61EE7B9EBF2E62E2DED2FA7BDA38F6CC28F
107 comments
爬虫写的好,牢饭吃到饱,哈哈
瑟瑟发抖~~
技术是为爱好服务的宗旨没有变
怎么下载啊?
刷新一下就可以下了~
下载地址?
发表评论请勾选 在此浏览器中保存我的显示名称、邮箱地址和网站地址,以便下次评论时使用。 否则无效~~
再重新发一条即可~~
站内信已经发送链接~
正想要爬这个站的图,原来已经有先行者了
可以的
谢谢分享
满网找资源,找到了这里,多谢!
谢谢分享!!
谢谢分享!!
感谢分享!!
看看源码
非常好
感谢老哥分享,作揖!
谢谢分享!
感谢分享!
感谢分享
技术实现生活
厉害
学到了
感谢分享
不会使用的参考这里:https://weibo.com/2120123121/KuYiEkkhW
感谢分享!
瑟瑟发抖 试试
卧槽强啊
太强了,感谢分享!
请问搜索爬取提示[2408] Failed to execute script xiurenji该怎么办?
windows版本?来个全面日志,这么一句看不出原因
谢谢大佬
老哥,你微博是什么,上面那个微博地址找不到了,我爬取失败了,想请教一下,跟上面那个老哥显示一样的结果。另外,如果秀人集网站换地址了,要怎么修改爬虫?
微博上其实没什么东西,https://weibo.com/cracklab/home
目前域名不能用了,等节后更新一个支持指定域名版本