本项目依赖的第三方库:
requests
在终端执行以下语句安装依赖即可:
pip install requests
有Python环境
将题库.csv与main.py放于同一目录下,直接运行main.py文件即可.
无Python环境 下载可执行文件，将题库.csv与main.exe置于同一文件夹，直接运行即可.
豆瓣电影 A crawler of doubamovie 一个小小的入门级scrapy框架的应用，选取豆瓣电影对排行榜前1000的电影数据进行爬取。 spider.py start_requests方法为scrapy的方法，我们对它进行重写。 def start_requests(self):
Shopee Scraper A web scraper in python that extract sales, price, avaliable stock, location and more of a given seller in Brazil. The project was crea
Media-WebScraper This program scrapes information and images for movies and TV shows. Summary For more information on the program, read the WebScrape_
Social Media Scraper An utility library to scrape data from TikTok, Instagram, Twitch, Youtube, Twitter or Reddit in one line! Go to the website » Vie
Introduction A dead simple crawler to get books information from Douban. Pre-requesites Python 3 Install dependencies from requirements.txt (Optional)
printStealer 1.1 What is this tool? This tool is developed to show the insecurity of the screenshot utility called prnt sc. It is a site that stores s
Proxy Scraper A simple proxy scraper that utilizes the requests module in python. Usage Depending on your python installation your commands may vary.
web-scraping Program that scrapes a website for a collection of quotes, picks on
ScrapInsta A script to scraping data from Instagram Install First of all you can run: pip install scrapinsta After that you need to install these requ
release-notes-scraper This simple script can be used to grab the release notes for projects from github that do not keep a CHANGELOG, but publish thei
AutoScraper: A Smart, Automatic, Fast and Lightweight Web Scraper for Python This project is made for automatic web scraping to make scraping easy. It
Meme Videos Scrapes memes from reddit using praw and request and then converts t
Pythonic Crawling / Scraping Framework Built on Eventlet Features High Speed WebCrawler built on Eventlet. Supports relational databases engines like
Une PS5 pour Noël Python + Chrome --headless = une PS5 pour noël MacOS Installer chrome Tweaker le .yaml pour la listes sites a scrap et les criteres
An Arxiv Spider 做为一个cser，杰出男孩深知内核对连接到计算机上的硬件设备进行管理的高效方式是中断而不是轮询。每当小伙伴发来一篇刚挂在arxiv上的”热乎“好文章时，杰出男孩都会感叹道：”师兄这是每天都挂在arxiv上呀，跑的好快~“。于是杰出男孩找了找 github，借鉴了一下其
原神圣遗物半自动爬虫 说明 直接抓取原神界面中的圣遗物数据 目前只适配了背包页面的抓取 准确率：97.5%(普通通用接口，对 40 件随机圣遗物识别，统计完全正确的数量为 39) 准确率：100%(4k 屏幕，普通通用接口，对 110 件圣遗物识别，统计完全正确的数量为 110) 不排除还有小错误的
STW-Collection Scrap The Web Collection; blog posts. This repo contains Scrapy sample code to scrap the following kind of websites: Do you want to lea
Parsel Parsel is a BSD-licensed Python library to extract and remove data from HTML and XML using XPath and CSS selectors, optionally combined with re
WebScraping Web scraping Pyton program that scrapes Job website for python devel
This is a simple website crawler which asks for a website link from the user to crawl and find specific data from the given website address.
1 Oct 05, 2021
5 Nov 29, 2022
1 Dec 05, 2021
2 Aug 03, 2022
1 Jan 10, 2022
4 Jul 26, 2022
3 Sep 08, 2021
1 Jan 07, 2022
1 Sep 05, 2021
4 Apr 01, 2022
4.8k Jan 04, 2023
12 Oct 28, 2022
173 Dec 05, 2022
3 Feb 13, 2022
11 Sep 09, 2022
28 Oct 10, 2022
15 Jun 08, 2022
859 Dec 29, 2022
2 Jul 22, 2022
1 Jan 10, 2022