Skip to content

krilifon/proxy-parse

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Proxy Parser

About

Synchronous library, for convenient and fast parsing of proxies from different sources.

Uses Scrapy as a parser.

At the moment the library does not support automatic proxy check, this option will be added in the asynchronous version of the library.

Installation

Installing the latest version of the library:

pip install proxy-parse

Example

from proxy_parse import ProxyParser

proxy_parser = ProxyParser()
proxies_list = proxy_parser.parse()

If you need, you can add some parameters to the ProxyParser class:

  • path_to_file - optional str parameter, the proxies will be saved to a file at the path
  • proxy_limit - optional int parameter, the ProxyParser.parse function will return as many proxies as you need
  • scrapy_spiders - optional scrapy.Spider list parameter, you can add your own spiders, which will work together with the others
  • scrapy_settings - optional dict parameter, you can replace the library rules with your own

Contribution

Any changes from you will be good for the life of the library

About

Easy-to-use sync library for handy proxy parse

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages