Subdomain enumeration,Web scraping and finding usernames automation script written in python

Last update: Nov 22, 2022

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

git clone https://github.com/d8rkmind/Pyosint.git
cd PyOsint
pip3 install -r requirements.txt

Usage :

python3 Pyosint.py [OPTIONS]

Brief info:

The main functionality of this program has been divided to 3 parts

Find - Module to search For usenames form a list of 326 websites
Scrap - To Scrap a website to extract all links form a given website and store it in a file
Enum - To automate the search of subdomains of a given domain from different services

In Scrap module results are automatically stored in output/web folder wit he ip-address of the website as the filename

The services used are Virus Total,PassiveDns,CrtSearch,ThreatCrowd
Enum module an Api key of Virus total that you can get from going Here

Paste the key inside api.json file:

* if this step is not done Virus total may block your request

Command Line Utilization Information.

The following are the sub-commands that work this program

Arguments	Shot form	Long form	Functionality
Name	-n	--name	To specify the domain name or username to use
Module	-m	--module	To specify which module to use
Output	-o	--output	To specify outputfile name
Thread	-t	--threads	To specify the number of threads to use [ Not applicable to web crawling ]
Limit	-l	--limit	to specify the maxium value of web urls to crawl [ Applicable only to web crawling ]
Verbose	-v	--verbose	To enable verbose mode [ Applicable only to Enumeration ]
Ports	-p	--ports	To specify the ports to scan [ Applicable only to Enumeration ]
Help	-h	--help	To Show the help options

Example :

Linux commands:

python3 pyosint.py -m find -n exampleuser               <-- Username-huntdown

python3 pyosint.py -m scrap -n http://scanme.nmap.org   <-- Scrapping using bot

python3 pyosint.py -m enum -n google.com                <-- Subdomain enum

The project is still in development and will be added with additional functionality.
Happy to hear suggestions for improvement.

Special Thanks to 𝓣𝓮𝓬𝓱𝓷𝓸𝓻𝓮𝓬𝓴 and 𝓢𝓱𝓾𝓷𝓾𝔁 - 𝓢𝓽𝓾𝔁𝓷𝓮𝓽 for working in this project

Note :

This is only for educational and research purposes.The developers will not be held responsible for any harm caused by anyone who misuses the material.

License :

Pyosint is licensed under the GNU GPL license. take a look at the LICENSE for more information

Update informations

Update on 18-8-21:

Rewritten the code completely ,Improved interface

Update on 20-8-21:

Subdomain enumeration module (enum) has been added

Update on 23-8-21:

Find module code that has been optimised. The number of sites to automate has grown from 14 to 147, and connection error has been resolved.

Update on 16-09-21:

Program has been re-written to work with arguments
Find module has been added threading Functionality
Output functionality has been added to every module
More Error handiling has been added
Number of sites has been increased from 147 to 326
Cross platform portable
Reduced unused and unwanted codes
Removed console mode

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

NExfil is an OSINT tool written in python for finding profiles by username. The provided usernames are checked on over 350 websites within few seconds.

1.4k Jan 1, 2023

Web Scraping com Python - Raspando Vagas para Programadores

Web Scraping com Python - Raspando Vagas para Programadores Sobre o Projeto Web

3 Dec 30, 2021

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

log4j-scan A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts Features Support for lists of URLs. Fuzzing for more

4 Aug 8, 2022

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

About create a target list or select one target, scans then exploits, done! Vulnnr is a Vulnerability Scanner & Auto Exploiter You can use this tool t

108 Dec 4, 2021

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

The SCodeScanner stands for Source Code Scanner, where you can scan your source code files like PHP and get identify the vulnerabilities inside it. The tool can use by Pentester, Developer to quickly identify the weakness.

136 Dec 13, 2022

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

IDA Pattern Search by Argus Cyber Security Ltd. The IDA Pattern Search plugin adds a capability of finding functions according to bit-patterns into th

48 Dec 29, 2022

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Related tags

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

Brief info:

Command Line Utilization Information.

Example :

Linux commands:

Note :

License :

Update informations

Update on 18-8-21:

Update on 20-8-21:

Update on 23-8-21:

Update on 16-09-21:

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

Web Scraping com Python - Raspando Vagas para Programadores

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

A simple automatic tool for finding vulnerable log4j hosts

Tool for finding PHP source code vulnerabilities.

Releases(v1)

v1(Sep 16, 2021)

Owner

Syam

Midas ELF64 Injector is a tool that will help you inject a C program from source code into an ELF64 binary.

It is a very simple XSS simulator based on flask, python.

Open source vulnerability DB and triage service.

A (completely native) python3 wifi brute-force attack using the 100k most common passwords (2021)

This repository uses a mixture of numbers, alphabets, and other symbols found on the computer keyboard

An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.

Security-TXT is a python package for retrieving, parsing and manipulating security.txt files.

Android Malware (Analysis | Scoring) System

Holehe OSINT - Email to Registered Accounts

APKLeaks - Scanning APK file for URIs, endpoints & secrets.

A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.

A scanner and a proof of sample exploit for log4j RCE CVE-2021-44228

Python HDFS client

Simulating Log4j Remote Code Execution (RCE) vulnerability in a flask web server using python's logging library with custom formatter that simulates lookup substitution by executing remote exploit code.

This program will brute force any Instagram account you send it its way given a list of proxies.

Scout Suite - an open source multi-cloud security-auditing tool,

Instagram brute force tool that uses tor as its proxy connections

Advanced subdomain scanner, any domain hidden subdomains

Details,PoC and patches for CVE-2021-45383 & CVE-2021-45384

Python low-interaction honeyclient