Subdomain enumeration,Web scraping and finding usernames automation script written in python

Last update: Nov 22, 2022

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

git clone https://github.com/d8rkmind/Pyosint.git
cd PyOsint
pip3 install -r requirements.txt

Usage :

python3 Pyosint.py [OPTIONS]

Brief info:

The main functionality of this program has been divided to 3 parts

Find - Module to search For usenames form a list of 326 websites
Scrap - To Scrap a website to extract all links form a given website and store it in a file
Enum - To automate the search of subdomains of a given domain from different services

In Scrap module results are automatically stored in output/web folder wit he ip-address of the website as the filename

The services used are Virus Total,PassiveDns,CrtSearch,ThreatCrowd
Enum module an Api key of Virus total that you can get from going Here

Paste the key inside api.json file:

* if this step is not done Virus total may block your request

Command Line Utilization Information.

The following are the sub-commands that work this program

Arguments	Shot form	Long form	Functionality
Name	-n	--name	To specify the domain name or username to use
Module	-m	--module	To specify which module to use
Output	-o	--output	To specify outputfile name
Thread	-t	--threads	To specify the number of threads to use [ Not applicable to web crawling ]
Limit	-l	--limit	to specify the maxium value of web urls to crawl [ Applicable only to web crawling ]
Verbose	-v	--verbose	To enable verbose mode [ Applicable only to Enumeration ]
Ports	-p	--ports	To specify the ports to scan [ Applicable only to Enumeration ]
Help	-h	--help	To Show the help options

Example :

Linux commands:

python3 pyosint.py -m find -n exampleuser               <-- Username-huntdown

python3 pyosint.py -m scrap -n http://scanme.nmap.org   <-- Scrapping using bot

python3 pyosint.py -m enum -n google.com                <-- Subdomain enum

The project is still in development and will be added with additional functionality.
Happy to hear suggestions for improvement.

Special Thanks to 𝓣𝓮𝓬𝓱𝓷𝓸𝓻𝓮𝓬𝓴 and 𝓢𝓱𝓾𝓷𝓾𝔁 - 𝓢𝓽𝓾𝔁𝓷𝓮𝓽 for working in this project

Note :

This is only for educational and research purposes.The developers will not be held responsible for any harm caused by anyone who misuses the material.

License :

Pyosint is licensed under the GNU GPL license. take a look at the LICENSE for more information

Update informations

Update on 18-8-21:

Rewritten the code completely ,Improved interface

Update on 20-8-21:

Subdomain enumeration module (enum) has been added

Update on 23-8-21:

Find module code that has been optimised. The number of sites to automate has grown from 14 to 147, and connection error has been resolved.

Update on 16-09-21:

Program has been re-written to work with arguments
Find module has been added threading Functionality
Output functionality has been added to every module
More Error handiling has been added
Number of sites has been increased from 147 to 326
Cross platform portable
Reduced unused and unwanted codes
Removed console mode

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

NExfil is an OSINT tool written in python for finding profiles by username. The provided usernames are checked on over 350 websites within few seconds.

1.4k Jan 1, 2023

Web Scraping com Python - Raspando Vagas para Programadores

Web Scraping com Python - Raspando Vagas para Programadores Sobre o Projeto Web

3 Dec 30, 2021

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

log4j-scan A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts Features Support for lists of URLs. Fuzzing for more

4 Aug 8, 2022

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

About create a target list or select one target, scans then exploits, done! Vulnnr is a Vulnerability Scanner & Auto Exploiter You can use this tool t

108 Dec 4, 2021

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

The SCodeScanner stands for Source Code Scanner, where you can scan your source code files like PHP and get identify the vulnerabilities inside it. The tool can use by Pentester, Developer to quickly identify the weakness.

136 Dec 13, 2022

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

IDA Pattern Search by Argus Cyber Security Ltd. The IDA Pattern Search plugin adds a capability of finding functions according to bit-patterns into th

48 Dec 29, 2022

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Related tags

Overview

𝓟𝓨𝓞𝓢𝓘𝓝𝓣

Subdomain enumeration,Web scraping and finding usernames automation script written in python

Installation

Brief info:

Command Line Utilization Information.

Example :

Linux commands:

Note :

License :

Update informations

Update on 18-8-21:

Update on 20-8-21:

Update on 23-8-21:

Update on 16-09-21:

You might also like...

NExfil is an OSINT tool written in python for finding profiles by username.

Web Scraping com Python - Raspando Vagas para Programadores

A fully automated, accurate, and extensive scanner for finding vulnerable log4j hosts

Vulnerability Scanner & Auto Exploiter You can use this tool to check the security by finding the vulnerability in your website or you can use this tool to Get Shells

SCodeScanner stands for Source Code scanner where the user can scans the source code for finding the Critical Vulnerabilities.

IDAPatternSearch adds a capability of finding functions according to bit-patterns into the well-known IDA Pro disassembler based on Ghidra’s function patterns format.

A Burp Suite extension made to automate the process of finding reverse proxy path based SSRF.

A simple automatic tool for finding vulnerable log4j hosts

Tool for finding PHP source code vulnerabilities.

Releases(v1)

v1(Sep 16, 2021)

Owner

Syam

Just another script for automatize boolean-based blind SQL injections.

MainCoon - an automated recon framework

Glass是一款针对资产列表的快速指纹识别工具，通过调用Fofa/ZoomEye/Shodan/360等api接口

Automatic SQL injection and database takeover tool

A simple python script for hosting a Snowflake Proxy in your python program or with it's standalone cli

S2-061 的payload，以及对应简单的PoC/Exp

WebLogic T3/IIOP RCE ExternalizableHelper.class of coherence.jar

Binary check tool to identify command injection and format string vulnerabilities in blackbox binaries

How to exploit a double free vulnerability in 2021. 'Use-After-Free for Dummies'

Operational information regarding the vulnerability in the Log4j logging library.

Http-proxy-list - A lightweight project that hourly scrapes lots of free-proxy sites, validates if it works, and serves a clean proxy list

PySharpSphere - Inspired by SharpSphere, just another python version

A great and handy python obfuscator for protecting code.

Template for new OSINT command-line tools

Safe Policy Optimization with Local Features

Hadoop Yan RPC unauthorized RCE

client attack remotely , this script was written for educational purposes only

一款针对向日葵的识别码和验证码提取工具

CVE-2022-22965 - CVE-2010-1622 redux

Exploiting CVE-2021-42278 and CVE-2021-42287 to impersonate DA from standard domain user