V2.0.0

Subprober - An essential HTTP multi-purpose Probing Tool for Penetration Testers and Security Researchers with Asynchronous httpx client support

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

• Fast and configurable probings
• Supported Inputs: hosts, URLS, IPs
• Supports multiple methods http requests
• Supports proxies and customizable Header for probing
• Progress your probing tasks

Features in V2.0.0:

• New Probing configurations

  • --http2 : Now subprober support to request with Http/2 version
  • --http-version : display the server supported http version of the host
  • --http-reason : display the reason for http connection of the host
  • --jarm-fingerprint : display the jarm figerprint hash of the host

New Updates:

Subprober now supports HTTP/2 to give request and Improved concurrency using next generation http request client httpx
and also now gives jarm figerprints and other probe configurations. Subprober Concurrency performance improved with
more Asynchronous concurrency which make subprober more accurate and Concurrent tool for probing.

Subprober Probing Configuration:

Probes	Default check	Flags to Use
Url	True
Title	True	-tl, --title
Status code	True	-sc, --status-code
Response Length	true	-wc. --word-count
Server	True	-sv, --server
Content Type	True	-apt, --application-type
Follow redirection	False	-ar, --allow-redirect
Path	False	-p, --path
Redirect location	False	-l, --location
Max redirect follow	False	-maxr, --max-redirection
Disable http probe	False	-dhp, --disable-http-probe
Random user agents	False	-ra, --random-agent
Ipaddress of Host	False	-ip, --ipaddress
Cname of Host	False	-cn, --cname
Proxy	False	-px, --proxy
Custom Headers	False	-H, --header
Jarm	False	-jarm --jarm-fingerprint

v1.0.9

Subprober v1.0.9 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.9:

• New Probing configurations

  • -ip : finds the ips of urls
  • -cn : find the cname of urls
  • -maxr : maximum redirection for url
  • -ra : enable random agent to probe with random agent
  • -X : custom method for urls to probe
  • -H : set custom header for urls to probe
  • -sc : removed default to show response code and this flag to improve the subprober I/O

• Improved Concurrency

  • Subprober concurrency and accuracy are improved with asynchoronous libraries aiohttp, arsenic, aiodns which make subprober to asynchornously probe urls

• Headless

  • -ss : enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)
  • -st : set a timeout value for urls to take screenshots
  • -bt : select your browser type to take screenshots

• IO Support:

  • Subprober now support stdout when using -nc flag which make subprober output to be piped and extend your automated workflows
  • Now Subprober automatically detect the stdin are connected or not and quits
  • Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls

• Patched issues:

  • Fixed issue to probe urls when passing u, --url by @blackcodersec
  • Fixed double appendence of path when using -p, --path
  • Fixed update issue in previous version
  • Fixed issue in saving scrennshots output when urls passed with -p, --path

Speed and Loads:

Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources aws VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

v1.0.8

Subprober v1.0.8 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.8:

• New Probing configurations

  • -ip : finds the ips of urls
  • -cn : find the cname of urls
  • -maxr : maximum redirection for url
  • -ra : enable random agent to probe with random agent
  • -X : custom method for urls to probe
  • -H : set custom header for urls to probe
  • -sc : removed default to show response code and this flag to improve the subprober I/O

• Improved Concurrency

  • Subprober concurrency and accuracy are improved with asynchoronous libraries aiohttp, arsenic, aiodns which make subprober to asynchornously probe
    urls

• Headless

  • -ss : enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)
  • -st : set a timeout value for urls to take screenshots
  • -bt : select your browser type to take screenshots

• IO Support:

  • Subprober now support stdout when using -nc flag which make subprober output to be piped and extend your automated workflows
  • Now Subprober automatically detect the stdin are connected or not and quits
  • Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls

Speed and Loads:

Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources aws VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

v1.0.7

Subprober v1.0.7 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.7:

• Subprober is capable to handle high loads
• accuracy and concurrency are improved
• add extra configuration in probing saving outputs
• added new command -dhp --disable-http-probe to only probe https protocol
• improved subprober's memory allocations
• added deduplication that remove duplicated urls and etc..

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

v1.0.6

Subprober v1.0.6 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober v1.0.6 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.6:

• Subprober Concurrency and Accuracy are Improved than previous version
• Introduced new options and probes configuration
• Improved handling exception and increased the accuracy in results

v1.0.5

Subprober v1.0.5 - Fast Probing Tool for Penetration Testing

Overview

Subprober v1.0.5 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.5:

• Subprober Concurrency and Accuracy are Improved with libraries like aiohttp,asyncio
• Subprober Error handling and Synchronization are improved
• Resolved some Bugs for Subprober
• Subprober Commands are changed with usefull flags
• Resolved executive errors in v1.0.4
• Subprober requires python version 3.11.x

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

update to v1.0.4 to v1.04.5:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Recommended Concurrencies:

Info: Subprober is improved with higher concurrency and accuracy for probings and recommend the users to use the concurrencies less which is efficient and accurate for probing

• 30-50 : this range of concurrency can be given when probing for more than 50K+ Subdomains, ips, domains etc..
• 50-80 : this range of concurrency can be given when probing for more than 100K+ Subdomains, ips, domains etc..
• 100-120 : this range of concurrency can be given when probing for more than 150K+ Subdomains, ips, domains etc..

Note higher concurrency values may results in inaccurate results because subprober builded with higher concurrency and more accurate than other probing tool with following mentioned concurrency values

v1.0.4

Subprober v1.0.4 - Fast Probing Tool for Penetration Testing

Overview

Subprober v1.0.4 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.4:

• Subprober Concurrency and Accuracy are Improved with libraries like aiohttp,asyncio
• Subprober Error handling and Synchronization are improved
• Resolved some Bugs for Subprober
• Subprober Commands are changed with usefull flags

v1.0.3

Subprober v1.0.3 Release

We are thrilled to announce the release of Subprober v1.0.3, a cutting-edge tool crafted for penetration testers and security professionals. This version introduces several enhancements, new features, and performance improvements to elevate your subdomain probing experience.

Key Features

1. Concurrent Processing

Subprober v1.0.3 introduces advanced concurrency management, allowing users to optimize their probing operations with parallel processing. The new -c flag enables users to set the concurrency level, significantly improving the speed and efficiency of subdomain analysis.

2. Progress Visualization

Enhance your probing experience with the new Show Progress mode. Enabled by the -sp flag, this feature provides real-time feedback through a dynamic progress bar, allowing users to monitor the probing progress at a glance.

3. Title Extraction

Efficiently identify and analyze subdomains with the new -tl flag, which retrieves and displays the titles associated with probed subdomains. This feature streamlines the identification of critical information during penetration testing.

4. Server Information

Gain deeper insights into the infrastructure by utilizing the -sv flag. Subprober now identifies and displays server information associated with probed subdomains, providing valuable context for security professionals.

5. Application Type Detection

Subprober v1.0.3 introduces the -apt flag, enabling users to determine and display the application type of probed subdomains. This feature enhances the reconnaissance process, helping users identify the technology stack of their target.

Upgrade Instructions

To experience the enhanced capabilities of Subprober v1.0.3, simply upgrade using the following command:

pip install --upgrade Subprober

Usage Examples

Explore the new features and functionalities with the following usage examples:

Basic Usage

subprober -f subdomains.txt -o output.txt -tl -wc -sv -v -apt -wc -ex 404 500 -suo 200 -v -o output.txt -c

Direct URL Probing

subprober -u https://example.com -c 20 -to 8 -tl -sv -wc -apt -ex 404 500 -suo 200 -v -o output.txt

Piping Subdomains

cat subdomains.txt | subprober -c 20 -to 8 -tl -sv -wc -apt -ex 404 500 -suo 200 -v -o output.txt

Contributing

We encourage the community to contribute to the development of Subprober. Feel free to open issues or submit pull requests to help us continually enhance the tool.

License

Subprober v1.0.3 is released under the MIT License. See the LICENSE file for details.

Connect with Us

For the latest updates and discussions, join our community on LinkedIn:

Thank you for choosing Subprober. We hope this release enhances your penetration testing workflow, and we look forward to your valuable feedback!

v1.0.2

Subprober Version Informations.

Subprober has been with lots features to enhance the user experience and to get good probing details.

• Subprober can easily piped through other tools output as Subprober input though command lined
• Subprober probing has enhanced with lot of features and get results with user defined flags
• Subprober concurrency and Asynchronous probing has been improved to save your time
• Subprober is OS independent so it can run any Operating System even Android also so do your recon anywhere as you like
• Subprober is ability to run in low end systems but it depend on user defining concurrency values
• Subprober can be easily installed through pip or git clone
• Subprober have good CLI interface to console the output
• Version.1.0.1 bug has been resolved

The Subprober has been developed by D.Sanjai Kumar to develop the open source contributions so show your love and support by giving a ⭐ and show your love ♥️ .

v1.0.1

Subprober Version Informations.

Subprober has been with lots features to enhance the user experience and to get good probing details.

• Subprober can easily piped through other tools output as Subprober input though command lined
• Subprober probing has enhanced with lot of features and get results with user defined flags
• Subprober concurrency and Asynchronous probing has been improved to save your time
• Subprober is OS independent so it can run any Operating System even Android also so do your recon anywhere as you like
• Subprober is ability to run in low end systems but it depend on user defining concurrency values
• Subprober can be easily installed through pip or git clone
• Subprober have good CLI interface to console the output

The Subprober has been developed by D.Sanjai Kumar to develop the open source contributions so show your love and support by giving a ⭐ and show your love ♥️ .