Skip to content

Latest commit

 

History

History
113 lines (67 loc) · 2.41 KB

README.md

File metadata and controls

113 lines (67 loc) · 2.41 KB

Usage Video Demo

https://youtu.be/dkBlcVMkgB8

URL Regex Match Counter

URL Regex Match Counter is a script designed to count occurrences of various regular expressions within the content of provided URLs. It is available in both Python and Go versions.

Usage - Python Version

Prerequisites

  • Python 3.x
  • Required Python packages: requests, tqdm

Installation

  1. Clone the repository:

    git clone https://github.com/Acorzo1983/codehunter.git
cd codehunter

  2. Install the required Python packages:

    pip install -r requirements.txt

How to Use - Python Version

Run the codehunter.py script with the following arguments:

python3 codehunter.py -f <file_with_URLs> -r <file_with_regex> -v -o <output_file>
    -f/--file: File containing URLs to scan.

    -r/--regex: File containing regular expressions to match.

    -o/--output: Output file to store the results.

    -v/--verbose: Optional flag for verbose output (displays URL results).

python3 codehunter.py -f urls.txt -r regex.txt -o results.txt

Usage - Go Version

Prerequisites Go installed on your machine.

How to Use

  1. Compile the Go code:
go build codehunter.go
  1. Run the compiled executable with the necessary arguments:
./codehunter -f <file_with_URLs> -r <file_with_regex> -v -o <output_file>

Features

Simultaneously scans multiple URLs for various regex patterns. Provides the count of matches per URL for each regex.

Extra BETA urlextractor

Extract URLS from a websites

sudo chmod +x urlextractor.py
python3 urlextractor.py -u https://domain.com -d -v -o domainresult.txt
  -u, --url <url>         URL to extract links from (required)

  -v, --verbose          Verbose mode

  -o, --output <filename> Output file name (default: output.txt)

  -d, --deep              Perform deep crawl

Example usage:

python3 urlextractor.py -u https://domain.com -d -v -o output_file.txt

File Structure

codehunter.py: Main Python script.

codehunter.go: Go version of the script.

README.md: Instructions and information about the script.

requirements.txt: Contains necessary Python packages.

urlextractor.py complimentary Python script to extract urls

Contribution Contributions, issues, and feature requests are welcome! Feel free to check the issues page if you want to contribute.