The Can Crawl tool is a Python script designed to crawl and discover URLs associated with a given domain or IP address. It resolves the IP address of the target and explores the website structure up to a specified number of levels, collecting unique URLs along the way.
- IP Resolution: Resolves the IP address for the provided domain.
- Multithreaded Crawling: Uses multithreading to crawl multiple URLs concurrently.
- Level-Based Crawling: Allows users to specify the number of levels to crawl, providing a structured approach to exploration.
-
Clone the repository:
git clone https://github.com/MrYellowOwl/CanCrawl.git
-
Navigate to the project directory:
cd CanCrawl -
Run the script:
python3 CanCrawl.py
-
Follow the on-screen instructions to enter the target domain, URL, or IP address and the desired number of levels to crawl.
- Python 3.x
- Requests
- BeautifulSoup
- Script by MrYellowOwl
If you encounter any issues or have suggestions for improvements, please open an issue. Contributions are welcome!
MrYellowOwl