Spydan – A web spider for shodan.io without using the Developer API
Spydan allows you to retrieve information from shodan.io without an API Key and export it as CSV, JSON or XML by creating queries with given parameters.
Due to the five page limit Shodan has for standard users, the results are limited to those shown in these first pages.
Before you start crawling, you need to have Scrapy
pip install scrapy
You only need to worry about the file
spydan.py. You will need to add some arguments when running Spydan. The required ones are username, password, and networks. Other arguments are ports, services, and products.
A full example is:
python spydan.py adanvillarreal p455w0rd 184.108.40.206/16 220.127.116.11/18 --ports 80 8080 8084 8484 --fname prueba --type json
You can get more information about arguments by executing
python spydan.py -h
There is a delay between requests of 3 seconds and a limit for 2 concurrent requests due to 503 codes that I received with higher values, which are located in
settings.py under the directory spydan.