Looking for help in crawling the url

Hi,

I am new to nmap. i am looking for crawling the target on port 80,8080,443,
8088.
my goal is to get sub-urls of a target

say target is nmap.org and i want mutilple urls which are part of nmap.org
like
https://nmap.org/book/osdetect-usage.html .
https://nmap.org/mailman/listinfo/dev

and parse these sub urls and check does any sub-url ask for login
credentials.

Thanks
Sandeep

_______________________________________________
Sent through the dev mailing list
https://nmap.org/mailman/listinfo/dev
Archived at http://seclists.org/nmap-dev/