Guys i am building a simple web crawler which crawls a website and fetches for url’s,Displays the url’s and after completely crawling a url crawls all the url’s found for a period of 10mins.
I am using regular expressions to get the links after getting the source code.
Please suggest better ideas. thnx
Check out crawler developed by me on
For educational purpose only
1 Like
http://www.lovelyrani.com/
http://www.lovelyrani.in
http://www.siyamalhotra.com
http://www.jaipurescorts.services
http://www.harpreetkaur.website
http://www.delhiescorts.website
http://www.lovelyrani.com/lucknow-escorts.html
http://www.lovelyrani.com/mumbai-escorts.html
http://www.lovelyrani.com/hyderabad-escorts.html
http://www.lovelyrani.com/chandigarh-escorts.html
http://www.lovelyrani.com/kolkata-escorts.html
http://www.lovelyrani.com/ahemdabad-escorts.html
http://www.lovelyrani.com/jaipur-escorts.html