Crawler for expired domains - job II

$30-250 USD

Cancelled

Posted

about 10 years ago

$30-250 USD

Paid on delivery

I am looking for a guy who can create a polite python crawler to find expired domains. Following functionality: (1) Indexing domains - Crawler crawls through the web and saves domainnames in a database - There shall be the setting opportunity just to crawl domains with a certain ending (2) Checking website status - Another crawler regularly and automatically visits the domainnames saved in database - By using HTTP-Header-Status or other ways, it shall be checked whether is domain is indexed in the nameservers (3) Displayment of domains - In case the domain is not in the DNS entries anymore, the pagerank of the domain is checked - Furthermore, the validity of the pagerank is checked These two parameters are then set in a list. PLEASE JUST BID IF YOU CAN COMPLETE FULFILL THE REQUIREMENTS!

MySQL

PHP

Python

Software Architecture

Project ID: 5560499

About the project

4 proposals

Remote project

Active 10 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

4 freelancers are bidding on average $301 USD for this job

@mwschultz

PLEASE READ!!! I am an experienced programmer, and I can create the web crawler you require. I have written spiders and crawlers in the past, many of which were more complicated than the one you have described in your project. If you are not satisfied with my results, I will not ask you to pay. Thank you for your consideration, and I hope to work with you soon.

$166 USD in 7 days

4.0

(3 reviews)

2.6

@BigBadBegger

I think i can finish all of them. I know how to go through links with scripts and i know how to check pagerank. But i also have some questions. Shall we discuss a bit through message?

$400 USD in 3 days