Closed

Smart web crawler

I'm looking for a developer that can develop a crawler that uses machine learning elements to gather data. The workflow is as follows:

1. I give the crawler input data which I want it to "learn"

2. After learning the crawler searches online for websites with similar content

3. Crawler extracts data from websites that match the profile

Example: as input product descriptions are put into the crawler. After it mines the text it than goes on and crawls (searches on google/yahoo/bing/etc) for websites with similar product descriptions and extracts data like website URL, title, description, emails, etc. from the websites it finds.

Upon completion extracted data is send to my email address in a CSV format.

Once this is working I'll be adding some more functionality so I'm looking for a long term developer.

Skills: Data Mining, PHP, Python, Software Architecture, Web Scraping

See more: i m looking for web designer employee, i m looking for the best web designer in rome, i m looking for one web developer, python, web scraping, machine learning, i m looking for a web developer worcestershire, i m looking for a web developer job in ca, i m looking for a web developer envato, i m looking for an app developer, i m looking hire a dedicated php developer freelance, i m looking for a web to answer my engineer hw, i m looking for a web developer, i m looking for a web designer, i m looking for a developer startup, i m looking for a cloud software developer, google yahoo bing ask ranking, google yahoo bing ask rank, seo google yahoo bing page ranking, serp google yahoo bing

About the Employer:
( 3 reviews ) Ljubljana, Slovenia

Project ID: #17355953

25 freelancers are bidding on average €618 for this job

mhmhz

Hi I have knowledge with machine learning, kindly provide the details requirements then i can prepare a demo Relevant Skills and Experience C# Proposed Milestones €1111 EUR - all

€1111 EUR in 5 days
(220 Reviews)
7.8
mmadi

Dear jn263, I would like to discuss your project in brief and I am much interested to assist you on the development of your Project "Smart web crawler" with fulfilling all of and elegantly. Also I do have similar expe More

€525 EUR in 12 days
(46 Reviews)
7.0
€555 EUR in 10 days
(24 Reviews)
7.2
bestit4u

Hi,sir I have read your requirement and I am very , very interested in your project. Because I have much experiences in web scraping and machine learning. Relevant Skills and Experience I have expert and smart techn More

€555 EUR in 10 days
(112 Reviews)
7.2
€888 EUR in 10 days
(70 Reviews)
6.6
€277 EUR in 10 days
(62 Reviews)
7.2
zekovicm

Hi there,I am Miljan,Web crawling expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! Relevant Skills and Experience Check out my More

€277 EUR in 3 days
(80 Reviews)
6.9
rajawi9999

I will create it with php using virtual multithread , so it will be faster. You will need just apache server for making it work without need database. Relevant Skills and Experience I have done many bot as you can che More

€333 EUR in 2 days
(188 Reviews)
6.7
schoudhary1553

We came along with your request for Smart web crawler Relevant Skills and Experience We are offering our services for more than 5 years in the field of Data Mining, PHP, Python, Software Architecture, Web Scraping P More

€400 EUR in 6 days
(77 Reviews)
6.6
etuannv

I would approach your project by using Scrapy. It is simple and fast Relevant Skills and Experience Scrapy, python Proposed Milestones €2222 EUR - Project mileston I have 4+ years experience at Web scraping. If you' More

€2222 EUR in 10 days
(56 Reviews)
6.0
€555 EUR in 10 days
(167 Reviews)
5.4
hassanalvi95

Hi sir, I am expert in ML and Web crawling both are necessary for your Job.... I am up for research and work in long term... Relevant Skills and Experience I made a crawler in past for a client who wanted to crawl som More

€555 EUR in 10 days
(34 Reviews)
5.5
lillysoft

sir i have already developed many web crawlers so i can complete your project for best price with best quality

€500 EUR in 5 days
(30 Reviews)
5.6
yongbeauty1996

hello how are you? i am very interested in your project i have read your description very carefully. i can do your job in time kind regards. Relevant Skills and Experience Data Mining, PHP, Python, So More

€555 EUR in 10 days
(6 Reviews)
4.9
€555 EUR in 10 days
(18 Reviews)
5.4
superbpartner

hello,dear. It's my pleasure meeting you. I have read your requirements and I fully went through it. I am confident and I am sure that I am able to finish such project. Would you contact me for further discussing. Than More

€555 EUR in 4 days
(10 Reviews)
4.8
binarycodersvw

crawler Relevant Skills and Experience vb.net Proposed Milestones €740 EUR - to be discussed Hi.I am a Visual Basic .NET programmer with 14 years experience(others say this too but I can show proof). This is not ano More

€740 EUR in 10 days
(16 Reviews)
4.4
youssefelhady

Hello sir, We're going to first make a machine learning model that will be able to generate a searching profile "Keywords" and "Topics", then use it to crawl for the most relevant pages. Relevant Skills and Experienc More

€555 EUR in 10 days
(10 Reviews)
3.6
saifullahlive27

hi sir i have expertise in neural networks, recommendation algorithms, collaborative filtering, q-learning and more. please consider me your work Stay tuned, I'm still working on this proposal.

€555 EUR in 10 days
(8 Reviews)
3.5
€600 EUR in 10 days
(3 Reviews)
0.8