Ruby Bing Search / link scrapper

$30-250 USD

Closed

Posted

over 8 years ago

$30-250 USD

Paid on delivery

I need a project that does the following: 1. Takes in a search term from the user 2. Searches bing for the search term( I would like as many results as possible) 3. Returns all urls of the results. 4. Goes to each url and checks all outbound urls to see if the links are still working (just checking on the return http status) 5. returns links that are not working, along with the url the link is on and the anchor text. These should be returned in a hash so I can use them in the DOM. Bing has a search API. I would like this script to be written in this. Also there is a Ruby gem that makes it easier to work with the bing search API. ruby gem: [login to view URL] Bing search API: [login to view URL]

Ruby

Web Scraping

Project ID: 8321975

About the project

10 proposals

Remote project

Active 9 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

10 freelancers are bidding on average $187 USD for this job

@mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$250 USD in 5 days

5.0

(341 reviews)

7.9

@phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta

$210 USD in 3 days

4.9

(74 reviews)

7.2

@lunr

Hello. I have done similar jobs before and can easily do this for you. I can send you code examples, if you want. Let's discuss further in chat. Or you can add me on Skype: kalayciarif. Thanks.

$194 USD in 3 days

5.0

(3 reviews)

5.2

@saminatinny

Hi, I am passionate,I am an extremely motivated individual who pays attention to detail. I always make sure my work is complete and accurate. I am also an ambitious person and I desire to be among the best in my field. Best Regards SaminaTinny.

$244 USD in 5 days

4.9

(22 reviews)

4.6

@ziadbinshams

Hello Sir I have gone through your job posting. I can do the task perfectly as your project requirement. I am professional in web research, web scraping, data extraction and all type of database development. I will send you accurate data. I have a great experience for the same task. Please contact with me. I will do my best. Thank you. Regards Ziad Bin Shams

$210 USD in 5 days

5.0

(24 reviews)

4.8

@prem89k

Hi, I have 5+ years experience in working with Ruby for scraping and building web apps. Do you want to build a standalone app or just a script which get inputs from the user? I have previously worked on two projects with Shoesrb if you want it as a app for windows. Do you just need the 404 outbound urls? Thanks

$150 USD in 2 days

5.0

(11 reviews)

4.5

@alextakitani

Hello! I'm a 18+ yrs fullstack developer, with 5 yrs working with Rails. For you problem I propose to build a RubyGem, Rspec tested that will: - Integrate with bing api, through using searchbing gem - Store the results for processing - Process the stored results for broken links I recommend the use of a database to store the urls, the outbound urls and their status, and a background job to process the data. Please, contact me if you have any questions. Thanks!

$230 USD in 5 days

5.0

(5 reviews)

3.6

@webkraits

I dont even need the Bing Search API to execute this type of script (It will save your money). I will write a PHP code with multiple mechanisms which will search your queries on bing and return the URL's. And can also penetrate into the result URL's and check the internal URL's there. and return the results as you like

$155 USD in 7 days

4.8

(1 review)

1.2

@Number11PM

I have selenium web-driver solution can read Excel file and fill one web site. and at a same time I can read content on web site to Excel file. Selenium is solution of QTP best for Web Scape Let's to discuss first. In this work, we developed, implemented, and validated an image-processing system for qualitative and quantitative volumetric analysis of brain images. This system allows the visualisation and quantitation of global and regional brain volumes.

$180 USD in 5 days

4.3

(3 reviews)

1.0

@kinetic87

Hello! I have been creating Ruby scripts for web scraping and networking for several years now. I have created everything from a search engine scraper (similar to the one you want, actually) to a full-blown, event-driven scraper that can be distributed to multiple locations. I can finish this for you quickly and it will be well written and easy to read. If you need extra functionality, such as a graphical front-end, we can discuss this as well.

$50 USD in 3 days