Python Webdriver search all iframes on page for string

$30-250 USD

Completed

Posted

over 6 years ago

$30-250 USD

Paid on delivery

Write a python webdriver crawler (chrome) which loads a json file like below { "find":[ { "url": "[login to view URL]", "profile_dir": "" }, { "url": "[login to view URL]", "profile_dir": "" } ] } Then loop over each URL, parse the URL for the domain like for the first item [login to view URL] will be a string "[login to view URL]" Then load another JSON file like below { "sites": [ "[login to view URL]", "[login to view URL]" } Now for each of these sites ([login to view URL], [login to view URL] etc etc) you will go to these websites with webdriver. Get all iframes on the main page Search all iframe source for the "[login to view URL]" string. If string is found in link example <a href="https://findme...."></a> return the string findeme and the a tag complete <a></a> and save to new json file. Next continue to `[login to view URL]` and repeat checking all source. If the iframe does not have a matching string "[login to view URL]" then you will search this frames source for more iframes. Then again search each iframe for the string and continue 10 levels (frames deep) before exiting.

Python

Selenium Webdriver

Web Scraping

Project ID: 16073529

About the project

12 proposals

Remote project

Active 6 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@ThanassisKalv

what you need seems like 'straightforward' work to be accomplished with a Python script along with selenium! Ping me if you're interested, we can discuss and start it !

$95 USD in 1 day

4.9

(94 reviews)

5.9

12 freelancers are bidding on average $165 USD for this job

@mingxiao2008

Dear,Sir How are you? I have read your project and I am sure that I can do your project as selenium developer. I have extension experienced in developing python scraping project using selenium. I will work very hard and best for you. Best Regards

$155 USD in 3 days

5.0

(50 reviews)

7.0

@thewebscraper

Hi, I am expert web scraper! I will use python selenium to automate and crawl based on your requirements. Crawl iframe and save info to JSON I look forward to your acceptance.

$111 USD in 2 days

5.0

(47 reviews)

5.7

@ChanakyaNaag

Hey there! I have read the description and would love to work on this project. I have been developing web scraping tools for past 2.5 years using python. My skills & experience: -- 2.5 years of experience in developing web scraping tools using python -- Worked on more than 49 web scraping projects ( 3 on freelancer.com ) -- Can scrape data out of dynamic java script enabled sites as well -- Working experience in developing automation tools for Infosys ( a big tech company ) ** I will use selenium and chrome web driver for this process. Can scrape all the content you have specified in your description. Looking forward to work with you, Ping me for further discussion. *** Assign me the project only when i explain my procedure to extract data out of website *** Thank you, Have a nice day!

$211 USD in 2 days

5.0

(31 reviews)

4.7

@zara5

Hello there, I am Python developer for couple of years now and I would love to help you with the project. I have already done plenty scraping jobs for customers before. Will love to discuss with you further about the price you want. Pleaae contact with me if you want me to do it. Thanks.

$198 USD in 2 days

5.0

(8 reviews)

3.4

@amariitism

Hello We are highly motivated young technocrats from India. We are approachable, you can come to us if you have a struggle, we are happy to help. Team TiponTongue Relevant Skills and Experience Ph.D. in Computer Science and Engineering

$200 USD in 2 days

5.0

(6 reviews)

3.5

@origami07

Hello, I have been developing software for over 5 years. I have experience with web creation and services. Regards

$155 USD in 3 days

4.3

(8 reviews)

3.3

@olansile

A proposal has not yet been provided

$244 USD in 1 day

5.0

(1 review)

0.0

@praveenSinghM

Dear recruiter, I have work experience of 4 years in software testing with selenium webdriver. I have a good knowledge of python. Looking forward for your response. Thanks Praveen

$49 USD in 3 days

0.0

(0 reviews)

0.0

@tsebro

Hello! <<Write a python webdriver crawler (chrome) which loads a json>> I and my team is able to write such a crawler. Recently our team had two project concerning parsers: - one project concerned debugging a php crawler; - the other one concerned the crawler with ad block integration. In area of web development our main specialization is LAMP stack of technologies (Linux, Apache, MySQL, PHP) but we have experience with Python, Node.js, React.js and .NET stack of technologies either.

$157 USD in 3 days