Extract Data from the UC Berkeley University Directory
$10-30 USD
Completed
Posted almost 10 years ago
$10-30 USD
Paid on delivery
Hello, I need someone to extract information from the UC Berkeley University directory, and send me the results in a spreadsheet. To understand the requirements:
1) Go to the directory here: [login to view URL]
2) Search for: Search on = Last Name, Population = "Faculty/Staff/Affiliates", Search Term="ades"
3) Notice the 3 results.
4) Click on each result, notice that only 1 results has the following fields populated: Name, Email, Home Department, Title
I need ALL RECORDS Where (EMAIL is not empty) AND (HOME DEPARTMENT is not empty) AND (Title is not empty) AND (Population = "Faculty/Staff/Affiliates")
I need the following fields in the output: Name, Email, Home Department, Title. Please see the attached sheet for the output format. Please deliver the final output in exactly this format.
To show that you understand the requirements, please answer the following questions:
1) 2) Search for: Search on = Last Name, Population = "Faculty/Staff/Affiliates", Search Term="mcni". How many records are there that meet the search requirement?
2) I need ALL the records that meet the search requirement. Will you do this using a script? or manual entry?
3) If you plan to use a script, please briefly explain how your script will work to ensure that you get all records.
Please note, all bids between $20 - $35 will be considered.
1) 2 records meet the criteria
2) Script
3) Script will work in a few phases:
- Check last name letter combinations to find the ones that return fewer than 50 (since 50 is truncated). Ie, check "a", if it has 50, check "aa", "ab", "ac".... and add a letter each time to get it down to letter combinations that have fewer than 50 results. These letter combinations are stored for later use.
- Go through the letter combinations again, this time store all the results that have an email, since email can be seen on the top level result.
- Use the link recorded in the previous step, check for title and home department for each person that has an email - then record it.
$25 USD in 3 days
5.0 (1 review)
0.8
0.8
28 freelancers are bidding on average $38 USD for this job
Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience.
you can see my experience here:
https://www.freelancer.com/u/uumairkhalid.html
looking for your reply. Thanks
1. 7 / 2. Semi script. We ll search using 3 para meeter.. "A..Z""A..Z""A...Z" Example - aaa, aab, aac, aad.... so on. We can get you all of the result. We are 19 people team, worked on more than 500 completed projects. We provide round the clock service.
Can we chat here? Please reply me when you will be available. We are really like to discuss with you regarding this project. We are open for any type of negotiation. Let's speak together. Thanks vSol CORP
Hello Sir,
We are a well built set up with excellent skilled operator with lot of experience in this segment/skill,have complete more than 200 similar job in freelancer in last 4 years, i have gone through your project description, its really a simple task, we can make a well formatted,error free list.
Sir, we are waiting for your reply for communicate also like to make a sample if you allow by a single reply.
Thanks
DG
Hello, Read and understood project details. We have a lot of experience of data scarping and data entry. We can do this job very well also we are ready to do sample entries. Hope to getting consider for this also please allow us to do few sample before quoting the price for this work. Regards
Sir,
I am well versed in this kind of jobs and can do your project as per requirement.
I have done lots of these kind of projects and will deliver flawless work
Looking for further discussions in this regard.
with thanks and regards
I understand your requirements and for the search term "mcni" there are 3 results which meet your requirements.
Please send me complete list of search terms so i can see how soon it could be done.
Regards,
Umer
Hello,
i am expert in scraping
i did many similar jobs before
i will creat small desktop application that loads the list of terms u have
then do the search for each term then parse the results page to get the data then save it to csv file
about your questions
for "mcni" term
there are 2 results require out of the 7 total results
Robert McNicholas
&
Ms. Jessie Jane McNichols, BA
send me the list of terms to begin working
can begin now
Regards
Hello,
Just 2 records are available that fulfill your criteria for mcni.
Ms. Jessie Jane McNichols, BA and Robert McNicholas
I will do the searches and entry manually. I can start the work immediately.
Could you kindly confirm, for how may search terms do we have to repeat the task? This will help me to give you a time frame for the project.
I am available on skype and email for constant communication during work hours. I also send daily reports of the work done.
I have also seen your other similar projects, I can do that as well.
Please let me know if you need any further information from me. Awaiting your positive reply, so as to go ahead.
Thank You,
Latif
Hi,
If we search with SearchTerm=mcni, it shows 7 people.
I have my own script which can download data from any web page. I can run this script in loop for all search terms and extract result.
Thanks and Regards,
manishadk
Sir read carefully and understanding then after the bid of your poject.
I am Data Entry/Data Processing Expert/ Web Search/ Web Scraping/ Linkedin/ Excel/ Word & Techinacl writing.
I know the value of time. I am very hard working and always deliver work on time.
My Motive is to make my employer Happy without adding additional charges. If you are looking for data entry work.
I am the Right person for you. available 24-7.
a trusted Freelancer
Hi,
To answer your questions:
1. 2
2. I have to use script
3. Well whether is manual or using script, since it will only yields max 50 results per search there's no other way than using combination from aaaa to zzzz to narrow down the result.
Regards,
Hi. Certainly i can do it for you with that price. I did completed 100% projects for all my employers and they are very satisfied with my result. You can check it in my profile. Hope we have a deal. Thank you!
Hello. More 20 years programming experience.
I plan to use WWW::Mechanize - I had solved similar tasks many times - as I wrote in previous project similar project.
Regards. -----------------------------------------------------------------------------------------------------------------------------------------------
Good day
There are three entries that meet your requirements
I will be using software to mine all data and then send you the filtered results
Kind regards
Gert
Hello! ... 1 Record meets the search requirement ... I will do this by using manual entry or i will use software ... But first I need to know how many records do you want entered in the spreadsheet ( I need a number) ... Message me to talk more before you hire somebody !
