web scraper using google scripts / PHP

Closed Posted 5 years ago Paid on delivery
Closed Paid on delivery

Hi, we need a high performance script written in PHP as well as the same script written in google script language that can scan domains very fast to determine their cms (if any i.e. WP, Drupal, Joomla, typo3...) scan for version, installed plugins/themes, grab any contact details from the site (address, telephone, email), grab their facebook page, twitter page, instagram, linkedin... The full list of desired field values is as follows:

Domain,

Location on site, -- is this install a subfolder from another website 8like blog or news section?

Company,

Vertical, - can we determine the category 8manufacturing, retail, clothes, food, restaurant etc

Quantcast, can we grab quantcast info

Alexa, - can we get Alexa Rank

Telephones, - 1 or if multiple then list

Emails, for the website

Twitter, - Id and if possible grab fan count Facebook, - name and if possble follower count

LinkedIn, - name and if possible follwoer count

Google, - name and if posisble follower count

Pinterest, - name and if possible follower count

GitHub, - name if possibel fan/follower count

Instagram, - name and if possibel follower count

Vk, name and if possibel fan count

Vimeo, name and if possible fan count

Youtube, name and if possibel fan count

People, - if there are people listed/employees then their names and titles/blurbs

City,

State,

Zip,

Country,

First Detected, - first tie scanned

Last Found, - same as first until scanned again

First Indexed,- date of first time all info grabbed

Last Indexed - date of last scan

We prefer the domains being called from a Mysql DB and the results being stored back into the DB but if for performance reasons it is faster to store them in say google sheets, that is fine. This script must be scalable (either via duplication or smaller scripts controlled by masters to scale to be able to scan tens/hundreds of thousands of websites per day.

So the project is for developing the same script in 2 different platforms with Super high performance. 1 is google scripts and the other is PHP based. Our preference is DB driven but if your experience says that there is another way to work to improve speed then that is fine. We must however be able to bring results into a database though.

Joomla MySQL PHP Software Architecture Web Scraping

Project ID: #16639268

About the project

31 proposals Remote project Active 5 years ago

31 freelancers are bidding on average $552 for this job

AzzkaNoor

I am confident that I can implement this project as I have read all the details. There are some questions to ask so the clarify some doubts, so please message me. Eager to present my portfolio over the chat. Please More

$555 USD in 10 days
(81 Reviews)
8.4
extreamcode

HI There, I can assist you with web scraper using google scripts / PHP. I am very passionate about quality of my work, You will be pleased working with me. Let's have a quick chat to discuss it further. You can More

$555 USD in 10 days
(110 Reviews)
8.0
schoudhary1553

Hi there..... Warm Greetings We came along with your request for web scraper using google scripts / PHP and we reviewed your project description. We'd like to help you with confidence and satisfying results... More

$555 USD in 10 days
(201 Reviews)
7.6
kalidass678

Hi, I am venkatesh kumar senior PHP developer, I have more than 8 years experience in responsive website development. I have read your full description i am very much confident to do this job. Looking forwa More

$555 USD in 10 days
(181 Reviews)
7.3
mmadi

Dear advancedcoder1, I have gone through your project description "web scraper using google scripts / PHP" and could assure you the best of the solution. I am taking it as an opportunity and ready to deliver my best. More

$525 USD in 12 days
(50 Reviews)
7.1
maamekal

Hi, We have more than 6 years of experience in Web Development/Designing & have Developed numbers of websites in the past. We have an expertise in: ✔ PHP and its Frameworks like Codeigniter. ✔ CMS's like Wo More

$555 USD in 10 days
(159 Reviews)
7.0
kailasamir

hi there, the basic script will get ready in 8-10 working days and will grow up eventually. To grab and identify, City, Address, State, Country, Zip, Phone number and other parameters we have to do some analysi More

$1333 USD in 10 days
(64 Reviews)
6.7
webmetek

Hello there, I'm developer and i have experienced in development more than 6 years,and i have experienced development team as well, we are webmetek company already i have made more than 50 websites so please let me More

$250 USD in 10 days
(54 Reviews)
5.9
arjun366333

Ready to start the work to make web scraper using Google scripts and PHP, We can discuss more over chat, Thanks Arjun S.

$400 USD in 10 days
(33 Reviews)
6.1
athminteam

Your project comes under our area of interest, together we can finish your project with our technical expertise and dedicated team.

$555 USD in 10 days
(6 Reviews)
5.4
SeniorWebDev1

Dear sir. I have a sample project I have made before. If you are OK, I can show you this. I am an expert. I can do your project perfectly. I've ever done lots of works like that. T More

$555 USD in 10 days
(40 Reviews)
5.7
remotetypo3

Hello, I am working as PHP Developer from last 8 years. I am expert in TYPO3 & WordPress and other PHP frameworks and CMS. I totally understand the requirement and now let's talk more about some confirmation at y More

$600 USD in 10 days
(8 Reviews)
3.4
ishubys

Hi, I am ready to create a script on WP, Drupal, Joomla, typo3 or script on 2 different platforms for category manufacturing, retail, clothes, food, restaurant etc. I am highly interested to work on your project More

$555 USD in 10 days
(0 Reviews)
0.0