Find Jobs
Hire Freelancers

Build a FB Scraper using Macros, PHP cURL or anything else!

$1500-3000 USD

Closed
Posted over 5 years ago

$1500-3000 USD

Paid on delivery
** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. ** SUMMARY: This project is to build a scraper using macros – ie. iMacros – or PHP Curl’s for Facebook’s Newsfeed ("NF") ads OR any other safer method, and other types of ads to be decided later. GOAL: Visit specified FB page URLs and collect ads data (e.g. number of likes, comments, shares, number of comments in the past hour of a particular ad, corresponding page info, etc.) and present them neatly and in well-organized manner (e.g. can filter data based on a given rule i.e. show data based on page owner/competitor. -- IDENTIFYING NF ADS Facebook's NF ads the ones that show between status updates of your friends here: [login to view URL] The challenge is, there's several different formats of NF ads as can be seen here: [login to view URL] [login to view URL] What we're looking to do is identify story/update DIVs that contain the word "Sponsored" - as this is the common attribute among all NF ads. Then extract data from those DIVs only. Here are a few sample NF ads: [login to view URL] We will provide you with the accounts that are display these ads. -- LOGGING INTO ACCOUNTS Application will require the usage of multiple FB accounts to scrape data; hence application must have the ability to link up (and delete) with multiple FB accounts. When logging in to each account, the macro will need to ensure that the appropriate proxy for each account is used – which we will provide. When switching between accounts, the macro will need to clear all Temporary Internet Files (including Cookies) to ensure that the accounts aren't linked together. -- EXTRACTING NF ADS The scraper will need to continue scrolling to the bottom of the page, until it encounters the following messages: - Old FB Format: "Add your friends to see more of their photos and stories in your news feed." - New FB Format: "There are no more posts to show right now." It will then need to identify the DIVs that contain the text "Sponsored" and: - Identify a unique parameter (to keep track of when it was first seen, last seen, times seen) - Extract all the content within the DIV - Click the advertiser's link and record all URL redirects - Load and save any images displayed within the DIV - Save which account saw the advertisement - When the advertisement was first seen - When the advertisement was last seen - if the same ad has been seen several times - The number of times the advertisement was seen - if the same ad has been several times - Record social information such as the number of likes, comments, etc. All this information will need to be saved in the database. DEVELOPER SKILLS SET (MINIMUM REQUIREMENTS): 1. 3-4 years’ experience in web development using PRIMARILY PHP 2. Profound knowledge of related frameworks (e.g. Laravel for PHP) for faster development 3. 2-3 years’ experience with Facebook Graph API 4. Strong knowledge on writing AJAX requests 5. Must be well-versed in HTML5, CSS3/SASS, and JavaScript 6. Must have experience using git for version control (experience in using some git branching strategy is an advantage) 7. Experience with NPM and task runners is required for faster development NICE TO HAVE: 1. Experience with some basic project management application like Trello, etc. ** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. ** SKILLS REQUIRED: AJAX, Anything Goes, PHP, Web Scraping, Website Design BUDGET: Flexible/Negotiable
Project ID: 18291027

About the project

18 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
18 freelancers are bidding on average $2,276 USD for this job
User Avatar
Hello how are you? last time, i have built a php scraper engine for twitter page. twitter page have javascript loading when scroll down. let's discuss more details if this is your concern. Thank you
$2,833 USD in 30 days
5.0 (241 reviews)
8.8
8.8
User Avatar
Hello How are you My name is Xu it is possible on python and selenium it is not a problem for me please buzz me i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting
$2,500 USD in 30 days
4.9 (211 reviews)
7.2
7.2
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less
$1,500 USD in 7 days
4.9 (110 reviews)
6.0
6.0
User Avatar
Hello, I am very good at web scraping and network automation tasks. I can scrape almost any website wether it applied anti-scraping mechanism nor not. I hope you can choose me.
$1,874 USD in 10 days
4.7 (14 reviews)
4.9
4.9
User Avatar
Customer's satisfaction is my goal *** *** Also 100% Completion is happy of me and client. *** *** Rest 1% is my creative idea and honest effort. *** Looking to be your Good Venture along with your project! Best Regards.
$2,500 USD in 30 days
3.9 (20 reviews)
4.8
4.8
User Avatar
Hi, I am python developer with expertise in web automation and data extraction. I use Selenuim and beautiful soup to extract data, Selenuim works as a bot that will take input of facebook id login details and the url that is to be scraped, I have done scraping of Facebook and other social platforms before and ready to present you a demonstration before starting the actual project. Demo that I am ready to provide, includes extraction of data from the url you provide, also I will screen record the bot to show its steps during extraction. Hope to hear more from you, thanks
$1,666 USD in 30 days
4.2 (4 reviews)
3.8
3.8
User Avatar
Hello, It looks like you are looking for an experienced PHP developer expertise who can dedicatedly work on your project to build a Web Scraping script using macros or PHP Curl for Facebook’s Newsfeed where it can visit specified FB page URLs and collect ads data and present them neatly and in a well-organized manner. Currently, we are working on one of the same project, where we are mining websites in different groups of the scrape. Credibility, the developer will be responsible to work on AJAX, Anything Goes, Facebook API, PHP, Web Scraping. I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. So, from our end, we have +12 years experience team and has good working hands-on in PHP, React, Redux, CSS3, HTML5, full stack development, frontend and backend development, React.js, Phalcon, Laravel, Symfony, Yii, Javascript, MVC, Ajax, Typescript, Magento, CSS3, PHP cake, Wordpress, Codeigniter, CSS3, Angular Js, Node JS, and UI/UX. Awaiting for a positive response :) Regards! Akash
$2,722 USD in 31 days
5.0 (1 review)
1.6
1.6
User Avatar
Hi, I m truly excited to be working with you on your new project. We trying to fulfill your all ideas/plans. It will vary on every project. I'll look forward to your response. Thanks.
$2,500 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, Love this job. Lets start with me coz i will create an automation tools that will help you to do this job. faster and without any human interventions. Text me soon and lets start. Waiting your feedback and thanks
$1,666 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Sacramento, India
4.9
53
Payment method verified
Member since Aug 20, 2005

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.