Find Jobs
Hire Freelancers

Python developer to develop web spiders using Scrapy.

$250-750 USD

Closed
Posted about 7 years ago

$250-750 USD

Paid on delivery
Python developer to develop web spiders using Scrapy. Full-time remote work. $5 per hour, 8 hours per day, 5 days per week. Monthly payments. Requirements: 1. Skills in web scraping, including crawl of portals with javascript enabled 2. Good knowledge of Python 3, Scrapy 1.0, ability to write own middlewares/extensions for Scrapy project. 3. Unit tests, PEP8 is a must. 4. Ability to understand someone else's code, fix bugs in other spiders, maintain a corporate code writing style is a must. 5. Knowledge of HTTP (headers, requests, responses), understanding of how browser interacts with webpages. 6. Knowledge of JS at the level of understanding of how the ajax requests server. 7. Ability to analyze how the website works by using Chrome Developer Toos/Firefox DevTools. 8. Basic knowledge of how to work with databases(MySQL). 9. Willing to learn new technoligies. All requirements are mandatory. Work terms: It is a full-time remote work. 8 hours per day, 5 days per week. Prefer local time of the employee is GMT +2 +- 2hours. Preferences to candidates from the countries of Eastern Europe. Business hours are from 9 a.m. till 6 p.m. You need to be always online and at the workplace during business hours. Communication via skype. Tasks are appointed through Trello. Mandatory daily meetings on the results of the previous day. Mandatory use of time accounting system Toggl for all tasks. Payment increase can be only after successful co-operation, but no earlier than after 6 months. Candidate must perform the test task for the successful completion. The task is unpaid and necessary in order that the candidate has shown its ability to develop the spiders, which he will continue to implement on the working tasks. In case to insure that you have read this vacancy attentively you must include the text: PythonScrapyAADeveloper in the beginning of your cover letter. All cover letters without this text will be rejected. Please send your CV with description of your Scrapy and web scraping skills. If your candidature suited us then you will be interviewed by Skype. After that you should perform the test task within reasonable time (2-3 days).
Project ID: 13155373

About the project

13 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
13 freelancers are bidding on average $622 USD for this job
User Avatar
Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Kimi
$453 USD in 6 days
5.0 (227 reviews)
7.3
7.3
User Avatar
Web scraping expert My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 150 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, webshops and other sites with lists of any items). I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc. If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode. I can export data into json, xml, csv (excel), or any database (mysql, mongodb, mssql, etc). I can develop web-interface for management running script (start, stop, etc), using PHP, HTML, JS.
$300 USD in 2 days
4.8 (148 reviews)
6.9
6.9
User Avatar
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
$555 USD in 10 days
4.9 (61 reviews)
6.9
6.9
User Avatar
PythonScrapyAADeveloper А чего это вы проект создали с фиксированной оплатой? Ставьте сразу почасовую :D P.S. Я не кандидат, просто так, фи выразил :D
$2,777 USD in 30 days
5.0 (8 reviews)
5.5
5.5
User Avatar
Hello, My name is shahid from Kashmir Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years rich experience in the field.I have successfully completed more than 1000 projects in this field you will be glad to know that I am best fit for your project my key skills are. Python Email developer, software architecture and Scrapping Using Python, Wordpress , C Programming , C++Programming, Linux,PHP,MYSQL ,Java ,Javascript, ,Website Design ,Graphic Design,CSS,Research,WordPress ,Magneto ,MATLAB and Mathematica ,Leads ,Web Search ,Machine Learning ,HTML5 ,LinkedIn ,Landing Pages ,Web Services ,Internet Research ,Angular.js ,,Data mining,,Web scrapping,Find contacts, Data Processing, Data Entry, Excel, Leads, Web Search, Data Mining, Linked in, Microsoft Office, Email handling. I am a highly skilled web researcher,data entry provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills. I have successfully completed more than 100 projects ranging from, WordPress , C Programming , C++ Programming, Linux,PHP,MySQL ,Java ,JavaScript ,Website Design ,Graphic Design,CSS,Research,WordPress ,Magneto , You can test the quality of my work and also i provide work at best price in the market. Regards:
$251 USD in 10 days
5.0 (6 reviews)
4.3
4.3
User Avatar
Hi, I have more than a year of experience in web scraping and automation with python, selenium, scrapy. Experience with mongodb, mysql, mssql. My hourly rate is 7$. Look forward to hearing from You.
$555 USD in 10 days
5.0 (8 reviews)
3.8
3.8
User Avatar
Hello, I am Raqiya I am expert in web scrapping, data crawling and data mining,I have 7 years+ experienced employees in data mining, website scraping, screen scraping and that too certified web scrapper expert. I have completed 100+ projects of web scraping . Mykey Skills are: Web scraping, Data mining, Data crawling, Ms Office(FULL) JavaScript, Go, PHP, SQL, HTML, Python, Perl, CSS. Platforms:Linux, Amazon Web Services (AWS), Google App Engine, Windows, Mac OS X. You can test the quality of my work if needed.. So I will be waiting for your response. Thanks. Sumira
$250 USD in 10 days
5.0 (1 review)
0.0
0.0
User Avatar
Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned I have checked your requirements.i have right skills to work on this assignment my award = superb result = happy client. In a good partnership, good results happen. Good cooking makes good eating!BWe consider our client as our partner. can u provide your email or sky-pe etc for further discussion about the project. I am ready to discuss with you with best Regards
$555 USD in 6 days
0.0 (0 reviews)
0.0
0.0
User Avatar
PythonScrapyAADeveloper Hello, my name is Igor. I live in Serbia (GMT +1). I'm very interested in working for you. I've been working with scrapy on and off for the last six months. I've build few dozen spiders, most of them were updating MySQL database. I have limited experience writing middlewares (i wrote one ip rotator middleware). I'm also working on web development projects (using mostly python flask, css/bootstrap, javascript/jquery) so I'm very familiar with the front end part of the website, and able to analyze it from the developer tools. I have no expirience in writing extensions, unit-tests and scraping java-script. I know you said that all requirements are mandatory, but I decided to bid because those requirements are something that is possible to learn in relatively short amount of time. And also, I feel that, other than that, I m perfect fit for this role. If you decide to go with me, I will make my self available for the full-time ( 9 a.m. till 6 p.m.) and in my spare time and over the weekends I will work hard on building new skill-set, and improving existing. If you have any further questions, or want to talk about projects I've been working, I will be happy to answer. Kind regards Igor
$277 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, i am senior android and web developer, have experience with client server apps and mobile apps custom UI. Why would you hire me? -I will not waste your or my time! I know very well about the value of time and reputation. I will say YES to your projects only when I will be absolutely sure about meeting your requirements 100%. -I am an organized person and a fast worker. I maintain schedules and I always meet your deadlines. Many of my clients have said that I am the fastest provider they have worked with. -I have worked on a lot of projects and my feedback score is good. Thank you
$555 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of RUSSIAN FEDERATION
Russian Federation
0.0
0
Member since Feb 19, 2017

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.