Find Jobs
Hire Freelancers

scraper/crawler with Crawlee (TypeScript/Node.js)

$30-250 USD

Closed
Posted about 1 year ago

$30-250 USD

Paid on delivery
Hey, I need the following: A crawler based on crawlee ([login to view URL]) adding - the ability to get the proxies from an API endpoint (I will provide) - extract [login to view URL] microdata with node-microdata-scraper ([login to view URL]) from the resulting payload – no additional request - Send the result to an API endpoint (I will provide) Please read the project details and make sure that you refer to the content in your offer!
Project ID: 36219526

About the project

29 proposals
Remote project
Active 1 yr ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
29 freelancers are bidding on average $194 USD for this job
User Avatar
Hi, I'm George, experienced web crawler and scraper! Having completed similar projects before, I'm confident I'm the perfect professional for the type of job you're describing. I have experience working with both Crawlee and node-microdata-scraper and understand the task involves creating a Crawlee based crawler with the ability to get proxies from an API endpoint, extract microdata with node-microdata-scraper and send the result to an API endpoint provided by you. In addition, I have worked with our custom web scraping tool to get the job done and believe I can help you out as well. I have some questions: 1. What is the format of the payload you expect? 2. What are the input and output formats you wish to use? 3. Do you require you want authentication for the API endpoints? 4. Is th
$500 USD in 3 days
5.0 (90 reviews)
7.8
7.8
User Avatar
Hi Felix W., I am excited to submit a proposal for the scraper/crawler with Crawlee (TypeScript/Node.js). As an experienced software developer with over 10 of experience, I believe I possess the skills and qualifications necessary to excel in this role. My expertise includes list relevant skills or technologies such as JavaScript, Web Scraping, Node.js, Typescript, Web Crawling, and experience with relevant frameworks and libraries. I have also worked on various projects throughout my career, including JavaScript, Web Scraping. In addition to my technical abilities, I am a team player who enjoys collaborating with others to solve complex problems. I have excellent communication skills and a strong attention to detail, which enables me to work effectively with stakeholders and ensure that project requirements are met. If hired for this role, I am confident that I can make a valuable contribution to your team and help drive the success of your software development projects. I am available to start immediately and am willing to work on a full-time basis. Lets connect in chat so that We discuss further. Thank You
$110 USD in 7 days
4.9 (77 reviews)
7.3
7.3
User Avatar
Dear Employer, I am writing to express my interest in the Scraper/Crawler project that you have posted. With my expertise in TypeScript and experience in web scraping and crawling, I am confident in my ability to develop a solution that meets your needs. I have a strong understanding of Crawlee, Puppeteer, Cheerio, and other web scraping tools, which enables me to create effective and efficient crawlers. My attention to detail, dedication, and strong communication skills make me a valuable asset to any team. Thank you for considering my application. I am excited about the opportunity to work with you and deliver the results you need. Best regards, Ferdous
$140 USD in 7 days
4.9 (204 reviews)
7.2
7.2
User Avatar
Hey !! I am fully worthy to do this task given working environment scraper/crawler with Crawlee (TypeScript/Node.js)As I am SENIOR EXPERT /TYPESCRIPT/NODE.JS/Full stack developer having 7 years of working experience . ^^I am available to start immediately and looking forward working with you . Many Thanks !!
$555 USD in 5 days
4.8 (62 reviews)
6.8
6.8
User Avatar
Hi, We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on JavaScript, Web Scraping, Node.js, Typescript, Web Crawling Lets connect in chat so that We discuss further. Thank You
$200 USD in 7 days
4.8 (29 reviews)
5.9
5.9
User Avatar
Hello, Felix W. I have checked your job post. I have many experiences in Typescript, Web Crawling, JavaScript, Web Scraping and Node.js. I am sure I can complete your project perfectly. Why don't we work together? I'd love to hear from you. Thanks
$155 USD in 3 days
5.0 (9 reviews)
4.9
4.9
User Avatar
Hello there, Thank you for taking the time to read this proposal. I understand that you are looking for an expert to assist your project, and I genuinely hope I can help. My skills as a software engineer/architect with over ten years of expertise and a major in information technology will be of advantage for your project and help you save time and stress. I am willing to help work on your project and I'm available to start right away. I would like to assist you in developing a crawlee that has the ability to get proxies, extract microdata with node scraper and send results to an API end point. With my proficiency, I can guarantee you a great outcome that makes the best use of technology standards and also meets your timeline. I would be delighted to collaborate with you and turn your ideas into a successful project. Could you please initiate a conversation so we can discuss this in great depth? Best Regards, Martin.
$140 USD in 7 days
5.0 (2 reviews)
4.9
4.9
User Avatar
scraper/crawler expert I 'm an expert and Perfectly Can complete your Project! I can start NOW I Just have a question pls message me via chat to discuss ..
$30 USD in 1 day
5.0 (18 reviews)
4.7
4.7
User Avatar
Hi, I can do this project right now with 100% accuracy. If you need any sample, please let me know. Thanks
$30 USD in 1 day
4.9 (21 reviews)
4.4
4.4
User Avatar
Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg
$30 USD in 7 days
4.9 (9 reviews)
4.1
4.1
User Avatar
Hi, Felix W.. Hope you're doing well. I am quickly responding to your job as I am the right fit for your project. More specifically, I have done similar project before. I have ✔ Rich experience in JavaScript, Typescript, Node.js, Web Crawling and Web Scraping ✔ Solid understanding of this project I could complete this project within the given deadline perfectly. Please contact me. I am ready to start your job right now. Look forward to hearing from you. Thanks!
$150 USD in 3 days
5.0 (3 reviews)
3.5
3.5
User Avatar
Hi, there. I am currently working as an Automation and scraping developer with Python. I have been working on several web scraping tasks, such as from Amanzon, Grofers, Jiomart, BigBasket etc. I can even handle data effectively, work with HTML, CSS, and Javascripts of webpages, and deliver everything in an excel file according to your needs. I will scrape required data from one API endpoint to another API endpoint. Happy to help!
$100 USD in 7 days
5.0 (5 reviews)
3.7
3.7
User Avatar
Hello,I go through your project regarding about scraper crawler with crawlee and , I understand it completely according to your requirements and demands. I am a full stacked experienced web developer having more then five years experience in this relevant field, also gathered different languages as WORDPRESS , HTML , CSS , PHP , JAVA SCRIPT , SHOPIFY , WIX , WOOCOMMERCE ,LARAVEL ,PYTHON ,GRAPHIC DESIGN, ,OPEN CART ,BBOTSTRAP JOOMLA ,MYSQUL and etc. I am fully devoted towards your work and complete it be on time. You can also look my previous history, rating and success of my work. Ping me in chat for further discussion and through out , so i can start work on your project immediately. Thanks Regards, Arbaz A.
$160 USD in 4 days
4.5 (2 reviews)
2.2
2.2
User Avatar
I love the flexibility and control that Crawlee provides to build an efficient scrapping bot. I have even worked with advanced features of crawless such as rate limiting, request caching, and custom middleware, allowing us to fine-tune the scraping process and ensure that it is efficient and respectful of the target website's resources. Thank you
$230 USD in 5 days
2.0 (1 review)
1.4
1.4
User Avatar
Hi, I would like to grab this opportunity and will work till you get 100% satisfied with my work. I'm a professional software engineer with many years of experience in JavaScript, Web Scraping, Node.js, Typescript, Web Crawling Let's connect by chat so that we can discuss further. Best Regards, Nikoloz Nadashvili
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I hope you are fine. I just read your project description. I am glad to find out that this project perfectly fits my skills. I will be happy to complete this project for you as described. Please feel free to reach us out anytime for further 'detailed discussion' about your project. Thank you!!
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Your project seems quite straighforward and using crawlee will help a lot. Do you expect the target site to have specific protections to overcome with the crawler ? How many sites do you expect to crawl ? I'm a senior fullstack developer and have more thant 5 years of experience working with nodejs on apis, services and crawlers, I'm sure I can successfully help you. Please contact me so we can discuss the details further. Regards
$150 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey, I'm Andrew and I have plenty of experience developing web crawlers/scrapers. After a detailed look at your project, I'm confident I can provide the highest quality service. I'm familiar with the Crawlee library, and my team has developed a custom web scraping tool successfully used in multiple projects in the past. With Crawlee and node-microdata-scraper at our disposal, your project should be running in no time. 1. What data will be retrieved? 2. Will I have to do a complete scraper from the ground up, or is there a base one to build from? 3. How do you want the results delivered? 4. What is the goal of this project? 5. Are there any performance goals you need to achieve? I'm looking forward to discussing your project further and seeing how I can help.
$500 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GERMANY
Essen, Germany
5.0
24
Payment method verified
Member since Jan 12, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.