Web scraping with ruby and nokogiri jobs

I need an expert in Python web scraping to help me extract specific data from a website. - The website I need data from will be disclosed once the project is awarded. - I have a specific list of data points I need extracted. - The frequency of updates for this data is not set yet. Ideal skills: - Proficiency in web scraping with Python - Experience in extracting data from dynamic websites - Ability to follow instructions and deliver precise data outputs - Good communication skills for potential project extensions and updates

Gmail ActionMailer has stopped working and I'm encountering an authentication error. After I changed my email password, and now I'm unable to send emails from my application.

...working with a client who has an old website built in ColdFusion. The website is going to be moved over to WordPress to give the client more flexibility updating etc. One of the challenges I have is that I need to migrate over about 400 photo galleries from ColdFusion into a WordPress Custom Post Type. Here is the current Structure: Primary Gallery Name - Sub Category (Year) - Gallery (with all the gallery images) Now there are 18 primary galleries, then under each primary gallery there are approximately 19 subcategories (the years), then within the subcategory is the gallery itself. I am looking for someone who can scrape the content from the existing website, and structure it exactly the same way in WordPress using ACF (Advanced Custom Fields) and Pos...

...aggregates news from various sources and uses machine learning to curate content based on user preferences. The dashboard will feature an AI-driven recommendation system that not only presents news articles but also provides analytical insights into trending topics and sentiment analysis of news content. Objectives: Main Goal: Develop a web application that personalizes news content for users based on their reading habits and preferences. Secondary Goals: Implement data visualization features to display trends and sentiment analysis of news articles. Minimum Requirements: Content Aggregator: Develop a system that pulls news data from various APIs or web scraping. User Profile Management: Create functionality for users to register, login...

...can locate roofing contractors with $1M or more in revenue on LinkedIn Premium, run a speed test on their mobile site and post matching results on an xlsx page. Key Tasks: - Locating Roofing Contractors: The tool should be able to scrape specific data points from LinkedIn Premium, mainly Company name, Revenue, and Location. - Mobile Site Speed Test: Once located, the tool should be capable of running a mobile site speed test on the found contractors. This test should focus on checking mobile site responsiveness and evaluating overall mobile site performance. - Results Presentation: The final task is to present the matching results in an xlsx sheet. Ideal Skills and Experience: - Proficiency in AI development and web scraping t...

I require a proficient web scraper to extract varied data types including text content, images, and metadata from specific websites. The primary function will be to gather, organize and present data in a structured and usable format. - Skills and Experience Required: - Strong knowledge in web scraping tools and techniques - Familiarity with data extraction, mining, and storage - Proven track record in delivering similar projects Due to a time-sensitive nature, I will need this project to be completed within a month. The quick turnaround shouldn't compromise the quality or functionality of the web-scraper. Do bear in mind that reliability, efficiency, and accuracy of the data extraction...

This price is only to post this project. Price will be discussed after providing full requirements. I need a browser extension developer for Chrome and Firefox for long term. I have so many projects in my mind to start. So, I am looking for developer for long term. Key Requirements: - Development of a cross-browser extension for Chrome and Firefox - Primary function should be automation, scraping etc.. - More details will be provided to the selected Freelancer. New freelancer who have expertise in this skills can also apply and they will get the opportunity to work in a long term project and they will get good reviews to boost their profiles. Thanks.

Dear freelancers, I need help to promote a petition against corruption in the entrepreneur program in Australia. The main goal is to increase petition signatures. Key Responsibilities: - Scrape ...help to promote a petition against corruption in the entrepreneur program in Australia. The main goal is to increase petition signatures. Key Responsibilities: - Scrape some websites to gather contacts from 'Entrepreneurs and business owners' groups in Australia. - Sending mass emails / DMs that with a link to this a petition . If possible, create groups on other social media platforms. I have a vision problem and need to avoid looking at screens, so I don't have social media accounts. if it works and I get a grant, I will offer a $500 bonus at lea...

...proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be ...

I'm looking for an experienced Ruby on Rails developer who can handle key backend development tasks and manage our databases. The ideal candidate for this position should have: - Expertise in Ruby on Rails: We need someone who knows Rails inside out and can deliver high-quality backend solutions efficiently. - Database Management Skills: Experience with managing databases and optimizing their performance is crucial. - Problem-solving and Communication Skills: Excellent problem-solving abilities and effective communication are essential. - Experience with Rails 5.x, 6.x, or 7.x is a plus, but not a requirement. The main focus should be on your expertise and experience in developing robust and efficient ...

...profile is geared toward data entry, copy-paste, web research, and other recurring tasks. I am a fast, reliable, and trustworthy online worker. I helped many startups, entrepreneurs, and business owners achieve their business goals in the past. I am an excellent communicator with sublime linguistic skills, and attention to detail is my key skill. Ill follow your instruction for the letter and get back to you with fantastic results. Here are the services I offer: Data Entry Data Mining Excel Data Entry CRM Data Entry Data Scraping Copy Paste Work Data Conversion Shopify Product Listing WordPress Data Entry PDF to Excel or Word JPEG to Excel or Word Typing in Excel or Word E-commerce Products Listing W...

I need an expert in Python web scraping to help me extract specific data from a website. - The website I need data from will be disclosed once the project is awarded. - I have a specific list of data points I need extracted. - The frequency of updates for this data is not set yet. Ideal skills: - Proficiency in web scraping with Python - Experience in extracting data from dynamic websites - Ability to follow instructions and deliver precise data outputs - Good communication skills for potential project extensions and updates

I'm in immediate need of a Python expert to help me scrape data from website. This is a time-sensitive project, so I'm looking for someone who can start on it right away and deliver quick results. Key Requirements: - Proficient in Python programming - Experienced in web scraping, particularly extracting text content - Able to work quickly and efficiently without compromising data accuracy - Good communication skills to keep me updated on progress - Capable of starting immediately Please share your relevant experience and how you plan to approach this task. The sooner you can deliver, the better.

...developer with google app script experience to adjust an existing Google App Script that's currently dealing with scraping linkedin from google search api. The purpose of the limit was initially for getting quality data, however, it's currently hindering my ability to extract more social media content - which is crucial for my project's success. I need quick tweak to the script to ensure the limit is removed. It should not only allow for a larger volume of data to be extracted but should also be optimized to prevent any potential server resource issues. Ideal skills and experience for this job include: - Proficiency in Google App Script - Prior experience with web scraping and data extraction - Ability to optimize...

I need a python software that can find emails from LinkedIn Sales Navigator URL...Designation Procedure: - I shall enter sales navigator ulr where multiple leads in pagination format displayes. - Software will pick each person url and find out his email (personal/professional) - Add that record along with above fields in excel sheet. Make sure software must not stuck, and i shall clear the payment after testing couple of days. Ideal Skills: - Proficiency in Python. - Experience in web scraping, particularly with LinkedIn URLs. - Familiarity with data manipulation in Excel files. This project is ideal for someone with a strong background in Python and web scraping. The successful freelancer will help me automat...

I'm seeking a professional to assist with integrating my python scraping script output to my personal WordPress site in real-time. Key Requirements: - The integration should be real-time and without the need for page refresh - The current output of the python script is a CSV file, but can be Json or another Ideal Freelancer: - Proficient in Python and WordPress - Experience with real-time data integration - Familiarity with data formats (CSV, JSON, etc.) - Excellent communication skills to deliver a seamless solution Looking forward to working together.

Hi, As discussed i have understood the requirement for powerapps creation with sharepoint list as backend database. The mutiple roles will be implemented using sharepoint group our master sharepoint list have all approvers level/department wise. Cost : 7000 Rs My Profile: -- 13+ years of experience with with different SP versions -SP Online/2019/2016/2013/2010 -- 3+ years of experience with power platform Power automate, PowerApps. -- worked for Sharepoint migration from on-premise to online using sharegate and microsoft tool. -- worked with power automate desktop for scraping data and excel automation. -- Worked with Nintex Forms and flows -- Experience with SPFx, ReactJS, JavaScript, jQuery, Typescri...

...articles, list them with their respective headlines, and provide convenient links in a chronological order. This will allow me to easily navigate through the latest content available on Bloomberg News. Key Features: - Automatically skimming and listing most of the Bloomberg News articles - Displaying article headlines with links in a chronological order Technical Requirements: - Development for the Windows platform - A user-friendly desktop application interface - Ability for the user to manually request updates for the article list Ideal Skills & Experience: - Proficiency in Windows desktop application development - Web scraping experience - Strong understanding of data presentation and organization - Familiarity with Blo...

...my account on and download all the videos stored there. The details are as follows: - The operating system this script will be running on is Windows - The script should also classify the downloaded videos into different folders on my PC, labeled according to the team name each video corresponds with. - The hired freelancer may have to study Veo's UI for this purpose. - I'd need this task completed ASAP. Ideal skills and experience: - Previous experience with Web Scraping and handling Video files - Extensive knowledge of Python with specific experience writing scripts - Understanding of Video download and organization, preferably with the Veo platform - Quick execution without compromising on efficiency ...

I'm looking for a ...in various categories. I need someone who can tackle challenges in Web Exploitation, Binary Exploitation, Cryptography, as well as other categories like web, forensics, osint, and more. Key Responsibilities: - Solve advanced level CTF challenges in multiple categories Ideal Skills and Experience: - Extensive experience with CTF challenges - Proficiency in solving challenges in Web Exploitation, Binary Exploitation, Cryptography, web, forensics, osint, etc. - Proven track record of solving advanced level CTF challenges - An understanding of security concepts Please note that the specific programming languages or platforms to be used in solving the challenges are not specified, but your background in Python, Jav...

I need a skilled developer to help me collect data from various websites to find a competitive edge. Key Requirements: - Prior experience in web data scraping - Ability to scrape data in real-time to ensure the information is up-to-date - Understanding of data analysis and how to interpret the results - Familiarity with competitive research The data collected will be used to inform my business strategies, so it's crucial that it is collected accurately and efficiently. Although not the immediate priority, I'm also interested in exploring the possibility of creating a discord bot and potentially web design in the future. A developer with experience in these areas would be preferred, though not essential. The developer m...

...scope 1, 2, and 3 emissions database through web scraping and data moderation. The selected developer will be responsible for scraping emissions data from global listed companies, implementing a moderation system, and enhancing our current offering by providing a database of published emissions data for ASX companies. Responsibilities: 1. Web Scraping - Web scrape scope 1, 2, and 3 data points from global listed companies to populate the VeriCO2 emissions database initially. - Develop scripts or tools to automate the web scraping process and ensure efficient data collection. 2. Data Moderation - Implement a moderation check to review and update data points based on user feedback and...

I'm in need of a professional who can build a tool that scrapes product data from Walmart and exports it into an Excel spreadsheet. Key Requirements: - Develop a web scraping tool specifically for Walmart website - Extract essentials (price, upc, title) Skills and Experience: - Proficiency in web scraping using Python, Scrapy, or similar tools Please let me know your availability and estimated time for completion. This is an urgent project, so a quick turnaround would be highly appreciated.

...final feedback and approval, looking to shortlist some candidates we will share our final scope with) Description: VeriCO2 is seeking a skilled developer to assist in completing the development of Phase 1 of our automated quantification of scope 3 emissions project. The selected developer will be responsible for conducting a thorough code review and integrating an emissions factor database into the existing codebase. Responsibilities: 1. Code Review and Functionality Check - Review the existing code to ensure there are no backdoors from the previous developer. - Verify that the code is functional and all equations for each method within the 15 scope 3 categories under the GHG protocol are correct. 2. Emissions Factor Database Integration - ...

Description: Seeking a freelancer to find and verify the contact information (email and mobile number) of specific job titles at a list of companies. We will provide the list of companies and if possible the name of the person we would like to speak with, just need for you to track down the email address and phone number. Responsibilities: • Research and identify the correct person in each company based on the provided job titles. • Find and verify the email and mobile number of the identified person. Requirements: • Strong research skills and attention to detail. • Proficiency in using online tools and databases for contact information search. • Excellent communication skills. • Strong ...

I am seeking a proficient programmer to build a program that helps identif...as access to this information is free. - Use UPC data to perform a search on eBay to see if the item is available on the platform. - Generate a profit prediction report based on eBay's item purchase history. The ideal freelancer for this job would have great scraping skills, experience with eBay's API, and be able to develop a friendly user interface. A background in eCommerce profitability analysis would also be advantageous. Key programming languages for this job include Python and JavaScript. Previous experience with web scraping libraries (BeautifulSoup, Selenium, etc.) is vital. End goal is to create a system that aids in making profitable product...

I'm looking for a skilled individual who can help me scrape data from a dead mobile app (has both ios and android versions). The database of the app is of particular interest, however, I am not sure of the specifics such as the Database Management System (DBMS) it uses. Key Points: - Extracting data from the database of a defunct mobile app - Unspecified Database Management System (DBMS) - will require exploration and identification Ideal Skills and Experience: - Proficiency in data scraping and extraction - Strong background in database management and familiar with multiple DBMS - Resourcefulness and ability to work with minimal information Please get in touch if you're confident in your abilities to handle this t...

Looking for scraping expert to write scraper script to download from a website that has captcha. The scraper script must be Windows executable .exe file that is very easy for non-technical user to just open and run.

...(if available), floorplans (if available), and location. This data should be compiled and organized into a spreadsheet for easier analysis and comparison. This is not Zillow or any traditional UK or US based portal, the website is specifically a portal focusing on luxury items Key Requirements: - Extraction of specific information from residential properties only - Data to be collected from a well-known property portal - Compilation and delivery of data in a spreadsheet - Inclusion of property description, price, number of bedrooms, bathrooms, images, videos (if any), floorplans (if any), and location - Images to be put into separate folders named after the property they are from Ideal Skills and Experience: - Experience with web...

I require a professional Python script to scrape a website for data. Key Requirements: - The script should be designed for a one-time run - The website does not have JavaScript dynamic content, so the script does not need to handle dynamic content The ideal freelancer for this project should have prior experience in: - Python programming - Web scraping - Handling static web content

I'm in need of a professional who can build a tool that can extract data from LinkedIn. The data I'm interested in includes: - Contact information (email address, phone number, etc.)...Connection network (connections, mutual connections, etc.) I'd like the extracted data to be conveniently structured in a CSV (Excel spreadsheet) format. The primary use of the extracted LinkedIn data will be for lead generation. The ideal candidate for this project should have: - Expertise in web scraping and data mining, particularly with LinkedIn - Proficiency in data handling and structural organization - Proven experience with developing tools for lead generation - Strong communication skills and a good understanding of client needs. ...

I'm looking for a web scraping expert to carry out daily data extraction. The websites to be scraped will contain text content, along with images and video. I may need the scraping program to be written such that it can be conducted on a daily basis. to update new articles We are going to be scraping around 50 websites for the first project Key Requirements: - Profound experience in web scraping and automation tools. - Strong problem-solving skills to deal with any potential web structure changes. - Creating and maintaining a database of the scraped data would be a plus. Please provide your quote, along with the tools you intend to use for this process and your relevant experience. L...

I urgently require a proficient programmer who can create a program for me. This program should be capable of copying numbers from an updated in real-time website and then paste those numbers into a text file format. Key tasks include: - Scrape numbers from a certain site that updates in real time. - Paste and save these numbers strictly in a text file. - Ensure the application is user-friendly and effective. Since I didn't specify the operating system, all OS platforms are welcome. Familiarity with web scraping tools and an understanding of different file formats will ensure task success. Time efficiency is crucial; hence, I need this project completed as soon as possible.

I am looking for a freelancer who can extract specific data from a Swedish business directory using Python. Main URL: Key Objectives: - Extract company names, contact information (phone/email), and business numbers from the directory. Ideal Candidate: - Proficient in web scraping techniques - Strong command of Python - Previous experience with similar projects will be considered a plus. Please reach out if you have the necessary expertise.

I'm urgently in need of a skilled web scraper who can collect links from a company's website. Here is what you need to know: - The focus of this project is on the headlines of a website. You'll need to scrape these headlines as links. - The website has several sections, but you just need to scrape the headlines from the homepage. I need this done as soon as possible. If you have previous experience with web scraping and can start on this task immediately, I'd love to hear from you. Please share your experience in scraping data from websites and your availability to take on this task.

I'm looking for a coder savvy in Python to help me scrape contact informatio...help me scrape contact information from a specific business directory. The task involves enumerating a set of links on the site and scraping the following data: - Email addresses - Phone numbers - Physical addresses - Names Ideal Skills: - Proficiency in Python - Experience with web scraping - Familiarity with business directories The main goal is to have a comprehensive list of contact information, which I will use for a marketing campaign. The scraper should be able to handle a large volume of links and data. Your expertise in Python programming and web scraping is crucial for the success of this project. Your attention to detail a...

...Optimization: * Utilize Feedgen with Vertex AI to generate high-performing product titles and descriptions optimized for Google Merchant Center feeds. * Integrate with Google Sheets for seamless data import and export. * Website Meta Tag Optimization: * Develop a custom script on Vertex AI to: * Scrape content from web pages (titles, headings, body text). If scraping is not feasible, allow for manual input of content. * Utilize Gemini to generate SEO-optimized meta titles and descriptions based on the scraped/input content. * Ensure the script can handle both automated scraping and manual content input scenarios. Requirements: * Proficiency: Strong experience with Google Cloud Platform, Vert...

...market. Our app specializes in web scraping to gather and compare rental prices from leading car rental websites like DiscoverCars, AutoEurope, DoYouSpain, and others. The name of the app is PriceBook Key Features: Real-time Data Collection: Our software continuously scrapes data from various car rental websites, ensuring that users have access to the most up-to-date pricing information. Price Comparison: The app automatically compares rental prices from multiple providers, highlighting the best deals and most favorable rental conditions. Customization: Users can tailor their search based on specific criteria such as location, rental period, and vehicle type, providing a personalized search experience. User-Friendly Interface: The app featur...

...freelancer who can help me with Web Scraping. We have a list of websites that we would like to scrape specific data from, and have them put into a set of MySQL Databases (or maybe something else). The website that we would like to scrape data from each contain thousands of articles, and we would also want other metadata, such as Author name, article date, number of views, or any other metadata that we can take from the pages. Please bid, and we can discuss the first website, you can tell us how long you think it'll take to write the scraper. There are maybe 50 websites to begin with that we would like to do this for, in this one project, and we also have another couple of similar projects. Ideally, the scraper will run form...

I have a python web-scraping script for a web-site. Web site is updated because of that my script doesnt works. I need some one who can update my script that i can use it to scrape web-site. Thanks for bidding

I need a python software that can find emails from LinkedIn Sales Navigator UR...Designation Procedure: - I shall enter sales navigator ulr where multiple leads in pagination format displayes. - Software will pick each person url and find out his email (personal/professional) - Add that record along with above fields in excel sheet. Make sure software must not stuck, and i shall clear the payment after testing couple of days. Ideal Skills: - Proficiency in Python. - Experience in web scraping, particularly with LinkedIn URLs. - Familiarity with data manipulation in Excel files. This project is ideal for someone with a strong background in Python and web scraping. The successful freelancer will help me automat...

I need a web scraping professional to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) Authentication is done through twitter, it has to be done manually to access the marketplace Deliverables: - Format: Script that I can run to

...data scraping project, coupled with Artificial Intelligence for one of Brazil's largest legal platforms, "JusBrasil." The primary task is to effectively scrape and identify case descriptions that deal with our specialty: immigration cases, specifically focusing on citizenship and international law cases. Project Scope and Expectations: - Enhance the existing data scraper to efficiently extract case descriptions from JusBrasil - Implement AI algorithms to accurately determine the relevancy of these cases to our requirements - Leverage keywords such as 'citizenship' and 'international law' to highlight the cases we focus on Skills and Experience Required: - Proficient in data scraping te...

I need a professional to gather 750 contacts from three different Houzz pages. Requirements: - The information required for each contact is Name, Email, Phone number, and business name. - The contacts should be organized by location. - There is a need for the contacts to be from the following specific Houzz pages: Kitchen Designers and Renovators, Bathroom Designers and Renovators, Design and Construction. Preferably, the contacts should be from a specific location which I will provide. The ideal freelancer for this task should have experience in web scraping and data collection. Accuracy and attention to details are also key for this project.

I need fresh email addresses from users in Germany! These should not come from web scraping or web crawlers, but from real users who have participated in contests, signed up for newsletters, or requested information on lead platforms, for example. The data must be current and deliverable. Only data from users in Germany is sought, in both the B2B and B2C sectors. B2C email addresses (freemailer addresses) are preferred. Acceptance will be based on a trial run in batches of 50,000 to 100,000 pieces (expandable), with a total volume needed of 10,000,000 pieces!

...freelancer to assist us with a high-speed web scraping project. Our existing web scraping scripts have been developed and deployed, but we need to optimize the scraping process to achieve faster data extraction rates. Responsibilities: Optimize existing web scraping scripts for speed and efficiency. Deploy and manage web scraping scripts on platforms such as Scrapy Cloud, Apify, AWS Lambda, or Azure. Implement techniques to ensure high-speed data extraction (e.g., parallel processing, distributed crawling, efficient request handling). Monitor and troubleshoot scraping processes to ensure uninterrupted operation. Collaborate with our team to understand project requirements ...

I'm in need of an experienced data scraper that can help me in extracting data from Yellowpages of Malaysia, Thailand, Japan, and Indonesia. Key Details: - I require a full listing of all businesses from various sectors within the mentioned countries. This includes but not limited to Restaurants, Hotels, Clinics, and Retail Stores. - The extracted data should be well-organized, including data such as business names, contact information, and addresses. Skills/Experience: - Proven track record in web scraping with a focus on Yellowpages. - Familiarity with the Yellowpages platforms of Malaysia, Thailand, Japan, and Indonesia. - Capability to handle large data sets and deliver the information in an easily usable format. - A...

...Developing software that can instantly capture data and automatically integrate this data with the user's own sales system. - **Main Features:** - Ability to securely log in to each supplier's B2B system. - Ability to instantly capture and process data. - Conversion and integration of the captured data into a format suitable for the user's system. 1. **Backend Development:** Required for system integration and data processing. 2. **Data Scraping/Web Scraping:** It is important to extract data from suppliers' B2B programs. 3. **API Development/Integration:** To securely integrate with suppliers' systems and retrieve data. 4. **Database Management:** It is a critical skill to organize, store ...

...urgently looking for a skilled Python developer to assist me with a project involving data analysis, web scraping, and potentially machine learning. Your role will be crucial in helping me to derive insights from a large dataset and extract specific information from the web. Key Responsibilities: - Conducting in-depth data analysis using Python - Implementing web scraping scripts to collect relevant data - Potentially developing machine learning models (based on your expertise) While the client did not specify the exact libraries, the ideal candidate should be well-versed in Python programming, particularly with libraries such as Pandas and NumPy. Familiarity with Django, although not mentioned, could be a p...

I am in need of a professional web scraper with Python expertise, who can scrape data from a website(with filter Options) and convert it into Excel format. Key Requirements: - Expertise in web scraping with Python, including dealing with website search filters. - Proficiency in data extraction and manipulation. - Experience in converting extracted data into Excel format. Please note that the specific website and the type of data to be extracted has not been provided as it was skipped by me. The project can be detailed further with the selected freelancer. If you have the skills and experience in this area, please do apply.