Aws lambda web scraping python jobs

I need a skilled Python developer to assist in setting up API functionality on my server. Key Responsibilities: - Discuss and understand API requirements. - Write efficient, secure, and scalable Python code. - Implement API functionality on the server. - Ensure API is well-documented and easy to understand for future maintenance. The project is particularly well-suited to someone with: - Strong experience in Python development and API integration. - Good understanding of server-side programming and data handling. - Ability to write clean, maintainable code that meets industry standards. I'm looking for a developer who can work efficiently, communicate effectively, and deliver the project in a timely manner.

I'm looking for a skilled individual who can help me scrape data from a dead mobile app (has both ios and android versions). The database of the app is of particu...both ios and android versions). The database of the app is of particular interest, however, I am not sure of the specifics such as the Database Management System (DBMS) it uses. Key Points: - Extracting data from the database of a defunct mobile app - Unspecified Database Management System (DBMS) - will require exploration and identification Ideal Skills and Experience: - Proficiency in data scraping and extraction - Strong background in database management and familiar with multiple DBMS - Resourcefulness and ability to work with minimal information Please get in touch if you're confident in your abilities ...

We are looking for several motivated freelancers interested in creating simple and user-friendly websites on Odoo (1-4p). Proficiency in Python and experience with Odoo are required. We have a large number of Odoo projects to be completed per week, and if you are serious, we will offer you multiple projects per week. Please contact us. Thank you.

YOUR BID PRICE IS FINAL. NO LATER CHANGE IS ALLOWED. I need an expert in CWP panel and in VPS who can install Python, NodeJS websites in my server as docker container. You don't need to do any coding. My VPS server is with Hetzner and it is more than one year old. Please see the screenshot. My VPS has 4GB RAM, 80 GB Harddisk, and CentOS 7 with Root access. it is long term project. I need to install 2 Python apps as of now. My budget is INR 600 per successful installation. I will prefer AnyDesk or TeamViewer. Might need to work with my developer during installation and after installation need to clean up junk files, depreacted, not used files to save space of my harddisk. Lowest Bidder will win.

Looking for scraping expert to write scraper script to download from a website that has captcha. The scraper script must be Windows executable .exe file that is very easy for non-technical user to just open and run.

I'm currently looking for a skilled and experienced developer for backend CMS development. Key responsibilities: - Develop a Content Management System using PHP, Laravel, MySQL, and Python. - Design, implement and maintain python-based backend application. Essential Skills: - Proficient in PHP, Laravel, MySQL, Python. - Extensive experience in backend development. - Knowledge in CMS development and implementation. - Strong understanding of data structures and algorithms. Your analysis skills will also be put to good use to solve complex problems in this role. As an experienced backend CMS developer, you can expect to work closely with me to deliver a robust, performant, and scalable system.

I need a developer versed in Flask Celery to help integrate background task processing into my ongoing project. Key requirements for this job include: - Significant experience with Flask Celery, Apache2, Python and understanding of its nuances - Ability to introduce background task processing in an existing project - Capability to be flexible regarding the nature of tasks being processed Regarding timeline, I am hoping for a swift turnaround due to the urgent nature of this project. Your understanding is appreciated.

I specifically require an AWS expert to handle a data migration task for me. The data in question originates from another cloud provider and needs to be securely transferred into my AWS S3 storage.

...access and consume a wine knowledge library, proficiency in working with APIs to fetch and utilize external data sources is required. Strong Communication Skills: Effective communication skills are essential for understanding client requirements, providing progress updates, and collaborating with the client's team. Skillset: Programming Languages: Proficiency in programming languages such as Python, JavaScript, and possibly others depending on the technology stack chosen for implementation. Natural Language Processing (NLP): Experience with NLP libraries and frameworks like NLTK, spaCy, or Transformers for processing user queries and generating conversational responses. Machine Learning Frameworks: Knowledge of popular machine learning frameworks like TensorFlow or PyTo...

...residential properties only - Data to be collected from a well-known property portal - Compilation and delivery of data in a spreadsheet - Inclusion of property description, price, number of bedrooms, bathrooms, images, videos (if any), floorplans (if any), and location - Images to be put into separate folders named after the property they are from Ideal Skills and Experience: - Experience with web scraping and data extraction - Attention to detail to ensure accurate information retrieval - Proficiency in data organization and management - Understanding of the property market and relevant terminology - Strong communication skills to clarify any uncertainties and ensure the project's success Please note that the accuracy and completeness of the extracted data are of...

I require a professional Python script to scrape a website for data. Key Requirements: - The script should be designed for a one-time run - The website does not have JavaScript dynamic content, so the script does not need to handle dynamic content The ideal freelancer for this project should have prior experience in: - Python programming - Web scraping - Handling static web content

I'm in need of a professional who can build a tool that can extract data from LinkedIn. ...information (email address, phone number, etc.) - Profile information (name, job title, etc.) - Connection network (connections, mutual connections, etc.) I'd like the extracted data to be conveniently structured in a CSV (Excel spreadsheet) format. The primary use of the extracted LinkedIn data will be for lead generation. The ideal candidate for this project should have: - Expertise in web scraping and data mining, particularly with LinkedIn - Proficiency in data handling and structural organization - Proven experience with developing tools for lead generation - Strong communication skills and a good understanding of client needs. Please include examples of previous si...

I'm looking for a web scraping expert to carry out daily data extraction. The websites to be scraped will contain text content, along with images and video. I may need the scraping program to be written such that it can be conducted on a daily basis. to update new articles We are going to be scraping around 50 websites for the first project Key Requirements: - Profound experience in web scraping and automation tools. - Strong problem-solving skills to deal with any potential web structure changes. - Creating and maintaining a database of the scraped data would be a plus. Please provide your quote, along with the tools you intend to use for this process and your relevant experience. Looking forward to your bids. Ideally we want this...

...platform or framework of the user registration screen is unspecified. So, having significant experience in multiple frameworks like PHP, JavaScript/Node.js, Python/Django will be beneficial. - The registration screen currently has some security measures in place. Knowledge of secure coding practices is a must for this job. - The chosen developer will bestow full permissions to the admin. Therefore, the freelancer should understand well about user permissions and roles in a web application environment. The perfect freelancer for this job should demonstrate strong attention to detail, proficiency in multiple coding languages, and understanding of web security concepts. Providing examples of similar work where you've adjusted user permissions or made admin-only...

... and Kubernetes. Key Requirements: - Proficient in Docker, Jenkins, and Kubernetes Additionally, I'm interested in a trainer who has hands-on experience with DevOps practices in a cloud environment. Specifically, experience with Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP) would be a major plus. The training sessions should be regular and comprehensive. I'm expecting around 6-10 hours of training sessions per week. Ideal Skills and Experience: - Proficient in Docker, Jenkins, and Kubernetes - Hands-on experience with AWS, Azure, and GCP - Previous experience in DevOps training - Excellent communication and teaching skills If you're a skilled DevOps expert with a passion for teaching, I'd love to discuss how you...

I urgently require a proficient programmer who can create a program for me. This program should be capable of copying numbers from an updated in real-time website and then paste those numbers into a text file format. Key tasks...copying numbers from an updated in real-time website and then paste those numbers into a text file format. Key tasks include: - Scrape numbers from a certain site that updates in real time. - Paste and save these numbers strictly in a text file. - Ensure the application is user-friendly and effective. Since I didn't specify the operating system, all OS platforms are welcome. Familiarity with web scraping tools and an understanding of different file formats will ensure task success. Time efficiency is crucial; hence, I need this project complete...

I am looking for a freelancer who can extract specific data from a Swedish business directory using Python. Main URL: Key Objectives: - Extract company names, contact information (phone/email), and business numbers from the directory. Ideal Candidate: - Proficient in web scraping techniques - Strong command of Python - Previous experience with similar projects will be considered a plus. Please reach out if you have the necessary expertise.

I'm urgently in need of a skilled web scraper who can collect links from a company's website. Here is what you need to know: - The focus of this project is on the headlines of a website. You'll need to scrape these headlines as links. - The website has several sections, but you just need to scrape the headlines from the homepage. I need this done as soon as possible. If you have previous experience with web scraping and can start on this task immediately, I'd love to hear from you. Please share your experience in scraping data from websites and your availability to take on this task.

I'm looking for a skilled Python backend developer to enhance an existing backend system for my project. Key Responsibilities: - Enhancing the existing backend system: Your primary responsibility is to enhance the functionality of the current system and optimize its performance. - Integrating SQL/NoSQL Databases: Your expertise in SQL/NoSQL databases is crucial to ensure smooth integration and efficient data handling. - Experience with Python and Minio: If you're familiar with Minio that's a big plus, but Python is the key language you'll be working with on this project. Ideal Candidate: - Proven experience in enhancing existing backend systems. - Proficient in working with SQL/NoSQL Databases and designing queries. - Strong Python skills ...

I have a Python script that needs integration with a Telegram bot. The requirement is to connect the code with the Telegram bot to send questions from the Chegg website. Key tasks: - Integrating the existing Python code with a Telegram bot to send questions from the Chegg website - Automating the assignment of student IDs for each Chegg website task The ideal freelancer should have: - Proven experience in Python programming - Previous work with Telegram bot integration - Familiarity with Chegg website tasks and automation - Good understanding of API integrations Please share your relevant experience and any insights into how you plan to approach this integration.

I'm looking for a coder savvy in Python to help me scrape contact information from a specific business directory. The task involves enumerating a set of links on the site and scraping the following data: - Email addresses - Phone numbers - Physical addresses - Names Ideal Skills: - Proficiency in Python - Experience with web scraping - Familiarity with business directories The main goal is to have a comprehensive list of contact information, which I will use for a marketing campaign. The scraper should be able to handle a large volume of links and data. Your expertise in Python programming and web scraping is crucial for the success of this project. Your attention to detail and ability to deliver accurate and complete contact i...

As someone in need of a specific tool, I'm seeking a proficient Python programmer to create a desktop tool for auto cropping bulk TIFF scanned images. The key features I'm requiring are: - Auto Cropping: The tool should be capable of automatically cropping large amounts of TIFF images, simplifying the process and saving time. - Image Quality Adjustment: After auto cropping the images, I should be able to adjust their quality within the same tool. - Maintain TIFF Format: The cropped and quality-adjusted images should remain in TIFF format. A freelancer with great proficiency in Python and past experience in image processing software or similar would be ideal for this project. Understanding of image formats, specifically TIFF, and quality adjustment is essential.

I'm in search of a skilled machine learning developer with expertise in GPT (Generative Pre-trained Transformer). My goal is to have an AI model that can both correct and standardize postal addresses. The addresses will be provided in CSV files and the output of the model should be accessible via an API for integration into our system. Key requirements: - Proficiency in machine learning with a focus on GPT - Experience in addressing data correction and standardization - Transformers - Pytorch, TensorFlow, Keras, Pandas, Numpy, seaborn, Matplotlib The ideal candidate will have a proven track record of developing AI models, particularly in the realm of addressing data, and be able to provide a detailed timeline for the completion of the project.

...* Integrate with Google Sheets for seamless data import and export. * Website Meta Tag Optimization: * Develop a custom script on Vertex AI to: * Scrape content from web pages (titles, headings, body text). If scraping is not feasible, allow for manual input of content. * Utilize Gemini to generate SEO-optimized meta titles and descriptions based on the scraped/input content. * Ensure the script can handle both automated scraping and manual content input scenarios. Requirements: * Proficiency: Strong experience with Google Cloud Platform, Vertex AI, Python (or similar language), and web scraping techniques. * Google Sheets Integration: Experience with Google Sheets API for seamless data flow. Deliverables: * Two Function...

I'm in need of an expert in AWS EKS who can assist in implementing an effective ingress solution with a focus on path-based routing capabilities. Key responsibilities and requirements: - **Ingress Implementation**: Your core task will be to set up a reliable and efficient ingress configuration for our AWS EKS cluster. - **Path-Based Routing**: We are specifically looking to utilize the path-based routing capabilities to direct traffic within our applications. - **Knowledge of EKS**: Strong background and experience with Amazon EKS is essential for this role. - **Understanding of Load Balancing**: While our primary goal is path-based routing, a good knowledge of load balancing is helpful. - **Communication**: Clear communication on the implemented solution is key to en...

Looking for a Python & Active Directory Expert to create a script and test data to capture all meta data linked to and which describes the confined parameters of an AD account, group policy etc. and export to a MS Excel File. More information attached.

We are developing an innovative software application designed to transform the car rental market. Our app specializes in web scraping to gather and compare rental prices from leading car rental websites like DiscoverCars, AutoEurope, DoYouSpain, and others. The name of the app is PriceBook Key Features: Real-time Data Collection: Our software continuously scrapes data from various car rental websites, ensuring that users have access to the most up-to-date pricing information. Price Comparison: The app automatically compares rental prices from multiple providers, highlighting the best deals and most favorable rental conditions. Customization: Users can tailor their search based on specific criteria such as location, rental period, and vehicle type, providing a personalized ...

I am looking for a freelancer who can help me with Web Scraping. We have a list of websites that we would like to scrape specific data from, and have them put into a set of MySQL Databases (or maybe something else). The website that we would like to scrape data from each contain thousands of articles, and we would also want other metadata, such as Author name, article date, number of views, or any other metadata that we can take from the pages. Please bid, and we can discuss the first website, you can tell us how long you think it'll take to write the scraper. There are maybe 50 websites to begin with that we would like to do this for, in this one project, and we also have another couple of similar projects. Ideally, the scraper will run form a program, so that we can...

I'm looking for an expert (8+ years) Python Django full-stack developer to become the business CO-FOUNDER. This individual must possess proficiency in back-end development and DevOps experience, database management, and server administration and must be a self-starter capable of overseeing the all website aspects. This is a position for a leader who has dreams, passion and ambition to be on the ground-floor of a business they believe in and a with the desire to want play a major role in our success. Our site and apps are in the final stages of completion and I have a team of developers currently in motion for the website and iOS/Android apps to fix bugs and optimize our operation. This responsibility would be to manage PRs, oversee performance, take proactive steps to resolv...

I have a python web-scraping script for a web-site. Web site is updated because of that my script doesnt works. I need some one who can update my script that i can use it to scrape web-site. Thanks for bidding

We are seeking a Business Data Analyst for our team who is willing to work with new ...Responsibilities: - Collect and analyze data from various sources - Identify patterns, trends, and correlations in datasets - Create reports and dashboards to present findings - Collaborate with cross-functional teams to understand business requirements Required skills: - Strong analytical and problem-solving skills - Proficiency in data analysis tools such as Excel, SQL, or Python - Experience with data visualization tools such as Tableau or Power BI - Excellent communication and presentation skills This is a great opportunity for individuals who are new to the field of business data analysis and are looking to gain practical experience in a supportive en...

I need a python software that can find emails from LinkedIn Sales Navigator URLs. The emails need to be in Excel format. What I Need in Excel: - Name of the person - Email - Location - Designation Procedure: - I shall enter sales navigator ulr where multiple leads in pagination format displayes. - Software will pick each person url and find out his email (personal/professional) - Add that record along with above fields in excel sheet. Make sure software must not stuck, and i shall clear the payment after testing couple of days. Ideal Skills: - Proficiency in Python. - Experience in web scraping, particularly with LinkedIn URLs. - Familiarity with data manipulation in Excel files. This project is ideal for someone with a strong background in Python ...

I need a web scraping professional to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) Authentication is done through twitter, it has to be done manually to access the marketplace Deliverables: - Format: Script that I can run to

I'm seeking a skilled Python developer to create a dedicated tool for data analysis. As I haven't specified specific features, I'd like the freelancer to have a thorough understanding of various data analysis techniques and be able to suggest suitable functionality. Key Skills: - Proficient in Python - Experienced in developing data analysis tools - Knowledgeable in a range of data examination and interpretation methods Experience: - A track record of successful data analysis tool development - Insightful in approaching data analysis - Proven Python programing capabilities Responsibilities: - Understanding my data analysis needs - Suggesting appropriate features for the tool - Developing a user-friendly tool that produces accurate results. Impor...

...a start, we need someone to continue an existing data scraping project, coupled with Artificial Intelligence for one of Brazil's largest legal platforms, "JusBrasil." The primary task is to effectively scrape and identify case descriptions that deal with our specialty: immigration cases, specifically focusing on citizenship and international law cases. Project Scope and Expectations: - Enhance the existing data scraper to efficiently extract case descriptions from JusBrasil - Implement AI algorithms to accurately determine the relevancy of these cases to our requirements - Leverage keywords such as 'citizenship' and 'international law' to highlight the cases we focus on Skills and Experience Required: - Proficient in data scraping te...

Project Description: We are looking for an experienced web developer or team to build a comprehensive escort directory website similar to EuroGirlsEscort. com. The website should include all essential features such as agency profiles, individual profiles, advertisement placements, country-specific listings, advanced search filters, and a secure messaging system. Key Features and Requirements: User-friendly interface with responsive design User registration and profile creation (escorts and agencies) Ability to post and manage advertisements with different subscription plans Advanced search and filtering options by location, services, rates, etc. Country-specific listings and regional filters Secure messaging system between users (escorts, agencies, and clients) Payment gateway int...

Dear Freelancer I need Python Scrape links with windows 10. Cell data must stay consistent, this will be linked to other Excel workbooks. Il attach the examples with the layouts. Scrape Links Examples: I've colour coded the Excel workbooks, to show where the Data comes from. Let me know if any more information is required?

I need a professional to gather 750 contacts from three different Houzz pages. Requirements: - The information required for each contact is Name, Email, Phone number, and business name. - The contacts should be organized by location. - There is a need for the contacts to be from the following specific ...number, and business name. - The contacts should be organized by location. - There is a need for the contacts to be from the following specific Houzz pages: Kitchen Designers and Renovators, Bathroom Designers and Renovators, Design and Construction. Preferably, the contacts should be from a specific location which I will provide. The ideal freelancer for this task should have experience in web scraping and data collection. Accuracy and attention to details are also key ...

I'm in need of a skilled High-Frequency Trading (HFT) Developer with mid-level experience (3-5 years). Key requirements: - Proficiency in Python and C++ programming languages is essential. - Must have a deep understanding of HFT strategies, specifically Market Making and Momentum Trading. Prospective freelancers should have applicable experience and be ready to showcase relevant past projects. This role requires precise code writing and fast problem-solving skills. A strong understanding of financial markets is also preferable.

I need fresh email addresses from users in Germany! These should not come from web scraping or web crawlers, but from real users who have participated in contests, signed up for newsletters, or requested information on lead platforms, for example. The data must be current and deliverable. Only data from users in Germany is sought, in both the B2B and B2C sectors. B2C email addresses (freemailer addresses) are preferred. Acceptance will be based on a trial run in batches of 50,000 to 100,000 pieces (expandable), with a total volume needed of 10,000,000 pieces!

...high-speed web scraping project. Our existing web scraping scripts have been developed and deployed, but we need to optimize the scraping process to achieve faster data extraction rates. Responsibilities: Optimize existing web scraping scripts for speed and efficiency. Deploy and manage web scraping scripts on platforms such as Scrapy Cloud, Apify, AWS Lambda, or Azure. Implement techniques to ensure high-speed data extraction (e.g., parallel processing, distributed crawling, efficient request handling). Monitor and troubleshoot scraping processes to ensure uninterrupted operation. Collaborate with our team to understand project requirements and adjust scraping strategies as needed. Requirements...

I'm in need of an experienced data scraper that can help me in extracting data from Yel... Thailand, Japan, and Indonesia. Key Details: - I require a full listing of all businesses from various sectors within the mentioned countries. This includes but not limited to Restaurants, Hotels, Clinics, and Retail Stores. - The extracted data should be well-organized, including data such as business names, contact information, and addresses. Skills/Experience: - Proven track record in web scraping with a focus on Yellowpages. - Familiarity with the Yellowpages platforms of Malaysia, Thailand, Japan, and Indonesia. - Capability to handle large data sets and deliver the information in an easily usable format. - A high level of accuracy in data extraction to ensure no important d...

We have a list of products. We need to check everyday, if those products have strikethrough price appear on them. All the products that need to be checked are from the same website. The following are the steps:- a) Excel file containing Product url list of about 300 products, all from the same website b) We should be able to run a ma...appear, then it should highlight that G) If the MSRP is appearing for variation, then it should fetch and enter that number. It is very easy and simple work. Bid only if you can do within next 24 hours. See the attached excel file for the sample of what I need For end solution, i should be able to carry it within excel file. The people performing this task, will not be able to execute separate python commands as they will have very limited tech ...

...and automatically integrate this data with the user's own sales system. - **Main Features:** - Ability to securely log in to each supplier's B2B system. - Ability to instantly capture and process data. - Conversion and integration of the captured data into a format suitable for the user's system. 1. **Backend Development:** Required for system integration and data processing. 2. **Data Scraping/Web Scraping:** It is important to extract data from suppliers' B2B programs. 3. **API Development/Integration:** To securely integrate with suppliers' systems and retrieve data. 4. **Database Management:** It is a critical skill to organize, store and always keep the captured data updated. 5. **Security and Encryption:** It is important to ensure the...

Data Entry Project - I am looking for a freelancer who can assist me with typing work. - The project involves entering data into a spreadsheet or a database. - The ideal candidate should have excellent typing skills and attention to detail. - There is no specific software preference for data cleaning, so the freelancer can use Excel, Python, or any other tool they are comfortable with. - The dataset contains 100-500 records or entries. - The project requires accuracy and efficiency in data entry. - Experience in data analysis would be a plus, but not mandatory. - The freelancer should be able to complete the task within the specified timeframe. - Good communication skills and the ability to follow instructions are important. - This is a one-time project with the potential for futur...

I'm urgently looking for a skilled Python developer to assist me with a project involving data analysis, web scraping, and potentially machine learning. Your role will be crucial in helping me to derive insights from a large dataset and extract specific information from the web. Key Responsibilities: - Conducting in-depth data analysis using Python - Implementing web scraping scripts to collect relevant data - Potentially developing machine learning models (based on your expertise) While the client did not specify the exact libraries, the ideal candidate should be well-versed in Python programming, particularly with libraries such as Pandas and NumPy. Familiarity with Django, although not mentioned, could be a plus if the proj...

I am seeking a beginner level Python developer with a knack for web development, data analysis, and scripting. The ideal candidate should have a good understanding and practical knowledge in: - Web development: Tasked with the development of usable, meaningful applications that will enhance user interactions and overall user experience. - Data analysis: The successful candidate is expected to leverage Python's capabilities in order to provide solutions to complex data problems. - Scripting: Equally, candidates should be adroit in writing, testing, and debugging codes—including modification of existing scripts. In terms of essential Python frameworks, knowledge and expertise encompassing Django and Flask is non-negotiable, as these will form the crux...

I'm in need of a talented UI designer who can create a highly ...should be well-versed in creating user interfaces specifically for PHP Laravel projects. - Experience with Interactivity: The interface you design should be highly interactive, offering real-time features and engaging functionalities. - Understanding of Business Needs: The target audience for this interface is business professionals, so your design should cater to their preferences. - AWS Knowledge: Familiarity with AWS would be a plus, as the project is hosted there. A successful freelancer for this role should have a keen eye for design, a solid understanding of PHP Laravel, and a knack for creating highly interactive elements. Your portfolio should demonstrate your past UI design work and success storie...

I am in need of a professional web scraper with Python expertise, who can scrape data from a website(with filter Options) and convert it into Excel format. Key Requirements: - Expertise in web scraping with Python, including dealing with website search filters. - Proficiency in data extraction and manipulation. - Experience in converting extracted data into Excel format. Please note that the specific website and the type of data to be extracted has not been provided as it was skipped by me. The project can be detailed further with the selected freelancer. If you have the skills and experience in this area, please do apply.

I'm in need of a Python expert to assist primarily with automation tasks. The specific task at hand involves generating HTML reports using Python. These reports should primarily include test steps. Your role will involve scripting Python-driven test steps and converting them into a comprehensive HTML report. Ideal Skills: - Strong experience with Python programming and automation. - Proficiency in generating HTML reports using Python. - Familiarity with Quality Assurance and translating test steps. Join me in streamlining my reporting process with your Python expertise!