Scraping web excel jobs

I want to improve the search function of a webshop. I want to do this by adding extra data to the products (in the form of tags). I have a list of 11,000 product names in Dutch. These product names consist of a piece of proper name, noun and then sometimes some content in...multiples and synonyms. This script assumes you have a list of product names and want to find the plurals and synonyms for each of them. It prints the original product name, the plural (if found) and the synonym (if found). I am looking for someone to help me create this list. I have the same list in English and French which the same thing needs to be done. Ideal Skills and Experience: - Advanced Excel skills. - Familiarity with implementing plural forms and synonyms. - Ability to ensure data integrity and co...

...proficient freelancer with a strong background in data scraping from LinkedIn, various social media platforms, and websites. The objective of this project involves harvesting old leads interested in job-oriented training courses in areas such as programming, digital marketing, business, and finance. The skillset and experience required include: - Excellent knowledge of data scraping techniques - Familiarity with LinkedIn, and other social media platforms for data extraction - A good understanding of programming courses, digital marketing, business, and finance topics The targeted audience for these training courses are students, working professionals, and entrepreneurs. I am expecting high-quality leads, so experience in targeted scraping is a must. To be successf...

I am in need of an Excel expert who can assist me with data analysis. The level of complexity I am aiming for is basic sorting and filtering. Crucially, I would like the data analysis to be interactive for users. Key Requirements: - Data analysis in Excel - Proficiency in creating drop-down menus for sorting/filtering - Experience with basic Excel functions and formulas Ideal Skills: - Strong understanding of Excel and its data analysis functions - Ability to create intuitive and user-friendly interfaces with drop-down menus - Excellent communication skills to help with user instructions This project requires someone who can provide a clean, well-structured, and user-friendly Excel file.

I am in need of a proficient freelancer who can scrape image data effectively. This project involves: - Scraping image content efficiently from various types of websites. - No particular specification was given about the type of websites to scrape from, so flexibility in handling different sites is essential. - The timeline for project completion was not specified, suggesting flexibility in delivery time, although efficiency and promptness are always appreciated. Ideal Skills: - Proficiency in data scraping - Ability to handle varying website formats - Strong work ethic and punctuality in project completion - Attention to detail when scraping images.

Seeking sales enthusiasts ready to make money from the comfort of their homes selling physical products on a full e-commerce platform. Whether you are new to the field or have seasoned experience, join our team to help us broaden our company's online sales. While no experience is required, those with a background or interest in sales could excel in this role, as you will be responsible for maintaining a broad product knowledge of our inventory. Requirements and responsibilities: - Sell a variety of physical products online - Display strong communication skills - Maintain product knowledge - Be reliable and committed Being tech-savvy, having prior experience with eCommerce platforms, or proven sales experience are all a plus but not mandatory. Novices are also welcome to ap...

I'm looking for a skilled trainer to deliver a comprehensive Excel training targeted towards beginners. The training will cater to a larger group of participants, around 15-20 individuals. Key Learning Objectives: - Understanding of Excel formulas and functions - Mastery of data analysis and manipulation The ideal candidate for this project would have a strong command of the above topics, with a proven track record in delivering effective training to large groups. Experience in breaking down complex concepts for beginners is essential. Practical demonstrations and hands-on activities should be incorporated to ensure the understanding and application of the learnt skills. Please, when making a bid, provide a brief outline of how you plan to structure the course. Look...

I need a skilled python developer to create a JSON to Excel converter. Key Requirements: - You'll be working with Flat JSON data - How to handle missing data is up to you - Mapping of JSON fields to Excel columns is flexible Ideal Skills: - Proficient in Python - Experience with JSON parsing - Excel manipulation skills I'm open to suggestions on the best way to map the data, so please include your ideas in your bid. Let me know if you have any questions.

Hi, The task is to scrape a pdf that is downloaded on website. Steps: 1. Go to website 2. Enter code in search and click search. (We provide list code) 3. On the results page Click on pdf document and open or download it 4. Extract 14 pieces of data from the PDF and export into excel sheet. There are about 150.000. Some codes do not have any data then skip. I have attached a word document with pictures and flow for you to review. Thanks!

I'm looking for a skilled developer to build me a web scraper for the Kumon UK website. The scraping needs to be able to: - Extract the names of tutors - Retrieve their addresses - Fetch contact information like phone numbers or email addresses The scraping process should be set to run just once, and must be accurate and reliable. The data should be presented in a structured format, ideally a XLSX file. Please provide an overview of your experience with web scraping and any similar projects you've worked on.

Hey everyone, i search someone who can do a task for my existing Wordpress Website. Actually i scrap every morning the data from soccer results from a website with WINHTTRACK and upload this to my website. Now i need automation. - Data Scraping from other website to my website - Data Refresh every Day 7 o'clock - 1:1 Copy with Design and my login - Only 3 Site ! I provide wordpress test access. On This access u can build a scraping automation. I can migrate myself. THANKS :)

I am looking for an expert who can create MIS rep...expert who can create MIS reports encompassing sales, financial, and inventory data. The frequency of these reports will be based on my requirements which can vary. Those equipped with excellent skills in data analysis, report generation, and detail orientation will be ideal for this role. Knowledge in handling Excel is a must as the reports need to be delivered in this format. Here's what is expected: - Data compilation and report generation as per my request - Proficiency in Excel for creating and delivering reports - Adherence to strict timelines for report submission - Maintain confidentiality of all the data involved If you have prior experience in creating MIS reports of these types, I would be very interested...

For this project, I require a meticulous freelancer with skills in data entry, and specifically in converting images with somewhat legible handwriting into Excel data. Key Responsibilities: - Accurate conversion of handwritten text from images into digital format in Excel. - Ensuring the integrity of the data by carrying out data validation and verification. Required Skills: - Proven experience in data entry, particularly involving handwritten text. - An eye for detail for data accuracy. - Proficiency with Excel is mandatory. - Ability to decipher and transcribe somewhat legible handwritten text. This project suits someone with patience and diligence due to the level of legibility of the handwritten text.

I'm looking for a tool or app to scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Bu...Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong understanding of car ...

I'm seeking guidance and support to excel in the AI certification, emphasizing on concepts and theories. - The primary focus of this project is on improving my understanding of AI principles, concepts, and theories. - As I'm aiming to complete the certification, I need a mentor who can explain complex AI concepts in a clear, concise, and readily understandable manner. - Given the current circumstances, I'm specifically looking for online resources to guide me through this journey. Ideal candidate for this project should have: - Proven experience in Machine Learning, ideally with certifications themselves. - Excellent teaching and mentoring skills, particularly in breaking down complex topics. - Good understanding of online learning platforms and resources, with the...

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intelligent data mining and competitive market analyses.

I'm looking for a skilled freelancer to create a custom quoting template in Microsoft Excel for my business. The template should be intuitive, easy to use, and visually appealing. Key Features: - The template must be fully customizable in design, enabling me to adapt it according to my branding and specific needs. - I'd like the template to incorporate conditional formatting for data visualization. This feature will help better present the data, making it easier to understand and interpret. Ideal Skills and Experience: - Proficiency in Microsoft Excel, particularly in creating templates. - Experience in designing visually appealing and user-friendly templates. - A strong understanding of how to implement conditional formatting for effective data visualization. I...

...and agreements. • Experience with software audit tools and technologies. • Excellent analytical and problem-solving skills. • Detail-oriented with a strong ability to interpret data and documentation. • Effective communication skills, both written and verbal. • Ability to work independently and collaborate with cross-functional teams. • Proficiency in using spreadsheet software (e.g., Microsoft Excel) for data analysis. Preferred Qualifications: • Certified Software Asset Manager (CSAM) or similar certification. • Familiarity with IT asset management (ITAM) principles and practices. • Experience with conducting audits in enterprise environments. • Knowledge of software compliance frameworks and standards (e.g., ISO/IEC 19770). ...

I am in need of a skilled professional who can assist me in setting up the Odoo Books system for my invoicing processes. Requ...Requirements: - Configure the system to enable the creation of goods and service invoices in USD. - Implement moderate customization to the invoice templates, focusing on layout changes and adding custom fields. - Import all of my product information from an Excel sheet. This includes product names and their respective cost prices (which are in INR). Ideal Candidate: - Proficient in working with Odoo Books and setting up invoicing processes. - Experience with customizing invoice templates within Odoo. - Skilled in data import from Excel sheets to Odoo. I look forward to working with a professional who can deliver these requirements effectively...

I am in need of a proficient excel wizard who can simplify my day to day tasks. While the specifics aren't in place, ideally I'm looking for someone who can efficiently perform data entry, come up with efficient formulas and functions, and provide comprehensive data analysis. Proper data formatting is key, for which I don't have a specific preference, however, creating simple tables, color coding cells, or using pivot tables and charts are all strong possibilities for this recurring project. Since no specific criteria was given, please do include your past work, experience, and a detailed project proposal when you apply. Skills and experience preferred: - Familiarity with advanced Excel functions and formulas. - Experience with data analysis and visualizatio...

Scrape license data from the FL DBPR website and deliver into an excel spreadsheet. Two counties: Osceola and Polk. Two license types: Vacation Rental - Dwelling and Vacation Rental - Condo. In the attached spreadsheet the required fields to identify the license type and county are shown in screenshots and the second tab as an example. The extracted data is then to put into tabs for each county and license type. Multiple rental locations for a primary name should have multiple entries (rows) with the license details repeated and only the rental location being different each row. There maybe some dynamic features in the website that complicates data extraction. Website:

I need an expert data analyst to clean and integrate data from excel files into a Power BI dashboard. Key Project Details: - The primary data source is excel files. It's crucial that the freelancer is proficient in Excel for extracting, cleaning, and transforming the data. - Dataset is farmers data including demographics and crop details. - The main focus of this project is on data visualization. I need the dashboard to present the data in a clear, visually engaging way. - The dashboard will be updated quarterly. Ideally, the freelancer should set up a process for this to be done efficiently and accurately. The task involves: - Understanding the data and the requirements for visualization - Cleaning the data to make it suitable for the dashboard - Identifying a...

I'm looking for an Excel expert to create a costing sheet for a product. Key details for the job include: - It's mainly a costing sheet that will help me calculate the final price of my product based on material costs. Ideal Skills and Experience: - Proficiency in Excel - Solid understanding of financial calculations - Previous experience in creating costing sheets for products Looking forward to receiving your bids.

I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus o...scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical ...

...in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to extract the body of the news articles with no need for the title, date or author. Let me know your approach and estimated timeframe for completion and budget. I give you (English only) - Google News search keywords, (possibly 50...

I require a detailed, easy-to-use Excel invoice template. The main features needed include: - Line items for products or services delivered: It's crucial that you add functionality for categorizing and detailing all the products or services delivered within the invoice. - Contact Information of both parties: The invoice must have dedicated sections to clearly present contact information of both the issuing and receiving party. - 1 page invoice in A4 size (fixed) with calculations based on user input amount. It's beneficial if you have profound knowledge of Excel and understand accounting principles to design the template in a highly organized and straightforward manner for ease of accounting tasks. Prior experience with invoice template design will be a great ad...

I'm looking to engage a freelancer skilled in data entry and Microsoft Excel to help type significant amounts of text data into an Excel sheet. Your responsibility will include: - Typing text data into an Excel sheet in an accurate and efficient manner. - Maintaining a consistent style and format throughout the entirety of the data entry. - Reviewing and proofreading your work to ensure absolute accuracy. You should display proficiency in Excel, attention to detail, and commitment to maintaining a consistent, professional style across all data. Please submit your bids along with an estimate of timeframe. Though the project completion timeframe was not specified, a timely delivery will still be appreciated.

...need of a skilled Python expert to transform a raw excel report into a final template version of excel. The project requires two main tasks: Formatting and re-arranging of columns along with calculation updates for one column. Key Points; - Need 3 open reports to pull the information and split the reports at the end. - Formatting Changes: The report needs specific columns to have pre-defined blank values for certain columns: Col B, E, J, R, W, AB, AE, AJ, AV, BG, BI, BJ, BQ, BU, BV, BW, BX, BY, BZ. - Calculation Updates: The calculation layer within the excel report needs to be updated and finalized. The ideal freelancer for this project should have a profound understanding of Python and extensive experience in manipulating and formatting excel reports. I ...

Everyday I have to extract some datas from around 100 invoices (PDF files) and copy it to an Excel file. I do it manually (copy/paste), but I need a tool to have it done automatically. These invoices have a consistent format structure, and the fields I need to copy to Excel are always the same. They are informations like: invoice number, date, customer's name, product code, price, etc. All the fields that need to be on Excel are highlighted in color red on the 2 files I'm providing as an example. Any other info not highlighted in red, doesn't need to be on Excel file. The automation process must execute without fail, ensuring that the location of highlighted fields - which are always the same in every file - does not affect the extraction. The o...

I'm looking for a professional Excel user with a strong grasp of nutrition concepts to develop an advanced tool for me. Here's what I need: - A comprehensive Calorie Calculator - Macronutrient Calculator to recommend the optimal amounts based on three different goals: Weight loss, Muscle gain, and Maintenance - BMI Calculator - Be able to calculate these based off body weight, height, activity level, age and gender inputs The ideal candidate should not only be proficient in Excel, but also have a good understanding of nutrition principles. The faster this can be completed, the better.

I need an Excel 365 PowerQuery script that can fetch daily market data and handle potential data source interruptions or changes. I will be providing a URL that contains the market data, and you'll need to replicate the Google Sheets function =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). This function provides real-time data from the specified URL. Please note that the data is structured using HTML tags. Key requirements: - The PowerQuery should be able to be refreshed with the google sheet. - It needs to include robust error handling. If the data source is unavailable or the structure changes, the PowerQuery should not break but continue to function, ideally providing a notification that an error occurred

I'm in need of a Node.js developer with a solid background in web scraping. If you've got experience in this area, I'd like to hear from you to discuss the specifics of the job. Key Requirements: - Proficient in Node.js - Experienced in web scraping - Ability to understand and implement scraping requirements - Good communicator Looking forward to hearing from you.

I'm searching for a talented full-stack developer to establish an e-commerce site akin to Shopify but entirely focused on the upload and download of digital files. Key Functionalities: - Implement user registration and login feature. - Develop robust file upload and download functionality for various types of files: documents such as PDF, Word, and Excel; images including JPEG, PNG, GIF formats; and media files such as audio and video. - Integrate a highly secure and user-friendly payment gateway for transactions. Ideal Skills for this Project: - Proficient in full-stack development. - Experience in building e-commerce platforms, particularly with user account management and file sharing features. - Strong understanding of payment gateway integration. - Ability t...

hi I'd need you again for a scraping job, please reply soon thanks

As your client, I'm looking for an Excel VBA expert who can make my daily processes more efficient by creating an automated reporting solution for me. Key Tasks: - Design and implementation of a VBA macro in Excel to automate the generation of cost summary reports. - The automated reports should be populated by data from four different worksheets, namely Worksheet 1, Worksheet 2, Worksheet 3, and Worksheet 4. Ideal Skills and Experience: - Excel VBA Programming - Experience with automated reporting - Understanding of data manipulation in Excel. -Possible migration of Cost Summary data to Word contract. In your proposal, please share samples of previous automated reporting projects done with Excel VBA. Commitment to delivering high quality and d...

I am looking for a freelancer with expertise in PowerBi and Excel. The task will revolve around creating a one-time report/dashboard on PowerBi sourced from a single Excel spreadsheet. The ideal candidate should have: - Previous experience with PowerBi and Excel - Proven track record of data analysis - Attention to detail Please note that the Excel file won't be changing over time, so there is no requirement for the PowerBi report/dashboard to be updated. Content Description: I have statistics from every UFC fight and want basic visualizations made (I have a rubric)

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.

I'm seeking an Excel expert to create a user-friendly data entry workbook. The job is straightforward and requires the following: - **Data Entry:** The workbook should mostly focus on simple data, like names and dates. I am not looking for any intricate calculations, formulas, or pivot tables. The main focus is on creating an Excel workbook that streamlines the process of entering simple data in a structured and efficient way. Experience in creating user-friendly UX within Excel is a plus. No integration with external systems or services is needed - this is a standalone project. I look forward to collaborating with an experienced professional who can deliver an effective, easy-to-use data entry solution within Excel.

I am in need of expert help to scrape text data from specified websites. After the data has been collected, the next step is to clean the data, ensuring that it is in t...collected, the next step is to clean the data, ensuring that it is in the appropriate format for use. The final output should be managed and stored in a Database Management System. The ideal freelancer for this project should have: - Proven experience in web scraping, specifically text data from websites - Advanced skills in data cleaning to ensure the data is usable and well-structured - Capabilities to manage and store the cleaned data into a Database Management System Please provide any relevant examples of previous work in web scraping and data cleaning and provide details about how you ...

I require AutoCAD shop drawings for the intention of construction planning for a commercial building. The freelancer should include comprehensive architectural details. A strong background in creating accurate AutoCAD drawings detailing architectural specifics for commercial projects ...accurate AutoCAD drawings detailing architectural specifics for commercial projects is a must. The desired candidate will need a strong understanding of construction processes, especially within the commercial realm, to ensure every detail contributes to a seamless build. Your craftsmanship will directly influence our build strategy, so we expect precise and detailed work. Please only apply if you excel in AutoCAD and have direct experience in the realm of architecture and construction of commercial ...

I need a web scraping expert to help me get data from a third-party search site. The project is urgent and needs to be completed ASAP. Key Requirements: - Skilled in web scraping techniques - Proficient with tools for scraping - Able to work under tight deadlines - Excellent communication skills Please note that the specific search site is not mentioned, but the task involves scraping information from it. If you have the experience and can work quickly, please reach out.

I'm looking for a seasoned Excel expert to create a set of macros that can automate my data extraction process. Here's what I need: - Automate data extraction: The primary purpose of these macros is to enable automated data extraction from local files. The data in question is stock market data. The ideal candidate for this project would have: - Proficiency in Excel: You should have a strong grasp of Excel, particularly in designing and implementing macros. - Experience in data extraction: You should have a track record of successfully automating data extraction processes. Looking forward to hearing from you.

I am looking for an expert in Excel to design a dynamic spreadsheet for project tracking. This spreadsheet will focus on monitoring task progress and deadlines. Key Features: - Daily updates: I will be updating task progress and deadlines daily, and so I need the spreadsheet to be user-friendly and efficient. - Task highlighting: If a task is falling behind schedule, I need it to automatically become highlighted in red. This will help me prioritize tasks and ensure no deadlines are missed. - This will need to show throughput for every phase and also provide an average through in volume. Skills and Experience: - Proficient in Excel - Experience in creating dynamic spreadsheets - Understanding of project management principles. I look forward to working with a detail-orien...

For this task, I am specifically seeking a freelancer who is proficient at data entry and familiar with Excel spreadsheets. The project primarily involves numeric data, so accuracy is vital. Key Responsibilities: - Input numeric data into an Excel spreadsheet. - Maintain a minimum 98% accuracy level. Ideal Skills and Experience: - Proficient in Excel. - High attention to detail. - Experienced in numeric data entry. - Proven track record of maintaining high levels of accuracy. Please ensure you have the necessary skills and experience before placing your bid. I look forward to your detailed proposals.

Need to extract data from website: , into an Excel file. Specifically name, discipline (medical practitioner, midwife, nurse, OT, physio, psychologist, podiatrist), location (incl suburb and postcode), initial registration date, registration expiry. There would be at least 100,000 rows of data. Only barrier, is this data is not able to be 'searched' efficiently. Individual names can be looked up. Or disciplines with a select number of names demonstrated...but I can't find a way to show ALL clinicians at once. Looking for a solution which can reliably pull all the names from the database.

I'm looking for an Excel expert who can build a simple yet effective sheet for basic arithmetic calculations. Key requirements: - Perform basic arithmetic operations: The main functionality of the sheet should be to perform basic arithmetic operations such as addition and subtraction. - Real-time collaboration: The sheet should support real-time collaboration, where multiple users can edit the Excel file simultaneously. Ideal skills and experience: - Strong background in Excel: The freelancer should have a deep understanding of Excel and the ability to create formulas for basic arithmetic. - Real-time collaboration proficiency: Experience in implementing real-time collaboration features in Excel will be highly beneficial. - Attention to detai...

I'm looking for a reliable and experienced data entry specialist who can assist me with entering data from images. The images will be directly uploaded to a website, and I need the data to be transcribed into various formats like Excel sheets, Word documents, and for copywriting purposes. Ideal Skills and Experience: - Prior experience with data entry from images - Proficiency in Excel and Word - Copywriting experience is a plus The primary goal of the project is to create a comprehensive database in various formats, so the ability to accurately transcribe and organize data is crucial. The chosen freelancer should have keen attention to detail and a high level of accuracy.

I need an expert to set up an automation system in Google Sheets for specific data from the NSE India website. Key Requirements: - Data Source: The data source will be ' Update Frequency: The automation should update the Google Sheets column once every day. - Data Display Format: The data in the Google Sheets should be displayed in percentage values. - Historical Data: No historical data tracking is required. The focus is solely on current updates from the source website. Ideal Skills: - Proficiency in Google Sheets and automation tools. - Experience with web scraping and data extraction. - Knowledge of data presentation and formatting in Google Sheets. - Ability to create a seamless automation system that updates the data accurately and timely.

...potential clients. - Convert conversations into promising leads. - Record conversational details into our database. REQUIRED SKILLS AND EXPERIENCE: - Exceptional persuasive communication skills. - Proven experience in lead generation. - Familiarity with the corporate events and conferences sector. - A resilient attitude to handle potential rejections and keep going. This role demands someone ready to excel in a fast-paced environment while showcasing dedication, autonomy and agility. Your ultimate aim will be to assist in the company's expansion through the successful generation of potential leads. This is an excellent opportunity for someone looking to apply and enhance their telecalling skills while significantly contributing to a growing company in the event managemen...

I need an Excel VBA expert to automate the generation and visualization of customer data reports. This task requires the building of a dashboard to simplify the report generation process. Key Tasks and Skills Required: - Strong understanding of Excel VBA for automation tasks. - Experience in building dashboards for report generation. - Skills in visualizing customer data within Excel. Outcome and Project Scope: - Develop an automated process for report generation. - Ensure the dashboard is user-friendly and visually appealing. - The final output should provide easily digestible customer data insights.

Specification: Facebook-Web-Scraping and Web-Crawling Write Swift Code that prompts the user to give username and password This information is used to login to facebook and scrape facebook for facebook friends and extract the following information: - Name - Birthday and month and if available year - Gender This information should be made available in a JSON or XML format. The code will be embedded in an app. It is important that this web-scraping activity can run in the background of the app invisible to the user.