Find Jobs
Hire Freelancers

Python Web Scraper for Dexscreener and MySQL Database Integration

$50-100 USD

Cancelled
Posted about 1 month ago

$50-100 USD

Paid on delivery
We need a web scraper bot developed in Python that can scrape the Dexscreener website for the top 20 trending tokens in a specific category (e.g., Solana). The bot should extract the top 20 trader addresses for each token and write this data into a MySQL database. The bot should perform the following steps: Navigate to [login to view URL] Select a specific category from the left sidebar (e.g., Solana). Sort the tokens in the selected category by trending. Open the pages of the top 20 tokens listed in the trending section. On each token's page, click on the "Top Traders" tab. Extract the top 20 trader addresses. Store Data in MySQL: Write the extracted data into a MySQL database with the following fields: id, network, token, trader_address. Requirements: Experience with web scraping using Python (e.g., BeautifulSoup, Scrapy, Selenium). Familiarity with MySQL database operations in Python (e.g., using pymysql or SQLAlchemy). Ability to handle potential anti-scraping mechanisms and ensure the scraper runs efficiently. Clean and well-documented code. Deliverables: A Python script that performs the above tasks. SQL file for creating the required MySQL table. Documentation on how to set up and run the script. Please provide examples of similar projects you have completed and your approach to handling this specific task.
Project ID: 38219391

About the project

27 proposals
Remote project
Active 1 mo ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello, there. I'm excited to bid on your project! I have extensive experience in Python web scraping using BeautifulSoup and Scrapy. Additionally, I'm proficient in MySQL database operations using pymysql. For this project, I'll develop a Python script that navigates through Dexscreener, extracts the top 20 trader addresses for each token, and efficiently stores the data into a MySQL database. To ensure smooth scraping, I'll implement strategies to handle anti-scraping mechanisms. My code will be clean, well-documented, and accompanied by comprehensive setup and run instructions. Could you clarify if there are any specific anti-scraping measures on Dexscreener that we need to address? Thanks for your job posting.
$75 USD in 7 days
0.0 (0 reviews)
0.0
0.0
27 freelancers are bidding on average $86 USD for this job
User Avatar
Hi sir i will use python selenium for this project .. i already done this before please message me ... Hi sir i will use python selenium for this project .. i already done this before please message me ...
$100 USD in 1 day
5.0 (138 reviews)
6.3
6.3
User Avatar
Hello there, With expertise in Python web scraping and MySQL, I can develop a bot to scrape Dexscreener for top trending tokens and trader addresses. I assure efficient handling of potential anti-scraping mechanisms and clean, well-documented code. Looking forward to contributing to your project. Best, Joseph
$100 USD in 1 day
5.0 (55 reviews)
6.0
6.0
User Avatar
As a freelance Python developer with extensive experience in web scraping using Python (including BeautifulSoup, Scrapy, and Selenium) and MySQL database operations, I am confident that I can successfully handle this project for you. I understand the importance of clean and well-documented code for ease of use and maintenance, and I assure you that my code will reflect these principles. To address any potential anti-scraping mechanisms, I will leverage advanced scraping techniques and rotate IP addresses to ensure uninterrupted data extraction. With previous work in scrapers, I have tackled similar issues effectively. My Python scripts are known to be efficient and quick, ensuring prompt delivery of your data to the MySQL database as required. In addition, my vast experience across various platforms like Wordpress, Laravel and more means I bring a diverse skillset to the table- a quality necessary when dealing with complex projects that require holistic thinking. Lastly, as a highly-disciplined freelancer who's consistently delivered satisfactory results to clients like you- I not only promise a job well done but also effective communication throughout the course of this project. Do not hesitate to reach out for my past similar projects or any clarifications you might need. Let's get started today!
$75 USD in 7 days
5.0 (31 reviews)
5.6
5.6
User Avatar
Hello. I read your requirement i will do that. Please come on chat we will discuss more about this. I will waiting your reply.
$100 USD in 1 day
5.0 (54 reviews)
5.7
5.7
User Avatar
Drawing from over four years of hands-on Python and web development experience, I am confident in my ability to deliver a robust and efficient solution for your Python Web Scraper project. My extensive proficiency with web scraping tools such as BeautifulSoup, Scrapy, and Selenium, will ensure that your scraper not only bypasses any potential anti-scraping mechanisms but also runs optimally, without compromising on data quality or speed. Moreover, my familiarity with MySQL database operations using pymysql and SQLAlchemy will facilitate the seamless storage of the extracted data. I understand the importance of well-documented code and guarantee clean code that will be easy to follow. Additionally, I will also provide an SQL file for creating the required MySQL table and an easy-to-understand documentation on how to set up and run the script. In similar projects in the past, I have created scrapers that have successfully gathered valuable data for informed decision-making. Leveraging my skills in web scraping paired with a dedication to precision and innovation, I ensure you’ll get a solution that is tailored specifically to fit your needs. Partner with me and get ready to extract invaluable insights that’ll drive your business forward!
$75 USD in 2 days
5.0 (25 reviews)
4.6
4.6
User Avatar
Hello, dear hire manager, I’m a Professional and Expert scraping developer come from China. I am interested in doing this job for you. I do have the necessary skill set & resources to complete this project. just scraped the same things yesterday. ping me and I can sent you some demo I scraped yesterday Best, Jax
$75 USD in 7 days
5.0 (4 reviews)
4.2
4.2
User Avatar
Hello, To develop the web scraper bot for Dexscreener as per your requirements, I suggest using Python with BeautifulSoup for parsing HTML, Selenium for dynamic content handling, and pymysql for MySQL database interactions. My approach would involve setting up Selenium to navigate the website, BeautifulSoup to parse HTML for data extraction, and pymysql for storing data in MySQL. Error handling and efficient scraping will be ensured to handle any anti-scraping measures. I will provide a structured script, an SQL file for table creation, and detailed documentation for setup and usage. Previous projects involving similar tasks have focused on modular code design, robust error handling, and efficient data processing to ensure reliable scraping and database operations. Regards
$80 USD in 2 days
5.0 (1 review)
3.8
3.8
User Avatar
With over 5 years of experience in Python and a strong expertise in web scraping and MySQL operations, I am confident that I can deliver an efficient and well-documented solution for your project. I have hands-on experience with popular scraping libraries such as BeautifulSoup, Scrapy, and Selenium which will be instrumental in navigating the Dexscreener website and extracting the necessary data. I have previously successfully developed and delivered several similar projects. In each case, I handled any potential anti-scraping mechanisms effectively ensuring a smooth scraping process. Combining this experience with my robust knowledge in Computer Vision, I can guarantee an even higher level of precision in extracting the top 20 trader addresses for each token. Not only will I provide you with a clean, well-documented Python script, but also with an SQL file for creating the needed MySQL table and detailed documentation on how to set up and run the script. You will have no trouble integrating my output into your existing system. Choose me for your project and let's exceed your expectations together.
$50 USD in 1 day
5.0 (3 reviews)
4.0
4.0
User Avatar
We work with over 300 clients in more than 21 countries and provide freelance support in over 85 technologies. You can connect with us for on-time delivery of your projects. We have successfully delivered more than 100 projects. So, connect with us! we have data entry experts
$75 USD in 7 days
5.0 (1 review)
2.7
2.7
User Avatar
With over a decade of experience as a Python developer, I bring not only a deep understanding of the language but also familiarity with web scraping libraries like BeautifulSoup, Scrapy, and Selenium that are key to the success of your project. I have experience in scraping yahoo finance data and saving it to MS SQL database. A major challenge in any web scraping project today is handling anti-scraping mechanisms employed by websites. My experience has equipped me with effective strategies to overcome these obstacles while ensuring the scrape runs smoothly and reliably. In addition to my technical skills, I am also dedicated to writing clean, well-documented code for easy maintenance and troubleshooting. As a Python developer, my work extends beyond just scraping; I use the data obtained in meaningful ways. For example, integrating the extracted information with machine learning models or data visualization tools. You can expect a similar added value from my end for this project as well. Based on your project's requirements, I proposancing the use of Coroutines (using ASYNC) of Python to balance out scraping speed and efficiency experiences you won't regret hiring me to complete your Dexscreener web scraper project!
$80 USD in 4 days
5.0 (2 reviews)
2.5
2.5
User Avatar
Hello! As an experienced Python developer with a strong background in web scraping and database integration, I am confident that I can deliver a robust and efficient solution that meets your requirements. My Approach: Utilizing the Selenium library in Python to automate the web navigation and interaction with the Dexscreener website. Implementing web scraping techniques to extract the necessary data from the token pages, including the top 20 trader addresses. Integrating the MySQL database connection and writing the extracted data into the appropriate tables and fields. Ensuring the robustness and reliability of the scraper bot by implementing error handling, retries, and other necessary measures. Providing detailed documentation and guidelines for the ongoing maintenance and operation of the bot. Thank you for considering my application. I look forward to the opportunity to discuss this project further. Best regards, Nordin
$50 USD in 7 days
5.0 (2 reviews)
2.0
2.0
User Avatar
⭐@Good day@⭐ Thanks for your posting. I am a good fit for this project due to my strong skills and experience as discussed on project modules. ******Please send me a message so that we can discuss more details.****** Gladly waiting to help you with my extensive skills. Thanks for reading my proposal. From Mohamed.
$100 USD in 7 days
5.0 (1 review)
1.8
1.8
User Avatar
Hello! I'm python engineer with 10+ years of experience in developing scraping scripts with scrapy, selenium, beautifulsoup. I can finish your project successfully in few days. Ready to discuss more details. Thank you.
$75 USD in 7 days
5.0 (1 review)
1.4
1.4
User Avatar
With over five years of experience in Bitcoin, Android, Iphone, Mobile Applications, PHP, Ionic ,React native ,Angular JS, WORDPRESS, HTML5,CSS and Ajax, I believe I have the necessary skills to develop your Python Web Scraper for Dexscreener. I've built more than 350 mobile apps and 400 web applications and have hands-on experience with technologies like BeautifulSoup, Scrapy, Selenium and MySql which are essential for this project. Anti-scraping mechanisms are no strangers to me. My team and I always stay ahead of the curve with innovative techniques to tackle such roadblocks efficiently. We also adhere strictly to writing clean and well-documented code that will ensure easy understanding and maintenance of the script. In previous projects, my approach has always been a combination of meticulous planning, efficient code development and thorough testing. For delivery on this project, you can expect a Python script that accomplishes all the requested tasks flawlessly along with a corresponding SQL file for the MySQL table and detailed setup and run instructions. I'll be available round-the-clock for any support or clarification post-delivery as well. Choose me to bring efficiency to your data extraction needs!
$95 USD in 2 days
5.0 (1 review)
0.6
0.6
User Avatar
Proposal: AI Solutions & Development Services for Python Web Scraper for Dexscreener and MySQL Database Integration Dear Onur K., I hope this message finds you well. My name is Noman Abdul Malik, and I'm a seasoned AI developer and machine learning engineer with over six years of experience. I specialize in crafting bespoke AI solutions that empower businesses to streamline operations, gain valuable insights, and make data-driven decisions. I'm writing to express my keen interest in your project, "Python Web Scraper for Dexscreener and MySQL Database Integration." Having carefully reviewed your project description, I'm confident that my expertise in AI and machine learning can add significant value to your endeavor. My experience spans a wide range of AI applications, including: * Natural Language Processing (NLP) * Computer Vision * Predictive Modeling * Recommendation Systems * Data Analysis and Visualization I'm eager to discuss your specific project needs and explore how I can tailor an AI solution to address your unique challenges and objectives. Please feel free to reach out to me at your earliest convenience to schedule a consultation. Thank you for your time and consideration. Sincerely, Noman Abdul Malik
$60 USD in 7 days
5.0 (1 review)
0.0
0.0
User Avatar
Hi, I can gather top 20 trader addresses from the Dexscreener website. I can make a sample for you. Data entry job is my passion and I have 7+ years of experience in this field. I’ve worked on several similar projects including web scraping, web search, excel formulation and shopify product listing. You may see my profile here: https://www.freelancer.com/u/joseph0556 I have completed over 700 projects on "" and have extensive knowledge and experience in similar jobs, so I can handle this project accurately. Message me so we can discuss more. Best Regards Joseph
$75 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, there. I have carefully reviewed the requirements for the web scraper bot project, and I fully understand the scope of the task at hand. With a focus on scraping the Dexscreener website for the top 20 trending tokens in a specific category, I am prepared to deliver a solution that meets your needs. In terms of technical experience, I have extensive expertise in web scraping using Python, employing libraries such as BeautifulSoup and Selenium. Additionally, I am well-versed in MySQL database operations in Python, using both pymysql and SQLAlchemy for efficient data storage and retrieval. For this project, I plan to utilize Python along with BeautifulSoup and Selenium for web scraping, ensuring that anti-scraping mechanisms are effectively handled. The extracted data will be formatted and written into a MySQL database, following the specified fields and structure. To ensure the successful execution of this project, I would like to ask: What specific categories should be considered for the token scraping, and do you have any preferences regarding the structure of the MySQL database? Thanks.
$75 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, Could you provide more details about the specific category you want to scrape from the Dexscreener website? I have extensive experience in web scraping using Python, including libraries like BeautifulSoup, Scrapy, and Selenium. I am also proficient in working with MySQL databases using pymysql and SQLAlchemy. Additionally, I am skilled in handling potential anti-scraping mechanisms to ensure the efficiency of the scraper. Once I have these details, I can develop a Python script that navigates to the Dexscreener website, selects the specified category, sorts the tokens by trending, opens the top 20 tokens’ pages, clicks on the “Top Traders” tab, and extracts the top 20 trader addresses. The extracted data will then be stored in a MySQL database with the required fields: id, network, token, and trader_address. I will also provide an SQL file for creating the necessary MySQL table and documentation on how to set up and run the script efficiently. Let me know if you would like to proceed. Best, Tawab S.
$100 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Python Web Scraping Expert here Hello, I have strong experiece in Web Scraping and related Scraping skills. So I can handle this project successfully. Looking forward to hearing from you. Sincerely.
$100 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of TURKEY
Turkey
5.0
1
Payment method verified
Member since Oct 10, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.