Need New Ideas to Developing Algorithm Using Priority Queue

$10-40 USD

Cancelled

Posted

almost 9 years ago

$10-40 USD

Paid on delivery

Hi All, I am developing a web scraping algorithm using Priority Queue to enqueue the new parsed links from seed URL to the queue and then dequeue the seed URL from the queue then start to select new seed URL from Priority Queue according to an algorithm i am developing it. The program is running without any problem. But the problem is: - Since (enqueue Links > dequeue), the size of Priority Queue is getting bigger and bigger by the time. How can I control of it ? - When I am try to get number of crawled URLs per minutes, i am getting low results by the time. Ex: after running the program for 1 hour, the average of crawled page is getting low than if i run the program for 15 minutes and get the average of crawled pages. How to fix this? I have these two issues and need your help and your idea to solve this problem in my crawled algorithm. Thanks All

Algorithm

Project ID: 7765013

About the project

3 proposals

Remote project

Active 9 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

3 freelancers are bidding on average $28 USD for this job

@ithuang2014

hello. I saw your description. I understand it and can do it well. I have done several project like this. I'm an expert in Data Structures and Algorithms. And I know Java ,C/C++ and Python well. I'm interested this project. I want to discuss with you about this project. If it's possible,please contact me and explain more detail. I wait your good reply. Bye.

$49 USD in 1 day

5.0

(3 reviews)

2.9

@christopherzahar

Dog, ima be honest. i don't no shit bout computerz. but you give me this job and i can hook u up wit dis rachet down da street n boy she will suck ur cock good. she got aidz but she need $$$ n i think she kan do algorithmz n shit.

$30 USD in 1 day