Find Jobs
Hire Freelancers

Build data extract and transformation tool -- 4

$250-750 USD

Completed
Posted about 8 years ago

$250-750 USD

Paid on delivery
We are in need of a data extraction (E) + transformation (T) tool -- the importer -- that converts information stored in various file types (such as .csv, .xls, .xlsx, .mdb, .accdb, etc.) and structures (wide, long, dyadic, etc.) into a standardized .json format based on an already established data schema and built off an existing prototype. Information on the json data schema can be found here: [login to view URL] The data extraction ( E ) logic is how to generate the flow of events from data within each source file; and the data transformation ( T ) logic is how to serialize the data in the flow to separate JSON objects. The JSON output of the E+T tool will eventually be uploaded into a cloud-based data aggregation tool, aka. DataGator, that is currently under development. The full-fledged importer tool needs to be robust enough to identify different variants of standard data fields and records, including non-standard characters within the data as well as within the file names, and reformat and package these into the final .json format that the system, aka. DataGator, recognizes. We are looking for developers with expertise in Java and data processing. Familiarity with Jackson/Apache POI would also be advantageous. This project has the possibility of becoming a longer-term arrangement for the development of additional auxiliary components for the DataGator project. The final iteration of this tool will be included in a public rollout for the DataGator system. To facilitate candidate developers to understand our requirements, we have created a prototype of the importer tool. A working example is provided within the prototype that can convert a single .csv file to JSON output. The prototype of the importer tool can be found in our public GitHub repository, [login to view URL] The work that needs to be completed would be to extend this prototype both horizontally (i.e. extract data from other file types such as .xls, .xlsx, .mdb, .txt) and vertically (i.e. support data filtering, merging, and hierarchical extraction, i.e. selecting multiple work sheets within a single Excel files, one sheet in multiple Excel files, multiple sheets within multiple Excel files etc.). There are multiple modules that need to be constructed based on file types and additional functionality NOTE: This project is only for Module 3 (XLSX Extractor) and all additional modules will be completed under follow-on projects dependent on successful completion of Module #3. Module 1: Build E+T functionality for .xlsx file Module 2: Build E+T functionality for .xls file Module 3: Build E+T functionality for .mdb file Module 4: Build E+T functionality for .txt file Module 5: Allow for processing of multiple files Module 6: Create a Java GUI for client-side operation Note: The logic for multi-sheet xls / xlsx/mdb files can have three alternative options (i) extract data from one of the sheets (ii) extract data from multiple sheets and combine them into a single JSON object (iii) extract data from multiple sheets and output them as individual JSON objects. Our expectation is that Module 3 (XLSX Extractor) will be able to be completed within 3-4 days of being awarded the project and the freelancer is qualified to complete Modules 4 through 6. We have provided several sample files that will need to be converted to JSON format and eventually uploaded, however it must be understood that these sample files are not an exhaustive list of characters within a file or file structures. The ideal freelancer will be willing and able to identify potential issues that may arise as other users begin to use it and different file structures are loaded into the tool. We are looking for freelancers that are passionate about this project and interested in a longer term working relationship. Please reach out with any questions that you may have.
Project ID: 9234319

About the project

4 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I have 9 years experience in JAVA, J2EE
$444 USD in 5 days
4.9 (82 reviews)
6.4
6.4
4 freelancers are bidding on average $689 USD for this job
User Avatar
A proposal has not yet been provided
$700 USD in 5 days
4.9 (66 reviews)
6.1
6.1
User Avatar
Hello Sir, I have more than 8 year experience in web development ,made many website with delivered quality work I am expert in web development . few things that i have , i am very quick learner ,good listener ,and make understanding with whom i am working. I am sure ,i can help you in web development . Looking forward for long term relationship. Please give me chance to working with you. Hope we will work together. Thanks Ricky
$833 USD in 15 days
1.0 (1 review)
1.8
1.8
User Avatar
High quality work with zero errors is guaranteed. I can do all your Finance, Accountancy and Strategy related work. Business plans, Bookkeeping, Accounting, Data Entry, PowerPoint, Excel and etc. Finance, Accountancy and Business Plans Finance, Accountancy, Bookkeeping, Income Statement etc. Business Plans All Accounting related work (XERO, SAP, QB, ABCOM, MYOB and etc All kind of Financial analysis's Data Entry and Other Data organization Data entry on MS Word and MS Excel PDF to MS Excel or MS Word Web Research Help Copy/Paste Data from websites to MS Excel and MS Word Send a reminder (via email) Instant and quality presentation in PowerPoint and all excel related work Why me? ✔100 % Satisfaction Guaranteed ✔Money Back Guarantee ✔Fast Delivery (Work delivery in few hours) ✔Unlimited Revisions ✔Various number of service If any service is not listed above, you can message me and I will get back to you. If you like my service then do not forget to save my GIG by clicking "Favorite" button from Top Right Corner
$250 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$555 USD in 10 days
0.0 (1 review)
0.0
0.0

About the client

Flag of UNITED STATES
United States
5.0
55
Payment method verified
Member since Jan 18, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.