Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    1 jobs found

    I have several relational database tables that need to be extracted into Databricks, cleaned, and reshaped before being loaded into a separate database / data-warehouse. The entire workflow should be scripted in Python (PySpark and SQL) and version-controlled in GitHub, with development ideally done from VS Code so that I can review and extend the notebooks locally. Key points you’ll handle • Connect to the source database from Databricks and pull the required tables. • Use PySpark DataFrame APIs and SQL to remove duplicates, harmonise column types, apply business rules, and create the final fact and dimension structures. • Write the transformed data back to the target warehouse in an efficient, partition-friendly format (Parquet or Delta Lake preferred). &bul...

    $6 / hr Average bid
    $6 / hr Avg Bid
    27 bids

    Recommended Articles Just for You