Senior Data Engineer - Remote Job at Duobridge Talent Solution, United States

  • Duobridge Talent Solution
  • United States

Job Description

Job Summary:

We are looking for a Senior Data Engineer with strong Python and data engineering experience to build scalable data platforms and pipelines using Azure, Databricks, and Snowflake .

Key Responsibilities:
  • Design and develop scalable ETL/ELT data pipelines.
  • Build data ingestion frameworks using Python, APIs, and distributed processing .
  • Develop Databricks pipelines using PySpark and Delta Lake .
  • Work with Snowflake, Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Design Medallion Architecture, CDC, data models, and data quality frameworks.
  • Develop REST/GraphQL API integrations with authentication, retry, and error handling.
  • Optimize pipeline performance, reliability, and cloud costs.
  • Support batch, real-time, and event-driven data processing.
  • Collaborate with AI engineers, architects, product teams, and business stakeholders.
Required Skills:
  • 5+ years of Data Engineering experience.
  • Strong Python and Advanced SQL skills.
  • Hands-on experience with Databricks, PySpark, Delta Lake, and Snowflake .
  • Strong knowledge of Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Experience with REST/GraphQL APIs, OAuth2/JWT, and API integrations.
  • Knowledge of data architecture, CDC, Medallion Architecture, and dimensional modeling.
  • Experience with Git and CI/CD .
Good to Have:

Airflow, dbt, Kafka, Terraform, Azure OpenAI, and AI/ML data pipelines.

#J-18808-Ljbffr

Job Tags

Similar Jobs

ProctorU Inc.

UX Designer Job at ProctorU Inc.

 ...The Role: The User Experience Designer partners with Product and Engineering to...  ...prototyping, validation, and delivery. The UX Designer is increasingly comfortable reasoning...  ...and internal stakeholders, including remote and asynchronous formats. Help distinguish... 

Department of the Air Force

Cashier-Checker Job at Department of the Air Force

 ...Job TitleDutiesHelpOperates cash register, rings up the sale, receives money and makes change, processes credit card sale, or charges to member's account. At the end of each tour of duty clears the cash register and turns over cash and supporting documents as instructed... 

Wellpath

Dental Assistant - Temp - FT Job at Wellpath

 ...In addition to comprehensive benefits including medical, dental, vision, paid time off, and 401k, we foster a work, life balance...  ...including: DailyPay, receive your money as you earn it! Tuition Assistance and dependent Scholarships Employee Assistance Program (EAP)... 

PeerSource

Technical SEO Specialist (30 hrs/wk) Job at PeerSource

 ...SEO Specialist will help execute organic search initiatives across traditional SEO as...  ...platforms while supporting testing and future optimization strategies. \n \n Responsibilities...  ...skills with the ability to manage multiple concurrent workstreams. \n ~... 

Vituity

Physician - Breast Imaging Radiologist - Loma Linda University Medical Center - Murrieta Job at Vituity

 ...Hybrid Onsite/Remote, CA Seeking Breast Imaging Radiologists Join the Physician Partnership Where You Can Increase Your Impact Vituity's ownership model provides autonomy, local control, and a national system of support, so you can focus your attention where...