Remote Data Engineer Job at 1872 Consulting, Oak Brook, IL

  • 1872 Consulting
  • Oak Brook, IL

Job Description

Sr. Data Engineer

This role is responsible for providing technical expertise and leadership to design and deliver end-to-end data engineering solutions to support advanced analytics capabilities and drive innovation and decision-making across our enterprise.

Responsibilities:

  • Build and maintain real-time and batch data pipelines across the advanced analytics platform.
  • Design, develop and orchestrate highly robust and scalable ETL pipelines.
  • Design and implement Dimensional and NoSQL data modeling as per the business requirements.
  • Develop highly optimal codebase and perform Spark optimizations for Big Data use cases.
  • Design, develop and deploy optimal monitoring and testing strategy for the data products.
  • Collaborate with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions.
  • Collaborate with data scientists to prepare data for model development and production.
  • Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.
  • Collaborate with data architects on the enhancement of our enterprise data architecture and platforms.
  • Provide leadership to third-party contractors.
  • Comply with health and safety guidelines and rules.
  • Maintain professional and technical knowledge by attending educational workshops, professional publications, establishing personal networks, and participating in professional societies.

Requirements:

  • 4+ years of experience in Data Engineering
  • 2+ years of experience with Advanced Analytics or Data Science
  • Proficient in Spark
  • Experience with Azure

Nice to have:

  • Experience with IoT Data Architecture.
  • Machine Learning Operationalization (MLOps) proficiency.
  • Proficiency with streaming design patterns

Job Tags

For contractors

Similar Jobs

United Counseling Service of Bennington County Inc

Teacher Job at United Counseling Service of Bennington County Inc

 ...: The Teacher's responsibilities include the development and implementation of curriculum to meet the philosophies and goals of Head Start. They should be able to communicate well with children, their parents, center staff, and consultants. Provide pre-school educational... 

Insight Global

Remote iOS Developer Job at Insight Global

 ...Job Description This iOS Developer will be working at a global hotel company to support some upcoming projects that they have coming up. They will participate in regular meetings throughout the week, including standard Scrum ceremonies and occasional organizational... 

hth companies

Travel Industrial Cleaning Foreman Job at hth companies

 ...Job Description Job Description Company Description: hth companies is an industrial services provider offering mechanical insulation, scaffolding, industrial cleaning, and various other services to meet our customers' needs across the Midwest. At hth companies,... 

Mesquite ISD

Junior Network Engineer Job at Mesquite ISD

 ...Shift Type: Full-Time Wage/Hour Status: Non - Exempt Reports To: Network Operation Supervisor EMPLOYMENT BEGINS: As soon as...  ...Science studiesSpecial Knowledge/Skills: Network infrastructure engineering, implementation, and design Network Security (NERC CIP and NIST... 

The Judge Group

Azure DevOps Engineer Job at The Judge Group

 ...Manage and optimize cloud infrastructure on Microsoft Azure, ensuring high availability, performance, and security. Leverage Azure DevOps for version control, build/release pipelines, and project tracking. Monitor system performance and proactively address issues...