Job Title: Data Engineer
Primary Location: Hybrid in Chicago's Northwest Suburbs- 2 Days In-Office, 3 Days WFH
Position Type: Direct Hire
Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
5+ years of experience as a Data Engineer.
Building and supporting data lakehouse architectures using Delta Lake and changing data feeds.
Working with Spark and Python.
Writing code using OO programming.
Designing data warehouse table architecture such as star schema or Kimball method
Experience developing and installing wheelhouse packages for managing dependencies and distributing code.
Experience creating CI/CD pipelines for analytics solutions.
Nice to Have's:
Hands-on experience implementing data solutions using Microsoft Fabric.
Experience with machine learning/ML and data science tools.
Knowledge of data governance and security best practices.
Experience in a larger IT environment with 3,000+ users and multiple domains.
Current industry certifications from Microsoft cloud/data platforms or equivalent certifications. One or more of the following Certifications:
Microsoft Certified: Fabric Data Engineer Associate
Microsoft Certified: Azure Data Scientist Associate
Microsoft Certified: Azure Data Fundamentals
Google Professional Data Engineer
Certified Data Management Professional (CDMP)
IBM Certified Data Architect Big Data
What You'll Do. (Skills Used in this Position)
Design and develop scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.
Partner with data scientists and analysts to define requirements and design robust data analytics solutions.
Ensure data quality and integrity through data cleansing, validation, and automated testing procedures.
Develop and maintain technical documentation, including requirements, design specifications, and test plans.
Implement and manage data integrations from multiple internal and external sources.
Optimize data workflows to improve performance and reliability, and reduce cloud consumption.
Monitor, troubleshoot, and resolve data pipeline issues to ensure consistent data delivery.
Establish and manage CI/CD pipelines and release processes for data solutions.
Provide technical leadership and coordination for global development and support teams.
Participate in creating a safe and healthy workplace by adhering to organizational safety protocols.
Support additional projects and initiatives as assigned by management.
Compensation Information
The expected salary range for this position is $110,000 - $147,000 per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off.
This role requires authorization to work in the U.S. without current or future visa sponsorship.
...employer match Paid time off to relax and recharge with vacation, holidays, and sick time. Annual memberships with Strava and Headspace for additional health and wellness benefits Maternity and Paternity leave time options to care for the newest little family...
.../Summary: Incumbent serves as a junior level chemist in the Chemistry Laboratory of the IDOH Chemistry Laboratories. Incumbent prepares... ... Broad knowledge of principles and practices of analytical, organic and inorganic chemistry with subsequent experience during the last...
...qualified candidate to join their 100% remote team as a Salesforce Consultant. This candidate will be responsible for managing strategic... ...receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity...
Industry : Food & Beverage / Catering Location : Malta Basis : Full time Remuneration : Salary Main Duties: Provide high-quality table service to guests, ensuring a memorable dining experience Greet customers warmly, present menus, and...
Non-Interventional, Chronic Pain Management. Can be Residency trained in Internal Medicine, Family Medicine, PM&R +'Candidate will provide patient assessment, diagnosis,health status, interpretations of diagnostic procedures,development and implementation of patient treatment...