Azure Data Engineer Job at 3B Staffing LLC, Chicago, IL

  • 3B Staffing LLC
  • Chicago, IL

Job Description

This will require an onsite interview or require the candidate to pick up their laptop in person


Requirements/Top Skills Needed:
ADF
Databricks
Python
SQL
Retail experience would be helpful, but not required


Job Title: Azure Data Engineer
Job Summary: We are seeking a highly skilled Azure Data Engineer to design, build, and optimize our next-generation cloud data platform. You will build scalable data pipelines, manage enterprise data warehouses, and transform massive datasets using Azure Cloud, ADF, Databricks, Spark, and PySpark.

Key Responsibilities
• Pipeline Orchestration: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Big Data Processing: Build high-performance, distributed data transformation workloads via Azure Databricks and Apache Spark/PySpark.
• Data Warehousing: Architect, model, and maintain cloud-native Data Warehouses and Data Lakes (ADLS Gen2).
• Architecture Implementation: Apply modern architectural patterns like the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake formats.
• Performance Tuning: Optimize Spark jobs, cluster configurations, and SQL queries to minimize latency and cloud compute costs.
• Governance & Security: Implement security frameworks, data lineage, and user access policies using Unity Catalog.
• CI/CD Automation: Deploy, monitor, and automate workflows using Azure DevOps and automated alert configurations.

Required Technical Skills:
• Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL, Synapse Analytics, Key Vault, Storages, Azure Functions, Logic Apps).
• Data Orchestration: Advanced proficiency in Azure Data Factory (ADF).
• Compute & Analytics: Deep hands-on experience with Azure Databricks.
• Big Data Frameworks: Strong mastery of Apache Spark and PySpark (including Spark SQL).
• Languages: Expert level in Python and SQL.
• Data Warehousing: Solid understanding of Data Modeling (Star/Snowflake schema) and warehousing concepts

Job Tags

Similar Jobs

Village Media

Editor Job at Village Media

 ...bedrock of a healthy democracy. We seek five visionary, high-energy Editors to launch and lead our footprint in each of these Illinois...  ...communities. Compensation and Logistics Work Arrangement: Remote/Work-from-Home, with a strict requirement of residing within... 

University of Georgia- FACS

Inhalation Toxicology Research Scientist I Job at University of Georgia- FACS

 ...Leidos is seeking a Research Scientist to lead inhalation toxicology research in the Environmental Health Effects Laboratory, Dayton, OH. The role involves study design, animal use, data collection, and scientific reporting supporting naval health missions.The candidate... 

Hillside Boutique Hotel

Spa Massage Therapist Job at Hillside Boutique Hotel

 ...Job Title: Spa Massage Therapist Department: Spa Supervisor: Guest Service Manager, Operations Manager, and/or GM Summary The Massage Therapist provides professional massage and body treatments to guests in the hotel spa, ensuring a relaxing and rejuvenating... 

pretty little adventures

Travel Agent Job at pretty little adventures

 ...are looking for an energetic, driven, and detail-oriented Remote Travel Consultant. Our Travel Consultants play a key role in our...  ...achievable timelines to hit them Requirements A dedicated home work environment, including: A computer Cell phone High-speed... 

Jim Coleman Nissan of Silver Spring

Technician Job at Jim Coleman Nissan of Silver Spring

 ...Jim Coleman Nissan of Silver Spring is hiring a Technician! Jim Coleman Automotive is a 3rd generation family-owned dealership founded in 1968. The Coleman family has been selling and servicing cars in the Washington- Metropolitan and Bethesda areas since the 1950s...