Job ID: JOB_ID_3329
Job Summary:
We are seeking a Lead Azure Data Engineer with analytical expertise to design, develop, and optimize scalable data pipelines and analytics solutions using the Databricks platform. This role involves close collaboration with data scientists, analysts, and business stakeholders to transform raw data into actionable insights that drive strategic decision-making. The ideal candidate will have a strong background in Databricks, Apache Spark, Pyspark, and Azure data platforms, with extensive experience in ETL/ELT processes and SQL.
Key Responsibilities:
- Develop and maintain robust ETL/ELT pipelines using Apache Spark, Pyspark on Databricks.
- Collaborate with cross-functional teams to understand data requirements and deliver analytical solutions.
- Implement data quality checks, performance tuning, and scalable data models.
- Leverage SQL, Python, and Spark to perform advanced data analysis and reporting.
- Monitor and troubleshoot data workflows to ensure reliability and accuracy.
- Design, develop, and optimize scalable data pipelines and analytics solutions using the Databricks platform.
- Transform raw data into actionable insights that drive strategic decision-making.
Required Skills:
- Proficiency in Databricks, Apache Spark, Pyspark and Azure data platforms.
- Strong analytical and problem-solving skills with experience in data wrangling and visualization.
- Expertise in SQL, Python, and data modeling techniques.
- Familiarity with Delta Lake, ML flow, and notebook-based development.
- Ability to interpret complex datasets and communicate insights effectively.
Minimum Years of Experience:
- 8+ years
Nice to Have Skills:
- ADF
- DevOps
Special Requirements
Remote 100%
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Green, OH
Recruiter / Company – Contact Information
Email: heed.a@nityo.com
Recruiter Notice:
To remove this job posting, please send an email from
heed.a@nityo.com with the subject:
DELETE_JOB_ID_3329