NEWPosted 2 hours ago
Job ID: JOB_ID_6518
Detailed Job Description
Databricks Engineer with analytical expertise to design, develop, and optimize scalable data pipelines and analytics solutions using the Databricks platform. Closely with data scientists, analysts, and business stakeholders to transform raw data into actionable insights that drive strategic decision-making.
Key Responsibilities
- Develop and maintain robust ETL/ELT pipelines using Apache Spark, Pyspark on Databricks.
- Collaborate with cross-functional teams to understand data requirements and deliver analytical solutions.
- Implement data quality checks, performance tuning, and scalable data models.
- Leverage SQL, Python, and Spark to perform advanced data analysis and reporting.
- Monitor and troubleshoot data workflows to ensure reliability and accuracy.
Required Skills
- Proficiency in Databricks, Apache Spark, Pyspark and Azure data platforms.
- Strong analytical and problem-solving skills with experience in data wrangling and visualization.
- Expertise in SQL, Python, and data modeling techniques.
- Familiarity with Delta Lake, ML flow, and notebook-based development.
- Ability to interpret complex datasets and communicate insights effectively
Minimum Years of Experience
8+ years
Special Requirements
In Person Interview (Fully Remote role), F2F interview at Dallas TX
Compensation & Location
Salary: $100,000 – $150,000 per year (Estimated)
Location: Atlanta, GA
Recruiter / Company – Contact Information
Recruiter / Employer: Vision IT
Email: kanth.kumar@visionitllc.com
Recruiter Notice:
To remove this job posting, please send an email from
kanth.kumar@visionitllc.com with the subject:
DELETE_JOB_ID_6518