Job ID: JOB_ID_4181
Job Overview:
We are seeking a highly skilled and experienced Lead Data Engineer with a strong background in SQL and Databricks to join our team. This role involves building and maintaining scalable data pipelines, ensuring data quality, and optimizing data processes. The ideal candidate will have hands-on experience with Snowflake, Airflow, and GitHub, along with a solid understanding of Python and object-oriented programming principles.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Databricks and SQL.
- Orchestrate ETL/ELT workflows using Apache Airflow.
- Develop, maintain, and optimize Snowflake data models.
- Utilize GitHub for code management, version control, and CI/CD processes.
- Implement and manage data quality and observability tools such as Soda.
- Work extensively with AWS S3 for data storage, management, and integration.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Troubleshoot and resolve issues related to data pipelines and infrastructure.
- Ensure data accuracy, integrity, and security across all data processes.
- Stay up-to-date with the latest trends and technologies in data engineering.
Required Skills:
- Proficiency in Python and strong understanding of Object-Oriented Programming (OOP) principles.
- Extensive experience with SQL.
- Hands-on experience with Snowflake for data warehousing.
- Expertise in Databricks for data processing and analytics.
- Experience with Apache Airflow for workflow orchestration.
- Familiarity with AWS S3 for cloud storage.
- Knowledge of GitHub for version control and collaboration.
- Strong problem-solving and analytical skills.
- Excellent communication and interpersonal skills.
Preferred Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Experience with data quality and observability tools (e.g., Soda).
- Familiarity with CI/CD concepts and tools.
Experience Requirements:
- 12+ years of overall experience in data engineering or related roles.
Location:
- 100% Remote
Employment Type:
- Long Term Contract
Special Requirements
Visa Status – OPT/CPT/GC is not workable. Candidate should complete Berribot coding test in next 24 hours.
Compensation & Location
Salary: $70,000 – $120,000 per year
Location: Spring, TX
Recruiter / Company – Contact Information
Email: umohit064@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
umohit064@gmail.com with the subject:
DELETE_JOB_ID_4181