NEWPosted 2 hours ago

Job ID: JOB_ID_2984

Job Overview

We are seeking a highly skilled and experienced Senior Databricks Data Engineer to join our remote team. The ideal candidate will have a strong background in designing, developing, and deploying scalable data solutions using Databricks and related technologies. You will be responsible for building and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver data-driven insights.

Responsibilities

  • Design, build, and maintain robust and scalable data pipelines using Databricks and Apache Spark.
  • Develop and optimize ETL/ELT processes for large datasets.
  • Implement data warehousing solutions and data modeling best practices.
  • Ensure data quality, integrity, and reliability across all data systems.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Monitor and troubleshoot data pipeline performance, identifying and resolving issues proactively.
  • Implement and maintain data security and governance policies.
  • Stay up-to-date with the latest trends and technologies in data engineering and big data.
  • Mentor junior data engineers and contribute to the team’s technical growth.

Qualifications

  • Proven experience as a Data Engineer, with a focus on Databricks and Spark.
  • Strong proficiency in Python, SQL, and Scala.
  • Experience with cloud platforms (AWS, Azure, or GCP).
  • Solid understanding of data warehousing concepts, data modeling, and ETL/ELT processes.
  • Experience with distributed computing systems and big data technologies.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Nice to Have

  • Experience with other big data tools and technologies (e.g., Kafka, Hadoop).
  • Familiarity with data visualization tools (e.g., Tableau, Power BI).
  • Experience with CI/CD pipelines and DevOps practices.

Compensation & Location

Salary: $120,000 – $160,000 per year

Location: Remote

Recruiter / Company – Contact Information

Email: sneha.v@integrasystemsshell.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
sneha.v@integrasystemsshell.com with the subject:

DELETE_JOB_ID_2984

to delete@join-this.com.