Job ID: JOB_ID_3568
About the Role:
We are seeking a highly skilled and experienced Databricks Engineer to join our team. This is a remote position, with a preference for candidates located in the Eastern Standard Time (EST) zone. The ideal candidate will be a true builder, with a strong background in authoring and optimizing data pipelines within the Databricks ecosystem.
Key Responsibilities:
- Design, develop, and maintain robust Delta Live Tables (DLT) pipelines.
- Rewrite and optimize existing DLT pipelines for improved performance and efficiency.
- Implement and manage Lakehouse architecture, ensuring data integrity and accessibility.
- Develop and execute data ingestion processes from various sources.
- Perform data lake cleanup and refactoring to maintain a clean and organized data environment.
- Write efficient and scalable SQL and Python code within the Databricks environment.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
- Troubleshoot and resolve issues related to data pipelines and Databricks infrastructure.
- Stay up-to-date with the latest advancements in Databricks and related technologies.
Must-Have Qualifications:
- 5-8 years of hands-on Databricks engineering experience.
- Strong, recent experience with Delta Live Tables (DLT) pipeline development, rewriting, and optimization.
- Proven experience with Lakehouse architecture, data ingestion, and data lake cleanup/refactoring.
- Strong coding skills in SQL and Python within the Databricks platform.
- Demonstrated ability to function as a true builder, authoring pipelines rather than just operating them.
Preferred Qualifications:
- Experience with cloud platforms (AWS, Azure, GCP).
- Familiarity with data warehousing concepts.
- Understanding of CI/CD practices for data pipelines.
- Experience with version control systems like Git.
About Neodym Technologies:
Neodym Technologies, Inc. is a leading technology consulting firm dedicated to providing innovative solutions to our clients. We specialize in helping organizations leverage the power of data and cloud technologies to achieve their business objectives. We are committed to fostering a collaborative and growth-oriented environment for our employees.
Special Requirements
Keywords: green card Virginia. Remote (EST Preferred).
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Remote
Recruiter / Company – Contact Information
Email: d@neodymtechnologies.com
Recruiter Notice:
To remove this job posting, please send an email from
d@neodymtechnologies.com with the subject:
DELETE_JOB_ID_3568