Job ID: JOB_ID_6825
Job Summary:
We are looking for a skilled Data Engineer to join our team in Boston, MA. This is a long-term contract position requiring candidates to be local to the Boston area. The role involves designing, developing, and optimizing ETL/ELT pipelines, implementing real-time and batch data processing solutions, and ensuring data quality and performance within Databricks environments.
Key Responsibilities:
- Design, develop, and optimize ETL/ELT pipelines in Databricks.
- Implement real-time and batch data processing solutions using Apache Spark and Delta Lake.
- Develop PySpark/Scala-based data transformation scripts for large-scale data processing.
- Ensure data quality, performance tuning, and cost optimization within Databricks.
- Implement CI/CD pipelines for Databricks workflows using Terraform, GitHub Actions, or Azure DevOps.
- Monitor, troubleshoot, and optimize Databricks clusters, jobs, and queries.
- Collaborate with Data Architects, Business Analysts, and DevOps teams to align solutions with business needs.
Required Skills:
- Hands-on experience in Databricks (AWS) – Delta Lake, Medallion architecture, Coding skills etc.
- Proficiency in PySpark for data engineering workflows.
- Hands-on experience with file handling, Kafka, APIs, and streaming data processing.
- Proficiency in SQL for querying and performance tuning.
- Experience in DevOps and CI/CD pipelines for Databricks.
- Understanding of Data Governance, Security, and Access Control in Databricks.
Employment Type:
Long-term Contract
Location:
Boston, MA (Onsite DAY1)
About Metrix IT Solutions INC:
Metrix IT Solutions INC is a dynamic IT consulting firm specializing in providing innovative solutions to businesses. We are an E-Verified Company committed to delivering excellence in technology services.
Special Requirements
Local Candidates Only. Onsite DAY1.
Compensation & Location
Salary: $60 – $75 per year (Estimated)
Location: Boston, MA
Recruiter / Company – Contact Information
Recruiter / Employer: Metrix IT Solutions INC
Email: hyant.s@metrixit.com
Recruiter Notice:
To remove this job posting, please send an email from
hyant.s@metrixit.com with the subject:
DELETE_JOB_ID_6825