Job ID: JOB_ID_60
Role Overview
We are seeking a highly skilled and motivated Azure Data Engineer to join our dynamic team in Sunrise, FL. This is a critical Contract-to-Hire position designed for a professional who thrives in a fast-paced environment and is looking to transition into a permanent role within six months. The successful candidate will be responsible for building, maintaining, and optimizing our next-generation data platform, focusing on the Databricks Lakehouse architecture. You will play a pivotal role in bridging the gap between raw data and actionable business insights, ensuring our data infrastructure is scalable, secure, and highly performant.
Key Responsibilities
- Administer and optimize the Databricks Lakehouse environment to ensure high performance and cost efficiency.
- Develop and maintain data platform infrastructure using Terraform for Infrastructure as Code (IaC).
- Provision Databricks workspaces, SQL Endpoints, and Unity Catalog objects.
- Implement and manage robust CI/CD pipelines using GitHub Actions for data pipelines and dbt projects.
- Design and implement complex data ingestion patterns into Delta Lake.
- Develop and troubleshoot Spark jobs using PySpark or Scala for large-scale data processing.
- Manage data ingestion pipelines using modern tools like Airbyte, Fivetran, or Stitch.
- Collaborate with Analytics Engineers to translate business requirements into scalable data models using dbt.
- Enforce data governance and access control through Unity Catalog.
- Provide technical guidance and mentorship to junior team members while championing best practices.
Technical Requirements
- Minimum of 5 years of progressive experience as a Data Engineer with a cloud focus.
- Deep expertise in the Databricks ecosystem, including Spark, Delta Lake, and Unity Catalog.
- Strong proficiency in SQL and Python (Scala is a significant plus).
- Hands-on experience with Terraform for infrastructure provisioning.
- Proven track record of implementing CI/CD pipelines via GitHub Actions.
- Solid understanding of Data Lakehouse and Data Warehousing architectures.
- Experience with data modeling tools, specifically dbt (Data Build Tool).
- Familiarity with modern data ingestion tools like Airbyte or similar ETL/ELT platforms.
Infrastructure & Governance
As a Senior Azure Data Engineer, you will not only build pipelines but also oversee the structural integrity of our data environment. This includes managing network components and security configurations to protect sensitive enterprise data. You will be the primary advocate for Unity Catalog, ensuring that metadata management and access controls are strictly followed across the organization. Your work will ensure that our data scientists and business analysts have access to high-quality, reliable data in a self-service manner, reducing bottlenecks and accelerating time-to-insight.
Career Path & Transition
This role is specifically structured as a Contract-to-Hire engagement. For the first six months, you will work as a consultant, allowing both you and the company to ensure a perfect cultural and technical fit. Upon successful completion of this period, the role is intended to convert to a full-time permanent position. Candidates must be able to transition to permanent status without requiring visa sponsorship. This is an excellent opportunity for a local Florida resident to secure a long-term career with a leading organization in the Sunrise area.
Special Requirements
Must be able to go perm in 6 months with no sponsorship. Local to Sunrise, FL (driving distance). Contract to Hire.
Compensation & Location
Salary: $135,000 – $178,000 per year (Estimated)
Location: Sunrise, FL
Recruiter / Company – Contact Information
Recruiter / Employer: Hexagon Global Services Inc.
Email: Rakhi@hexgs.com
Recruiter Notice:
To remove this job posting, please send an email from
Rakhi@hexgs.com with the subject:
DELETE_JOB_ID_60