Job ID: JOB_ID_873
Role Overview
The Azure Databricks Engineer will be a pivotal member of our data engineering team, responsible for architecting and implementing high-performance data solutions on the Azure platform. This role requires a deep understanding of the Databricks ecosystem, including Spark, PySpark, and Delta Lake, to transform complex datasets into actionable insights. As we move into 2026, the demand for sophisticated data lakehouse architectures has never been higher, and this position sits at the forefront of that evolution.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines leveraging Databricks (Spark, PySpark, SQL, Delta Lake) to support enterprise-level data processing and analytics.
- Write clean, maintainable, and efficient PySpark and Python code to support data ingestion and transformation workflows.
- Integrate Azure Databricks with various Azure data services, such as Azure Data Factory (ADF), ADLS Gen 2, and Azure SQL, to build robust and scalable data platforms.
- Implement and maintain ETL/ELT workflows for scalability, cost-effectiveness, and operational efficiency.
- Manage job scheduling, orchestration, and monitoring using tools like Azure Data Factory, Airflow, or Databricks Workflows.
- Collaborate with data analysts and stakeholders to gather requirements and deliver scalable data solutions that meet business needs.
- Participate actively in design discussions, code reviews, and agile ceremonies to foster a collaborative and high-performing team environment.
- Design modular, reusable workflows using tasks, triggers, and dependencies within the Azure ecosystem.
Technical Requirements
- Minimum of 5 years of expert-level experience in SQL for complex data manipulation and analysis.
- At least 4 years of hands-on experience with Azure Databricks and PySpark.
- 4+ years of experience working within the Azure Cloud platform.
- 3+ years of experience with Azure Data Factory (ADF), ADLS Gen 2, and Azure SQL.
- 2+ years of experience with Databricks workflows and Unity Catalog.
- 2+ years of experience in Python programming and package builds.
- Experience in data ingestion, cleansing, and transformation from structured and unstructured sources like Cassandra, Mark Logic, and on-prem Mainframe sources.
- Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
- Strong understanding of ETL/ELT design patterns, data warehousing, and data lakehouse architectures.
- Preferred: Azure Entra/AD skills, GitHub Actions, and experience with event-driven architectures using Kafka or Azure Event Hub.
Data Governance and Security
In this role, you will be expected to implement robust data governance practices using Unity Catalog to ensure data lineage, security, and compliance across the organization. You will work closely with security teams to configure Azure Entra ID (formerly Active Directory) integrations and manage fine-grained access controls. Ensuring that our data lakehouse remains a single source of truth while maintaining the highest standards of data privacy is a core component of this engineering position.
Professional Environment
Joining Samson Software Solutions means becoming part of a certified Minority & Women-Owned Enterprise dedicated to high-quality IT resource delivery. We value innovation, technical excellence, and a collaborative spirit. This position offers the flexibility of remote work while maintaining a preference for candidates local to the Fort Worth, TX area to facilitate occasional in-person collaboration and team-building activities. We provide a path for continuous learning and certification in the latest Azure technologies.
Special Requirements
Only USC and GC. Remote but prefer local to Fort Worth, TX.
Compensation & Location
Salary: $145,000 – $185,000 per year (Estimated)
Location: Fort Worth, TX
Recruiter / Company – Contact Information
Recruiter / Employer: Samson Software Solutions, Inc.
Email: kavya.malik@samsonsoft.com
Recruiter Notice:
To remove this job posting, please send an email from
kavya.malik@samsonsoft.com with the subject:
DELETE_JOB_ID_873