Job ID: JOB_ID_8097
Job Title: Systems Analyst 3 (Databricks Administrator)
We are seeking an experienced Databricks Administrator, also known as Systems Analyst 3, to join our team. This is a remote position based in Austin, Texas, working with the State of Texas HHSC. The ideal candidate will have over 14 years of experience in managing and optimizing data platforms, with a strong focus on Databricks within an AWS environment.
Key Responsibilities:
- Administer and manage the Databricks platform and its associated workspaces.
- Configure and maintain Databricks clusters, including job scheduling and governance policies to ensure efficient and secure operations.
- Monitor the performance, reliability, and availability of the Databricks platform, proactively addressing any issues.
- Manage security aspects, including access control (IAM, RBAC, SCIM) and compliance with relevant regulations.
- Optimize Databricks workloads for both cost and performance, ensuring efficient resource utilization.
- Integrate Databricks with cloud storage solutions such as S3.
- Implement and manage DevOps practices, including Terraform and CI/CD pipelines, for infrastructure as code and automated deployments.
- Troubleshoot and resolve issues related to Databricks clusters, jobs, and user access.
- Collaborate with data engineers, data scientists, and other stakeholders to understand and meet their data platform needs.
- Stay up-to-date with the latest Databricks features and best practices.
Required Skills:
- Extensive experience in Databricks administration, specifically within an AWS environment.
- Proficiency in cluster configuration, workspace management, and job scheduling.
- Strong understanding of access control mechanisms such as IAM, RBAC, and SCIM.
- In-depth knowledge of Apache Spark, including performance tuning techniques.
- Experience with integration of Databricks with cloud storage, particularly S3.
- Familiarity with DevOps principles and tools, including Terraform and CI/CD practices.
- 14+ years of relevant professional experience.
Preferred Qualifications:
- Experience with Unity Catalog for data governance and management.
- Familiarity with AI/ML workloads, including MLflow.
- Knowledge of Lakehouse architecture principles.
- Proficiency in programming languages such as Python, SQL, and Scala.
This role offers a competitive salary and the opportunity to work with a leading state agency on critical data initiatives. If you are a skilled Databricks Administrator looking for a challenging and rewarding remote opportunity, we encourage you to apply.
Special Requirements
Remote
Compensation & Location
Salary: $100,000 – $150,000 per year (Estimated)
Location: Austin, TX
Recruiter / Company – Contact Information
Email: arecruiter312@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
arecruiter312@gmail.com with the subject:
DELETE_JOB_ID_8097