Job ID: JOB_ID_3835
Job Description:
We are looking for a Data Engineer with experience in healthcare, specifically with Medicare and Medicaid. This is a remote position, and local candidates from Texas are highly appreciated. The role involves optimizing the performance of data extract scripts, building and managing efficient ETL pipelines using Databricks workflows or other orchestration frameworks, and working with both structured and semi-structured data using PySpark. Familiarity with fundamental AWS services (S3, SQS) or similar cloud services, Terraform, and GitLab CICD is required. The candidate will also be responsible for query tuning and performance optimization in SQL and/or SparkSQL. Experience with data warehousing (Snowflake or similar) and FHIR experience are highly desirable.
Key Responsibilities:
- Optimize the performance of data extract scripts.
- Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
- Work with clients and implementation teams to understand data distribution requirements.
- Perform data analysis and data mapping required to produce client output.
- Build data distribution extracts and scripts.
Technical Skills:
- Proficient with Python and SQL.
- Familiarity with both structured and semi-structured data and ingesting and processing this data using PySpark.
- Fundamental AWS services (S3, SQS) or similar services for other clouds.
- Terraform and GitLab CICD.
- Query tuning and performance optimization in SQL and/or SparkSQL.
- Familiarity with data warehousing (Snowflake or similar).
- Spark SQL.
- AWS, PySpark, Databricks, Snowflake.
- FHIR experience.
Additional Information:
- Experience working for a cloud-based data services provider to large healthcare clients.
- Texas Local Candidates are highly appreciated.
Special Requirements
Remote, Healthcare experience required, Texas Local Candidates preferred.
Compensation & Location
Salary: $110,000 – $150,000 per year (Estimated)
Location: Remote
Recruiter / Company – Contact Information
Recruiter / Employer: Agile Enterprise Solutions Inc
Email: shaik_navi@aesincus.com
Recruiter Notice:
To remove this job posting, please send an email from
shaik_navi@aesincus.com with the subject:
DELETE_JOB_ID_3835