Job ID: JOB_ID_3876
Job Overview
We are seeking a skilled Data Engineer to join our team and contribute to our client’s data initiatives within the healthcare sector. This role involves building and managing efficient ETL pipelines, working with large datasets, and leveraging cloud technologies. The position requires a strong understanding of data warehousing, data processing, and data distribution requirements.
Key Responsibilities
- Proficiently use Python and SQL for data manipulation and analysis.
- Build and manage efficient ETL pipelines using Databricks workflows or other orchestration frameworks.
- Work with both structured and semi-structured data, ingesting and processing it using PySpark.
- Utilize fundamental AWS services (S3, SQS) or similar cloud services.
- Implement solutions using Terraform and GitLab CI/CD.
- Perform query tuning and performance optimization in SQL and/or SparkSQL.
- Gain familiarity with data warehousing concepts and tools like Snowflake.
- Leverage Spark SQL for data processing and analysis.
- Experience working for a cloud-based data services provider to large healthcare clients is essential.
- Experience with FHIR is a plus.
- Collaborate with clients and implementation teams to understand data distribution requirements.
- Perform data analysis and data mapping to produce client output.
- Build and optimize data distribution extracts and scripts.
Required Skills and Experience
- 15+ years of total experience.
- Proficiency in Python and SQL.
- Experience with ETL pipeline development (Databricks, Airflow, etc.).
- Strong understanding of PySpark for data processing.
- Familiarity with cloud services (AWS S3, SQS or equivalent).
- Experience with Infrastructure as Code (Terraform) and CI/CD (GitLab).
- SQL and SparkSQL query optimization skills.
- Knowledge of data warehousing solutions (Snowflake preferred).
- Experience in the healthcare industry, specifically with cloud-based data services for healthcare clients.
- FHIR experience is highly desirable.
Additional Information
- This is a hybrid role requiring 2 days onsite in Dallas, TX.
- An onsite interview is mandatory.
- Resumes must be from candidates located in Texas.
Special Requirements
Onsite Interview is must in Dallas TX. Need Resumes only from Texas. Healthcare Experience is Mandatory.
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Dallas, TX
Recruiter / Company – Contact Information
Recruiter / Employer: Agile Enterprise Solutions Inc.
Email: im@aesincus.com
Recruiter Notice:
To remove this job posting, please send an email from
im@aesincus.com with the subject:
DELETE_JOB_ID_3876