Job ID: JOB_ID_4564
Job Description: GCP Data Engineer with AI/ML Integration & MLOps
We are seeking a GCP Data Engineer with deep, hands-on architectural and development experience in Google Cloud Platform’s big data ecosystem. You will be responsible for designing, building, and optimizing a modern data lakehouse architecture. Your primary focus will be leveraging BigLake, BigQuery, Google Cloud Storage (GCS), and Vertex AI to create seamless, scalable data pipelines and machine learning integrations that drive business intelligence and predictive analytics.
Key Responsibilities:
- Lakehouse Architecture & Development: Architect and maintain a scalable data lakehouse using Google Cloud Storage (GCS) as the foundational data lake and BigLake to unify data warehouses and data lakes. Implement fine-grained security (row-level and column-level access controls) and data governance across open file formats (Parquet, Iceberg, ORC) using BigLake.
- Data Warehousing & Optimization: Design and manage complex, highly scalable data models within BigQuery. Perform deep performance tuning and cost optimization of BigQuery jobs utilizing clustering, partitioning, materialized views, and slot capacity management.
- AI/ML Integration & MLOps: Collaborate with Data Scientists to operationalize machine learning models using Vertex AI. Build robust data pipelines to feed Vertex AI Feature Store, manage model training workflows, and deploy ML models into production. Utilize BigQuery ML (BQML) for in-database predictive modeling and analytics.
Qualifications:
- Deep, hands-on architectural and development experience in Google Cloud Platforms big data ecosystem.
- Experience with BigLake, BigQuery, Google Cloud Storage (GCS), and Vertex AI.
- Experience implementing fine-grained security (row-level and column-level access controls) and data governance.
- Experience with open file formats (Parquet, Iceberg, ORC).
- Experience designing and managing complex, highly scalable data models within BigQuery.
- Experience with performance tuning and cost optimization of BigQuery jobs.
- Experience operationalizing machine learning models using Vertex AI.
- Experience building data pipelines to feed Vertex AI Feature Store.
- Experience managing model training workflows and deploying ML models into production.
- Experience with BigQuery ML (BQML) for in-database predictive modeling and analytics.
- Excellent communication and collaboration skills.
Keywords:
- Artificial Intelligence
- Machine Learning
- GCP Data Engineer
- AI ML Integration
- MLOps
- TX
Special Requirements
Interview Mode: 1 Video interview and client interview will be in person. Location: 100% onsite. Only Local to TX.
Compensation & Location
Salary: $135,200 – $156,000 per year
Location: Irving, TX
Recruiter / Company – Contact Information
Email: v.singh@digitaldhara.com
Recruiter Notice:
To remove this job posting, please send an email from
v.singh@digitaldhara.com with the subject:
DELETE_JOB_ID_4564