Job ID: JOB_ID_2498
Position Overview
We are looking for a seasoned GCP Data Engineer to join our team in Concord, CA. This is a critical onsite role focused on the architecture, design, and implementation of scalable data solutions on the Google Cloud Platform. The successful candidate will play a pivotal role in our organization’s data modernization journey, leading the migration of legacy on-premises workloads from systems like Teradata and Hadoop to a modern, cloud-native environment. This position requires a deep technical understanding of data engineering principles, cloud architecture, and the ability to build reusable frameworks that accelerate development across the enterprise.
Primary Responsibilities
- Architect and design robust, cost-effective data solutions on GCP that serve as the target architecture for all migrated and new data workloads.
- Develop and maintain reusable data engineering frameworks, templates, and accelerators to standardize ingestion, transformation, and validation processes.
- Lead the hands-on migration of data and ETL processes from legacy systems (Teradata, Hadoop) to GCP services, including BigQuery, Google Cloud Storage (GCS), Dataflow, and Dataproc.
- Analyze and deconstruct complex legacy ETL logic from tools like Informatica and Teradata BTEQ, translating them into modern, Python-based cloud pipelines.
- Build and automate batch and streaming data pipelines using Python, SQL, and GCP’s core data services.
- Proactively optimize BigQuery performance through advanced partitioning, clustering, and query tuning strategies to ensure high performance and cost efficiency.
- Implement comprehensive data validation and governance frameworks to ensure data integrity, security, and lineage using Google Cloud Data Catalog and Dataplex.
- Collaborate with business analysts, data scientists, and other stakeholders to understand data requirements and deliver high-quality data products.
- Act as a subject matter expert and mentor for GCP technologies, providing guidance and best practices to the broader engineering team.
- Design and implement event-driven architectures using Pub/Sub and Cloud Functions for real-time data processing.
Required Qualifications
- At least 5 years of professional experience in a data engineering role, with a proven history of building and maintaining large-scale data systems.
- Extensive experience in designing and promoting the adoption of reusable data engineering frameworks for ingestion and validation.
- Deep, hands-on expertise in at least one major on-premises data ecosystem: Teradata (BTEQ, TPT, SQL) or Hadoop (HDFS, Hive, PySpark).
- Demonstrable experience with enterprise ETL tools, specifically Informatica PowerCenter.
- Advanced proficiency in Google Cloud Platform data services, including BigQuery, GCS, Dataflow, and Dataproc.
- Experience with workflow orchestration tools, particularly Cloud Composer (Managed Airflow).
- Expert-level SQL skills, including complex joins, window functions, and performance optimization across different database engines.
- Strong programming skills in Python, with a focus on software engineering best practices such as modularity, testing, and documentation.
- Familiarity with Google’s migration assessment and database migration tools.
- Solid understanding of data warehousing concepts, ETL/ELT patterns, and data modeling techniques.
Preferred Qualifications
- Direct experience successfully completing at least one large-scale migration from on-premises to GCP.
- Google Cloud Professional Data Engineer certification is highly preferred.
- Experience with data visualization tools and integrating data pipelines with BI platforms.
- Knowledge of CI/CD for data engineering and infrastructure as code (Terraform).
- Excellent analytical and problem-solving abilities with a strong attention to detail.
Special Requirements
Visa constraints: Need Only H4EAD, E3VISA, L2S Visa, US Citizen and TN Visa. Interview/Work mode: Onsite in Concord, CA.
Compensation & Location
Salary: $155,000 – $210,000 per year (Estimated)
Location: Concord, CA
Recruiter / Company – Contact Information
Recruiter / Employer: Arkhyatech
Email: karthick@arkhyatech.com
Recruiter Notice:
To remove this job posting, please send an email from
karthick@arkhyatech.com with the subject:
DELETE_JOB_ID_2498