Job ID: JOB_ID_2244
Role Overview
TechClub Inc. is seeking a highly skilled Senior Big Data Engineer to join our team for a long-term engagement in Dublin, OH. This onsite role is critical for re-architecting and optimizing our production data pipelines to meet evolving business requirements. The ideal candidate will possess over 8 years of experience in engineering Big Data systems, with a specific focus on Google Cloud Platform (GCP) and data integration frameworks. You will be responsible for designing and building robust, scalable data pipelines from ingestion to consumption within a hybrid big data architecture.
Key Responsibilities
- Re-write and optimize existing data pipelines to support high-volume business needs using Java, Python, and GCP native tools.
- Design and implement production-grade data pipelines using GCP Dataflow, Cloud Fusion, and Airflow for orchestration.
- Develop and maintain Collibra Workflows using Java to ensure enterprise-level data governance and metadata management.
- Implement data transformation, curation, and ingestion functions on GCP cloud, leveraging both native services and custom programming.
- Perform performance tuning and cost optimization for large-scale data lakes and BigQuery environments.
- Ensure all technical specifications are aligned with business objectives and technical design standards.
- Partner with external consultants and managed services organizations to enable product solution development.
- Track project progress, identify technical risks, and communicate status updates to leadership.
- Develop best practices for solution frameworks, including standard naming conventions, scripting, and coding practices.
- Ensure platforms and tools meet or exceed data security standards, including preparation for internal and external audits.
Technical Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 8-10 years of engineering experience in Big Data systems and Data Integration.
- At least 2 years of hands-on experience with GCP Data Engineering and Cloud Analytics solutions.
- 5+ years of experience with Python and Java, including frameworks like Spring Boot and Spring MVC.
- Expertise in REST API development and CI/CD pipelines (Concourse, Jenkins).
- Proficiency in GCP data stores, specifically BigQuery, and experience with Terraform for infrastructure management.
- Knowledge of metadata management and data governance tools like Collibra or Atscale is highly preferred.
- Google Cloud Platform certification is a significant advantage.
Special Requirements
Onsite requirement in Dublin, OH; Long-term duration.
Compensation & Location
Salary: $145,000 – $195,000 per year
Location: Dublin, OH
Recruiter / Company – Contact Information
Recruiter / Employer: TechClub Inc.
Email: raja@techclubinc.com
Recruiter Notice:
To remove this job posting, please send an email from
raja@techclubinc.com with the subject:
DELETE_JOB_ID_2244