Job ID: JOB_ID_4044
Role Overview
We are seeking a Senior Data Engineer to support data product and data integration initiatives. The role involves designing, developing and maintaining scalable data pipelines and applications within the Hadoop ecosystem and streaming platforms. The engineer will work in an Agile team environment (two-week sprints) to build and maintain consumer and production data applications and streaming solutions.
Must-Have Technical Skills
Big Data & Hadoop Ecosystem:
- Hive, Oozie, Yarn, Impala, HDFS, HBase / Hue, Beeline
Programming:
- Python (PySpark) – Python 2.7 / 3.x, Shell scripting, Core Java
Data Processing & Streaming:
- Apache Spark (Core & SQL), Kafka / Confluent
Development Tools:
- IntelliJ with SBT or Maven, GitHub, Jenkins, UDeploy, Artifactory
Collaboration & ITSM Tools:
- Jira, Confluence, ServiceNow
Nice to Have
- CA7 scheduler experience
- Banking or financial services industry experience
Key Responsibilities
- Develop and maintain data pipelines within the Hadoop ecosystem
- Build consumer and production data applications
- Implement streaming data solutions using Kafka
- Develop scalable Spark and PySpark data processing pipelines
- Collaborate with cross-functional teams in Agile sprint cycles
- Troubleshoot and optimize big data processing workflows
Soft Skills
- Strong communication skills
- Team-oriented mindset
- Ability to collaborate effectively in Agile environments
Education
- Bachelors degree required (Computer Science or related field).
Additional Details
- Contract position with potential for extension
- Banking experience preferred but not required
Interview Process
- 1-hour panel interview with the Hiring Manager and Team Lead (in-person).
Special Requirements
Onsite 5 days/week. Interview Process: 1-hour panel interview with the Hiring Manager and Team Lead (in-person).
Compensation & Location
Salary: $100,000 – $150,000 per year (Estimated)
Location: Strongsville, OH
Recruiter / Company – Contact Information
Recruiter / Employer: Tek Inspirations LLC
Email: sh.singh@tekinspirations.com
Recruiter Notice:
To remove this job posting, please send an email from
sh.singh@tekinspirations.com with the subject:
DELETE_JOB_ID_4044