Job ID: 3188179
About the Role
We are seeking a highly skilled and experienced Senior Java Big Data Engineer with a strong background in AWS to join our dynamic team. This is an exciting opportunity to work on cutting-edge big data solutions and contribute to critical projects. The ideal candidate will possess a deep understanding of Java, Scala, Python, and various big data technologies, coupled with extensive cloud expertise in AWS.
Key Responsibilities
- Design, develop, and maintain robust and scalable big data pipelines using Java, Scala, and Python.
- Implement and optimize batch and streaming data processing solutions.
- Leverage expertise in Apache Spark, Kafka, and the Hadoop Ecosystem for data ingestion, processing, and storage.
- Develop and deploy microservices and RESTful APIs using Spring Boot.
- Utilize Docker and Kubernetes (ECS, EKS) for containerization and orchestration.
- Build and manage cloud infrastructure on AWS, including services like S3, EMR, SQS, SNS, ECS, EC2, Lambda, and CodeCommit.
- Work with both SQL (MySQL, PostgreSQL) and NoSQL (HBase, Cassandra, Redis) databases.
- Apply strong knowledge of Object-Oriented Design, Design Patterns, and Concurrency & Multithreading principles.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Troubleshoot and resolve issues in development, test, and production environments.
- Ensure code quality through rigorous testing and adherence to best practices.
Required Skills and Qualifications
- Proven experience as a Senior Java Engineer with a focus on Big Data technologies.
- Strong hands-on experience in Java, Scala, and Python.
- Expertise in Data Structures, Object-Oriented Design, and Design Patterns.
- Extensive experience with Apache Spark, Kafka, and Hadoop Ecosystem.
- Strong knowledge of Spring Boot and RESTful Web Services.
- Experience building and optimizing batch & streaming data pipelines.
- Hands-on experience with Docker and Kubernetes (ECS, EKS).
- Proficiency in AWS services such as S3, EMR, SQS, SNS, ECS, EC2, Lambda, and CodeCommit.
- Strong experience with SQL databases (MySQL, PostgreSQL).
- Experience with NoSQL databases (HBase, Cassandra, Redis).
- Solid understanding of Concurrency & Multithreading principles.
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork abilities.
Additional Information
This role requires candidates who are ex-Capital One employees. Please ensure you meet this specific requirement before applying.
Special Requirements
Only Ex-Capital One Employees Will Be Considered
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: McLean, VA
Recruiter / Company – Contact Information
Recruiter / Employer: Quiddity Infotech
Email: arjun@quiddityinfotech.com
Recruiter Notice:
To remove this job posting, please send an email from
arjun@quiddityinfotech.com with the subject:
DELETE_3188179