NEWPosted 1 hour ago

Job ID: JOB_ID_7845

Job Overview

We are seeking an experienced Kafka Admin/Engineer for an urgent requirement with one of our clients. This role is based in New York, NY, and requires a strong background in designing, developing, and managing Kafka-based data pipelines. The ideal candidate will have hands-on experience with other big data technologies and a proven ability to monitor, optimize, and troubleshoot Kafka clusters.

Key Responsibilities

  • Designing, developing, and managing Kafka-based data pipelines.
  • Working with other big data technologies such as Hadoop, Spark, and Storm.
  • Monitoring and optimizing Kafka clusters for performance and availability.
  • Troubleshooting Kafka-related issues and providing 3rd level administrator support.
  • Maintaining the availability, performance, and security of the Kafka infrastructure.
  • Creating and managing Kafka topics, producers, and consumers.
  • Developing Python-based Kafka consumers and producers for efficient data processing.
  • Handling customer queries and providing support.
  • Ensuring support availability during agreed business hours and rotational service guard periods (24/7).
  • Developing and maintaining automation for Kafka infrastructure.

Required Skills and Experience

  • 4-7 years of hands-on experience as a Kafka Admin.
  • Experience with designing, developing, and managing Kafka data pipelines.
  • Familiarity with big data technologies like Hadoop, Spark, and Storm.
  • Proficiency in monitoring, optimizing, and troubleshooting Kafka clusters.
  • Experience in performing 3rd level administrator support for Kafka infrastructure.
  • Skills in maintaining Kafka infrastructure availability, performance, and security.
  • Experience in creating and managing Kafka topics, producers, and consumers.
  • Experience with Python for developing Kafka consumers and producers.
  • Ability to handle customer queries and provide support.
  • Experience with 24/7 support availability and rotational service guard periods.
  • Experience in developing and maintaining automation for Kafka infrastructure.
  • Banking experience is a plus.

Work Environment

  • This is an onsite role requiring 5 days a week in the office in New York, NY.
  • A face-to-face (F2F) round of interview is mandatory.

Special Requirements

Face-to-face interview required. Onsite: 5 days a week in office.

Compensation & Location

Salary: $70,000 – $120,000 per year (Estimated)

Location: New York, NY

Recruiter / Company – Contact Information

Email: endra.s@noviainfotech.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
endra.s@noviainfotech.com with the subject:

DELETE_JOB_ID_7845

to delete@join-this.com.