Job ID: 1447
Role Overview: Kafka Administrator (Onsite NYC)
We are seeking a highly skilled and dedicated Kafka Administrator to join our enterprise infrastructure team in New York City. This is a critical onsite position focused on the robust management, scaling, and optimization of our distributed streaming platform. As a Kafka Admin, you will be the backbone of our real-time data architecture, ensuring that high-volume data pipelines remain resilient, secure, and performant. This role is strictly for experienced Administrators; candidates with a primary background in development without deep infrastructure management experience will not be considered for this specific requirement.
Core Responsibilities and Technical Duties
- Infrastructure Design and Management: You will be responsible for designing, developing, and managing complex Kafka-based data pipelines that serve as the central nervous system for our data-driven applications. This includes cluster sizing, broker configuration, and ensuring high availability across multiple zones.
- Ecosystem Integration: Work seamlessly with other big data technologies including Hadoop, Spark, and Storm to facilitate end-to-end data processing and analytics. You will ensure that Kafka integrates efficiently with these downstream and upstream systems.
- Performance Optimization: Continuously monitor Kafka clusters to identify bottlenecks. You will implement optimization strategies for partition management, replication factors, and retention policies to maintain peak performance under heavy loads.
- Advanced Troubleshooting: Act as the primary point of contact for 3rd level administrator support. You will diagnose and resolve complex Kafka-related issues, including consumer lag, broker failures, and network latency problems within the infrastructure.
- Security and Compliance: Maintain the security posture of the Kafka environment by implementing SSL/TLS encryption, SASL authentication, and fine-grained ACLs to protect sensitive data in transit and at rest.
- Automation and Scripting: Create and manage Kafka topics, producers, and consumers. You will utilize Python-based scripting to develop automation tools for infrastructure provisioning, health checks, and efficient data processing workflows.
Operational Excellence and Support
- 24/7 Rotational Support: This role requires a commitment to operational excellence, including participation in a rotational service guard period to ensure 24/7 support availability. You must be prepared to handle critical incidents outside of standard business hours.
- Customer Support: Directly handle customer queries and provide technical guidance to internal teams utilizing the Kafka platform. You will ensure that support is available during agreed business hours to maintain project timelines.
- Infrastructure Automation: Focus on ‘Infrastructure as Code’ by developing and maintaining automation scripts that streamline the deployment and scaling of Kafka components, reducing manual intervention and human error.
Professional Requirements
The ideal candidate must possess a deep understanding of distributed systems and have a proven track record in managing large-scale Kafka deployments in a production environment. You should be comfortable working onsite in New York City and collaborating with cross-functional teams in a fast-paced, high-stakes setting. Strong communication skills are essential for translating technical issues into actionable business insights and for providing high-quality support to our internal stakeholders.
Special Requirements
H1B candidates only; Kafka Admin experience required (no developers); Onsite NYC; 24/7 rotational support availability.
Compensation & Location
Salary: $124,800 – $135,000 per year
Location: New York, NY
Recruiter / Company – Contact Information
Recruiter / Employer: Tanisha Systems Inc.
Email: piyush10.tri@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
piyush10.tri@gmail.com with the subject:
DELETE_1447