Job ID: JOB_ID_3914
Job Summary:
We are seeking a highly skilled and experienced Senior Kafka Engineer with a strong background in .NET development to join our team. This role involves hands-on experience in setting up, configuring, and monitoring Confluent Kafka components, developing infrastructure solutions for multi-tenant cloud services, and leveraging Microsoft Azure/Google Cloud Platform (GCP). The ideal candidate will have a robust understanding of the .NET tech stack, RESTful services, microservices architecture, and CI/CD tools.
Key Responsibilities:
- Set up and configure Confluent Kafka clusters, including brokers, ZooKeeper, Control Center, Schema Registry, and Connect clusters.
- Monitor cluster health, performance, and manage broker configurations for high availability.
- Create, delete, and configure Kafka topics, and diagnose/resolve issues related to data flow, broker failures, and consumer lag.
- Integrate Kafka with other systems and services, such as Azure/GCP services, RESTful APIs, databases, and microservices.
- Provide production support for Kafka-related issues.
- Design, develop, and maintain web applications using .NET technologies (C#) for API design and implementation.
- Implement responsive user interfaces and ensure seamless integration with backend services.
- Optimize application performance and ensure code quality through unit testing and code reviews.
- Develop and maintain cloud-based solutions leveraging platforms like Azure or GCP, including Event Hub, Logic Apps, AKS, and Azure Functions.
- Implement infrastructure as code and configuration management using relevant DevOps tools (e.g., Terraform).
- Automate deployment pipelines and manage CI/CD processes using Azure DevOps or GitHub.
- Collaborate with development and operations teams to enhance system scalability, security, and monitoring.
- Work within agile development projects and sprint delivery cycles.
- Lead offshore delivery teams and provide excellent problem-solving, communication, and documentation skills.
Technical Skills & Experience:
- Hands-on experience with Confluent Kafka setup, configuration, security, and monitoring.
- Proficiency in .NET (C#) development, API design, and implementation.
- Strong experience with Microsoft Azure or Google Cloud Platform (GCP) services (e.g., Event Hub, Logic Apps, AKS, Azure Functions).
- Experience with RESTful services, microservices architecture, and authentication/authorization best practices.
- Proficiency in SQL and PostgreSQL databases.
- Hands-on experience with CI/CD tools such as Azure DevOps and GitHub.
- Hands-on experience with Terraform scripting and building pipelines.
- Experience with monitoring tools like DynaTrace & Splunk.
- Proficiency in Kubernetes.
- Experience working in agile development projects and sprint delivery.
- Familiarity with Windows console apps and Services.
Interview Questions:
- Describe the role of ZooKeeper in Kafka.
- How do you monitor the health of a Kafka cluster?
- How do you manage topic configurations (e.g., retention, replication)?
- What steps would you take to recover from a broker failure?
- How do you handle consumer lag and rebalance consumer groups?
- Describe how you would implement a Kafka producer and consumer.
- What serialization formats have you used (e.g., Avro, Protobuf)?
- How do you integrate Kafka with external systems?
- How do you deploy Kafka clusters/connectors?
- What authentication mechanisms have you implemented in Kafka?
- How do you manage API deployment, keys, and service accounts in Confluent Cloud?
- Describe a challenging Kafka issue you resolved.
- How to implement rate limiting for REST APIs using ASP.NET Core?
- Explain Kubernetes, infrastructure as code, and Kafka.
Special Requirements
Onsite
Compensation & Location
Salary: $100,000 – $150,000 per year (Estimated)
Location: Louisville, KY
Recruiter / Company – Contact Information
Email: kumar.s@kksoftwareassociates.com
Recruiter Notice:
To remove this job posting, please send an email from
kumar.s@kksoftwareassociates.com with the subject:
DELETE_JOB_ID_3914