Java / Kafka Consultant

Posted on March 21, 2025

Apply Now

Job Description

  • Position: Java / Kafka Consultant
  • Experience: 7+ Y
  • Duration: 6+ months contract
  • JD
  • We are looking for a Java / Kafka Consultant with four years of experience in setting up Kafka-based big data solutions using Kafka, Spark, and Scala.
  • If you have candidates, please let me know. Please go through the JD below:
  • Role Description:
  • The role requires a minimum of four years of experience in setting up Kafka-based big data solutions using Kafka, Spark, and Scala.
  • Strong expertise in Kafka architecture and managing single and multi-node Kafka clusters on VMs, Docker, and Kubernetes is essential.
  • Experience with Confluent Platform is a must, along with a deep understanding of Kafka Producer/Consumer APIs, Stream Processing, and KSQL.
  • Responsibilities include platform monitoring, creating key performance metrics, and maintaining cluster health, utilization, and performance.
  • The role involves capacity planning, upgrading hardware/software, and automating administration tasks using tools like Terraform, Ansible, and CI/CD pipelines.
  • Security configurations such as SSL encryption, SASL LDAP authentication, and Kafka ACL-based authorization must be implemented.
  • Hands-on experience in public cloud environments such as Azure, AWS, or GCP is preferred.
  • The candidate should be available for on-call support, shift work, and occasional weekend availability as required.
  • Strong communication, troubleshooting, and documentation skills are necessary, along with the ability to conduct knowledge transfer sessions.
  • Preferred qualifications include Confluent Kafka certification, cloud certifications (e.g., Azure), and experience with microservices, REST APIs, and containerization.

Required Skills

kafka spark and scala. vms docker and kubernetes microservices