Spark developer

Posted on February 10, 2025

Apply Now

Job Description

  • *Location-Bkc complex,Mumbai*
  • *7-8 years experience is ideal as a Spark Developer*
  • Flink and Kudu streaming
  • Informatica workflow migration
  • Automation of workflows CI/CD
  • Nifi streaming and transformation
  • Experience with Airflow or other workflow engines.
  • Project/scope description Job Description/Scope:
  • Spark development with batch and streaming experience
  • Experience with Pyspark and Data Engineering
  • ETL implementation and migration to spark
  • Programming knowledge on scala, java & python
  • Experience with kafka and Spark streaming (Dstream and Structured Streaming)
  • Experience with using Jupyter notebooks or any other developer tool

Required Skills

python java pyspark