Data Eng Developer

Posted on April 10, 2025

Apply Now

Job Description

  • Data Eng Developer
  • 4+ yr
  • below JD
  • 4+ years of relevant professional experience, preferably in data engineering, data pipeline development, and data science workflows, in a Linux environment.
  • Strong knowledge of SQL and NoSQL databases, including Azure SQL, PostgreSQL/MySQL, and MongoDB or similar.
  • Proficiency with at least two programming languages among Python, Scala, Java, or Go, with the flexibility to quickly learn additional languages.
  • Hands-on experience working with RESTful APIs and services, preferably using Node.js, Django, or similar frameworks.
  • Demonstrated expertise in containerization technologies such as Docker and Kubernetes.
  • Solid understanding and practical experience with orchestration and automation tools like Airflow or Dataiku.
  • Experience in developing, deploying, and maintaining AI workflows, including computer vision/image processing, NLP, and data categorization models.
  • Proficiency in using DevOps tools and practices, including Git, CI/CD tools, automated unit testing, and GitHub Copilot or similar AI-assisted coding tools (e.g., ChatGPT).
  • Experience building scalable data architectures with reference tables and automated AI-driven updating mechanisms.
  • Familiarity with Hadoop, Spark, Kafka, and streaming data platforms and technologies.
  • Knowledge of healthcare data standards such as HL7, and familiarity with integration tools like Mirth is a significant plus.
  • Strong knowledge of Azure cloud data services, including Azure Databricks, Azure Fabric, Azure Data Factory, serverless computing, virtual machines, and cloud security.
  • Strong knowledge of data visualization tools such as Power BI or Tableau.
  • Strong knowledge of data structures, data formats, algorithms, and object-oriented design and practical experience with data serialization and storage formats such as Parquet, Avro, JSON, or ORC.
  • Experience working within Agile methodologies and tools, specifically JIRA, is highly desirable.

Required Skills

sql and nosql databases including azure sql postgresql/mysql and mongodb or similar.