Senior Data Engineer

Posted on May 28, 2025

Apply Now

Job Description

  • Need Senior Data Engineer - 7+ years of experience in Data Engineering on Microsoft cloud platform.(Basic MDM knowledge)
  • India (Remote)
  • Responsibilities:
  • Create efficient data pipelines with reusability, work with product owners and stakeholders to design, develop, and implement data supply chains in enterprise data warehouse environment using Microsoft Azure, ADF, Python, Pyspark, Spark SQL and Databricks environment.
  • Ensure data quality, reliability of data, and orchestration of data pipelines, CI/CD implementation, performance and optimization of data pipelines to ensure efficiency.
  • Collaborate with cross-functional teams to integrate data sources and optimize data pipelines. Provide technical expertise and support for Azure Databricks-related projects.
  • Qualification:
  • Follow technical best practices and coding standards, job orchestration & monitoring, produce the mandatory artifacts.
  • Prior experience with data lakes and data warehouses, working knowledge with dimensional modelling is must.
  • Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines, data management methods.
  • Advanced Pyspark, Python, Spark SQL, Dimensional models, optimization in Azure data bricks skills required.
  • Ability to service various business stakeholders, internal and external partners to support data demands.
  • Health care experience is desired with a data-centric motive is a plus.
  • 7+ years of experience in data engineering with Azure data bricks ecosystem.
  • Strong knowledge of Azure data services, including ADF, Databricks, Delta Lake, delta live tables, Power BI, and Azure SQL Server.
  • Experience with data processing languages such as SQL, Python, Pyspark and Spark SQL

Required Skills

�strong knowledge of azure data services including adf databricks delta lake delta live tables power bi and azure sql server. �experience with data processing languages such as sql python pyspark and spark sql