Lead Data Engineer

Posted on May 21, 2025

Apply Now

Job Description

  • Lead Data Engineer
  • Duration: 3+ months
  • Working Remotely
  • Work timing: 1 PM - 9 PM IST (Some flexibility possible)
  • We are seeking an experienced Azure Data Engineer having a background in Microsoft Fabric will be plus. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines and data models using Azure Data Platform and Microsoft Fabric.
  • Key Responsibilities
  • 1. Develop, maintain, and optimize data pipelines using Microsoft Fabric, Azure Data Factory (ADF), and Azure Synapse Analytics.
  • 2. Integrate data from various sources such as Azure SQL Database, Data Lake, Blob Storage, and REST APIs.
  • 3. Design and implement scalable data models and data marts in Microsoft Fabric will be a plus.
  • 4. Build, deploy, and manage dataflows and notebooks in Fabric.
  • 5. Develop robust ETL/ELT processes for structured and unstructured data.
  • 6. Having data governance, security, and monitoring within Azure ecosystems will be a plus.
  • 7. Utilize GitHub or Azure DevOps for source control and CI/CD of Fabric assets.
  • 8. Collaborate with business stakeholders to define data requirements.
  • 9. Optimize query performance and manage Fabric datasets.
  • 10. Strong debugging skills to analyze and fix a defect in data process.
  • 11. Should be a good team player and a great collaborator
  • Minimum Qualifications:
  • 1. Demonstrated expertise with a minimum of 7+ years of experience as Data Engineer or similar role.
  • 2. Advanced SQL skills and experience with relational databases
  • 3. Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries.
  • 4. Strong exposure in writing ETL / pipeline code.
  • 5. Experience in Data collection from multiple sources and integrating based on business needs.
  • 6. Familiarity with the Azure data engineering services.
  • 7. Knowledge of Azure services viz. ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
  • Additional Experience Desired:
  • 1. Exposure to AI / ML
  • 2. Exposure to work with Big Data technologies such as Spark, Hadoop etc.
  • 3. Knowledge of Data Bricks, Snowflake, BigQuery
  • 4. Exposure to Tableau, Power BI
  • 5. Experience in Java or Scala.

Required Skills

lead data engineer