Data Engineer (PySpark, SparkSQL, REST API, Azure)

Posted on May 26, 2025

Apply Now

Job Description

  • *job Title* : Data Engineer (PySpark, SparkSQL, REST API, Azure)
  • *Location* : Remote
  • *Exp* : 6-8 Years
  • *Required Qualifications:* Bachelor�s or Master�s degree in Computer Science, Engineering, Information Systems, or related field. 6+ years of hands-on experience in data engineering roles. Strong proficiency in PySpark and SparkSQL for building data transformation workflows. Experience in building and consuming REST APIs using Python (FastAPI, Flask) or similar frameworks. Proven expertise in Microsoft Azure ecosystem, particularly Azure Data Factory, Azure Synapse, and Data Lake Storage. Experience with version control (e.g., Git) and CI/CD pipelines. Strong understanding of ETL/ELT concepts and data warehousing principles. Excellent problem-solving, communication, and collaboration skills. Preferred Qualifications: Experience with containerization tools (Docker, Kubernetes). Familiarity with DevOps practices and Infrastructure as Code (e.g., Terraform, ARM templates). Knowledge of security best practices for data in Azure. Experience with real-time data processing (e.g., Kafka, Event Hubs).

Required Skills

pyspark sparksql rest api azure