AWS certified Data engineer

Posted on March 18, 2025

Apply Now

Job Description

  • Role: AWS certified Data engineer
  • Contract: 1 Years
  • Location: Remote
  • Exp- 6+ Years
  • Mandate Skills:-
  • AWS RDS
  • Glue
  • Step functions
  • Lambda
  • Redshift
  • S3
  • PowerBI
  • Job Title: Data Engineer (Nifi, Glue, Airflow)
  • Location: Remote
  • Job Type: 6 months contract (extendable)
  • Experience Required:
  • 4+ years in developing and configuring workflows on Apache Nifi, including AWS-related connectors.
  • 3+ years in Apache Airflow, including writing jobs/DAGs/tasks using Python and experience with HTTP, S3, and Database operators.
  • Experience with AWS Step Functions, Glue, and Athena is a must.
  • Strong proficiency in Python.
  • Experience with Apache Spark (good to have).
  • Experience with PowerBI (a plus).
  • Workflow optimization experience in Nifi, Glue jobs, and query optimization.
  • Job Description:
  • We are seeking an experienced Data Engineer specializing in Apache Nifi, AWS Glue, and Airflow to join our team. The ideal candidate will have a strong background in developing and optimizing workflows, with a focus on using AWS technologies and Python. This is a remote position, with the potential for contract extension.
  • Roles and Responsibilities:
  • Apache Nifi Workflows: Develop, configure, and optimize workflows using Apache Nifi, focusing on AWS-related connectors.
  • Apache Airflow DAGs: Write, configure, and manage Airflow DAGs/jobs using Python, including scheduling, monitoring, and alerting for various tasks.
  • AWS Step Functions & Glue: Implement and optimize workflows using AWS Step Functions, Glue, and Athena to streamline data processing.
  • Python Development: Write and maintain Python scripts for various data engineering tasks, ensuring code quality and performance.
  • Data Processing Optimization: Optimize Nifi workflows, Glue jobs, and database queries to enhance performance and reduce costs.
  • Spark and PowerBI (Optional): Work with Apache Spark for large-scale data processing (preferred) and PowerBI for data visualization (a plus).
  • Collaboration: Work closely with other engineers, data scientists, and stakeholders to ensure smooth project execution.
  • Required Skills:
  • Must-Have:
  • 4+ years of experience with Apache Nifi, including AWS-related connectors.
  • 3+ years of experience with Apache Airflow, including writing DAGs/jobs in Python.
  • Experience with AWS Step Functions, Glue, and Athena.
  • Strong Python programming skills.
  • Good to Have:
  • Experience with Apache Spark.
  • Experience with PowerBI.
  • Optimization Expertise: Demonstrated ability to optimize workflows and queries for performance and efficiency.
  • Work Environment:
  • Location: Remote

Required Skills

No specific skills listed.