Sr.Data Engineer/Architect

Posted on May 23, 2025

Apply Now

Job Description

  • We are looking out for Sr.Data Engineer/Architect.This is a immediate replacement requirement.Requesting your support over here.
  • Role: Sr.Data Engineer/Architect
  • Years of Exp: 7 to 9 Years
  • Skillsets: Python,SQL,Pyspark,AWS,DuckDB
  • Shift-UK Shift
  • Work Mode: Work From Home-Candidate have to visit Chennai office for 2 days on induction process.
  • NP: Immediate Joiners-Available to join within a week.
  • Job Description
  • Responsibilities:
  • Collaborate with cross-functional teams (domain experts, stakeholders) to gather requirements and ensure data pipelines meet business needs.
  • Design, build, and maintain end-to-end data pipelines to ingest, process, transform, and deliver high-quality data.
  • Optimize existing pipelines for performance, scalability, and reliability.
  • Refactor and modularize code to improve readability, testability, and maintainability.
  • Implement validation, testing, and monitoring for data pipelines to ensure data quality and integrity.
  • Document technical workflows, transformations, and business rules for transparency and maintainability.
  • Participate in code reviews.
  • Manage codebase versioning and collaboration using tools like GitLab, ensuring smooth integration across development branches.
  • Key Technologies & Tools:
  • Languages: Python, SQL
  • Databases: DuckDB, PostgreSQL, or other SQL-based systems
  • Version Control: Git (e.g., GitHub, GitLab)
  • Tools: VS Code
  • Optional: Solvebio Library(EDP)
  • Qualifications:
  • Proven experience in building and maintaining data pipelines using Python and SQL.
  • Solid understanding of ETL/ELT workflows and performance tuning.
  • Experience working with DuckDB or similar in-process databases is a strong plus.
  • Strong analytical and problem-solving skills
  • Ability to write clean, reusable, and efficient code.

Required Skills

python sql pyspark aws duckdb