Senior Data Engineer
Posted on March 4, 2025
Job Description
- Position -Senior Data Engineer (PostgreSQL, ETL, Airflow, Python)
- Remote -Full-Time
- Experience: 10+ Year�s
- Time zone: IST
- Company Details
- We are a leading provider of Business Intelligence in Innovation, Research & Development . Our platform
- helps enterprises uncover trends, track technology, and analyze competitors � easier, faster, and smarter.
- Role Description
- As a Senior Data Engineer , you�ll play a key role in optimizing our PostgreSQL-heavy data infrastructure
- and scaling ETL pipelines . Your responsibilities include:
- Optimizing PostgreSQL databases � Performance tuning, indexing, and query optimization.
- Building and maintaining ETL pipelines � Ensuring scalability and efficiency.
- Enhancing data integrity and accessibility � Improving system reliability.
- Automating workflows with Python & Airflow � Streamlining data operations.
- Driving best practices � Guiding the team on data engineering excellence.
- Skills Required
- PostgreSQL Expert � Performance tuning, indexing, execution plans, query optimization.
- ETL Pipelines � 3+ years of hands-on experience building and optimizing workflows.
- Apache Airflow � Strong experience in workflow orchestration.
- Python � Proficient in scripting and automation for data processing.
- Data Cleaning & Integration � Strong understanding of deduplication and best practices.
- Data Modeling & Optimization � Structuring and optimizing large datasets.
- Bonus Skills:
- Document Databases � Handling large-scale unstructured data.
- Microservices � Experience splitting monolithic applications.
- Testing & Monitoring � Data quality checks, unit tests for ETL pipelines.
- Graph Databases � Experience with Neo4j or similar.
- ML Integration � Feeding pipelines into ML models
- Please suggest if you have any suitable profiles
Required Skills
postgresql
etl
airflow
python