Data Engineer
Posted on February 26, 2025
Job Description
- Job Description: Data Engineer
- Overview:
- We are seeking a highly skilled and motivated Data Engineer (4-8 years of experience) to join our dynamic team. The ideal candidate will possess advanced technical expertise in Python programming and relational databases, along with a strong foundation in data modeling, data transformation, and processing of both structured and unstructured data. This role requires a proactive individual who can contribute to feature development and problem-solving within a collaborative environment.
- Responsibilities:
- • Design, develop, and maintain scalable data pipelines and systems.
- • Transform and process large datasets from various sources, ensuring data integrity and quality.
- • Optimize and build efficient queries for data retrieval and manipulation.
- • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- • Implement data models and structures to support business intelligence and analytics.
- • Utilize advanced Python programming techniques and libraries to solve complex data problems.
- • Leverage relational databases and ORMs to manage and interact with data effectively.
- Technical Skills:
- Python Programming Language:
- • Level: Advanced
- • Key Concepts: Multi-threading, Multi-Processing, Regular Expressions, Exception Handling, etc.
- • Libraries: Pandas, Numpy etc.
- Data Modelling and Data Transformation:
- • Level: Advanced
- • Key Areas: Data processing on structured and unstructured data.
- Relational Databases:
- • Level: Advanced
- • Key Areas: Query Optimization, Query Building, Experience with ORMs like SQLAlchemy, Exposure to databases such as MSSQL, Postgres, Oracle, etc.
- Functional and Object-Oriented Programming (OOPS):
- • Level: Intermediate
- Problem Solving for Feature Development:
- • Level: Intermediate
- • Good experience working with AWS Cloud and it’s services related to Data engineering like Athena, AWS batch jobs etc.
- Qualifications:
- • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- • Proven experience as a Data Engineer or in a similar role.
- • Strong analytical and problem-solving skills.
- • Excellent communication and teamwork abilities.
- • Ability to work in a fast-paced, agile environment.
Required Skills
aws cloud
python