Data Engineer
Posted on March 21, 2025
Job Description
- Job Description
- Role: Data Engineer
- What you will need
- 5-7 years of experience in Solution, Design and Development of Cloud based data
- models, ETL Pipelines and infrastructure for reporting, analytics, and data science.
- Experience working with Spark, Hive, HDFS, MR, Apache Kafka/AWS Kinesis.
- Experience with version control tools (Git, Subversion).
- Experience using automated build systems (CI/CD).
- Experience working in different programming languages (Java, python, Scala)
- Experience working with both structured and unstructured data.
- Strong proficiency with SQL and its variation among popular databases.
- Ability to create the data model from scratch.
- Experience with some of the modern relational databases.
- Skilled at optimizing large complicated SQL statements.
- Knowledge of best practices when dealing with relational databases.
- Capable of configuring popular database engines and orchestrating clusters as necessary.
Required Skills
spark
hive
hdfs
mr
apache kafka/aws kinesis.