Role Overview

As a Lead Snowflake Data Engineer, you will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for crossfunctional teams. You will support the software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

Key Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / nonfunctional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
• Lead and mentor both onshore and offshore development teams, creating a collaborative environment.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, DBT, Python, AWS, and Big Data tools.
• Development of ELT processes to ensure the timely delivery of required data for customers.
• Implement Data Quality measures to ensure accuracy, consistency, and integrity of data.
• Design, implement, and maintain data models that can support the organization's data storage and analysis needs.
• Deliver technical and functional specifications to support data governance and knowledge sharing.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or equivalent combination of relevant work experience and education.
• 6+ years of experience delivering consulting services to medium and large enterprises. Implementations must have included a combination of the following experiences:
  • Data Warehousing or Big Data consulting for midtolargesized organizations.
• Strong experience with Snowflake and Data Warehouse architecture.
• Understanding of Data Vault Methodology.
• Strong analytical skills with a thorough understanding of how to interpret customer business needs and translate those into a data architecture.
• SnowPro Core certification is highly desired.
• Handson experience with Python (Pandas, Dataframes, Functions).
• Handson experience with SQL (Stored Procedures, functions), including debugging, performance optimization, and database design.
• Strong Experience with Apache Airflow and API integrations.
• Solid experience in any one of the ETL/ELT tools (DBT, Coalesce, Wherescape, Mulesoft, Matillion, Talend, Informatica, SAP BODS, DataStage, Dell Boomi, etc.).

Preferred Skills

• Experience in Docker, DBT, data replication tools (SLT, Fivetran, Airbyte, HVR, Qlik, etc), Shell Scripting, Linux commands, AWS S3, or Big data technologies.
• Strong project management, problemsolving, and troubleshooting skills with the ability to exercise mature judgment.
• Enthusiastic, professional, and confident team player with a strong focus on customer success who can present effectively even under adverse conditions.
• Strong presentation and communication skills.