GCP Data Engineer

Posted on April 28, 2025

Apply Now

Job Description

  • We are looking out for GCP Data Engineer contract profiles for one of our project .
  • 1.GCP Data Engineer
  • Years of Exp:5-6 Yrs
  • Location-Remote-Mandate to be here at Chennai office for 1 week of onboarding
  • No.of.Positions-1
  • Job Description
  • Data modelling experience is a must
  • Handson experience in GCP stack is a must have
  • Drive strategic problem solving in conjunction with Account Team
  • Design, review and deliver fool-proof frameworks for Big data in spark/Pyspark, handling for Data analytics platform at a petabyte scale.
  • Understand business requirements, design a feasible technical solution that addresses the current business need, but does not impact the ability to upgrade in the future, within the project timelines.
  • Programming Side:
  • Having strong programming experience in Data Engineering using Python or Java.
  • Other Responsibilities:
  • Has worked on GCP and is hands on with data analysis on GCP tools like dataproc Data flow, Composer, BigQuery.
  • Extensive experience with a variety of RDBMS and No SQL Databases.
  • Experience in building or maintaining ETL processes from a wide variety of data sources using SQL.
  • Experience building and optimizing �big data� data pipelines in spark/Pyspark, architectures, and data sets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Able to identify data quality issues and has worked with creating a framework to resolve data quality issues.
  • GCP Service Details
  • Ingest Services
  • Kubernetes Engine
  • Pub/Sub
  • Stack Driver Logging
  • Storage Services:
  • GCS
  • RDBMS: Cloud SQL or Cloud Spanner
  • NoSQL: Bigtable
  • Analytical Database: Big Query
  • Process and Analysis Services:
  • Cloud Dataflow (streaming/batch)
  • Airflow
  • � Dataproc

Required Skills

spark/pyspark architectures and data sets.