Data Engineer GCP

Posted on April 2, 2025

Apply Now

Job Description

  • Key Responsibilities:
  • Lead technical discussions and reviews with customers during the pre-sales stage, providing technical proposals, architecture, and estimations for new opportunities.
  • Drive architectural review discussions with customers and auditors.
  • Develop case studies on existing projects and reusable assets.
  • Manage the entire product lifecycle, from proposal to delivery, ensuring regular communication with delivery teams on architecture improvements.
  • Provide guidance on best practices for performance optimization in large-scale data warehouse (DW) projects, particularly on Petabyte-scale systems.
  • Oversee the migration of source systems like CSV, SQL, Oracle, MongoDB, SAP BW, and SAP Hana.
  • Lead performance and cost optimization efforts, assisting clients in optimizing their project costs.
  • Ensure data security protocols are in place for in-transit data, and encryption/decryption of Personally Identifiable Information (PII) data.
  • Utilize workflow management tools like Apache Airflow and scripting languages (Java/Python) to streamline processes.
  • Preferred Skills:
  • Strong communication and problem-solving skills.
  • Knowledge of Machine Learning practices and data manipulation techniques.
  • Experience with at least one reporting tool and access control mechanisms.
  • Role Requirements:
  • Develop high-performance and scalable solutions using Google Cloud Platform (GCP) for big data extraction, transformation, and loading (ETL).
  • Design and build production-grade data solutions from ingestion to consumption using Java/Python.
  • Design and optimize data models on GCP using GCP data stores like BigQuery.
  • Optimize data pipelines for performance and cost efficiency for large-scale data lakes.
  • Write complex, optimized queries for large datasets to create data processing layers.
  • Collaborate closely with Data Engineers to identify the right tools to deliver product features by performing Proof of Concept (POC).
  • Act as a collaborative team player, interacting with business analysts (BAs), Data/ML engineers, and other stakeholders.
  • Research new use cases for existing data to drive continuous improvements.

Required Skills

data engineer gcp