Senior Data Engineer – Cloud & Streaming Pipelines

About the role

Accelera Digital Group is looking for an experienced Data Engineer to join its Data and AI practice. You will lead the design and delivery of scalable batch and real‑time streaming pipelines on Google Cloud Platform, working closely with customers and internal teams.

Key responsibilities

• Architect and build robust, scalable batch and streaming data pipelines using GCP services and open‑source big‑data tools.
• Lead projects from concept to production, managing timelines, accountability and quality to meet client strategic goals.
• Understand business challenges, translate technical architectures into tangible business value, and propose improvements.
• Mentor junior engineers, drive proof‑of‑concept initiatives and keep the team ahead of emerging technologies such as Generative AI.

Required profile

• Minimum 7 years of proven experience in data engineering, data architecture and enterprise software systems.
• Computer Science degree or equivalent practical experience.
• Deep expertise in Google Cloud Platform data services (BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, Cloud Dataproc, Cloud Composer, Dataplex).
• Hands‑on proficiency with Python, SQL and Apache Spark, plus strong knowledge of Hadoop and distributed computing.

Required skills

• Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Dataproc, Composer, Dataplex)
• Python programming
• SQL
• Apache Spark
• Hadoop ecosystem