Senior Azure Data Engineer – AI & Data Platform

About the role

Sonata Software is looking for an experienced Azure Data Engineer to design, build and optimise data pipelines and AI‑driven solutions on its AI & Data Platform. The role will work on both batch and real‑time processing, integrating multiple data sources and leveraging Azure AI services to enhance productivity and business insights.

Key responsibilities

• Design, develop and maintain scalable data ingestion, transformation and ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks and Azure Data Lake Storage.
• Implement batch and real‑time data processing solutions with Spark, SQL and Python.
• Model data according to enterprise standards and manage integration across APIs, databases and cloud platforms.
• Develop AI‑assisted tools for automated pipeline generation, code acceleration and notebook creation.
• Integrate Azure OpenAI and Azure AI Services into data‑engineering workflows and build intelligent data‑quality monitoring, anomaly detection and predictive analytics.
• Design AI‑powered agents for operational monitoring, user notifications and workflow automation.
• Evaluate emerging AI technologies to improve engineering efficiency and business outcomes.

Required profile

• 5–8 years of professional experience in data engineering and Azure cloud services.
• Hands‑on experience with Azure Data Factory, Synapse, Fabric, Databricks and Data Lake Storage.
• Proficiency in Spark, SQL and Python for batch and streaming workloads.
• Experience building AI‑enabled data solutions using Azure OpenAI or Azure AI Services.
• Ability to work on‑site in a hybrid model from Hyderabad or Bangalore.

Required skills

• Azure Data Factory
• Azure Synapse Analytics
• Microsoft Fabric
• Azure Databricks
• Azure Data Lake Storage
• Apache Spark
• SQL
• Python
• Azure OpenAI
• Azure AI Services