Azure Data Engineer - Manager

Job Title: Azure Data Engineer - Manager at KPMG India

KPMG India is currently seeking an experienced Azure Data Engineer - Manager to join our dynamic team. If you are looking to advance your career in a fast-paced environment working on cutting-edge technology solutions, this is the perfect opportunity for you!

Qualifications

The ideal candidate will possess:

• A Bachelor’s or higher degree in Computer Science or related discipline; or equivalent professional experience (minimum 10+ years).
• At least 7+ years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases such as MySQL/SQL, and data warehouse solutions like Synapse/Snowflake.
• Proven expertise in Azure and Big Data technologies including Java, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive, and streaming technologies such as Kafka, EventHub, and NiFi.
• Extensive experience in designing and implementing high-performance data ingestion pipelines using Apache Spark and/or Azure Databricks.
• Strong background in cloud migration methodologies and processes, including familiarity with Azure Data Factory, Data Migration Service, and Kafka.

Key Responsibilities

As an Azure Data Engineering Manager, you will be responsible for:

• Designing, building, and maintaining the data infrastructure using Azure cloud services.
• Creating robust data pipelines and integrating data from various sources.
• Implementing data security and privacy measures.
• Monitoring, troubleshooting, and optimizing data storage and processing for performance and cost efficiency.

Preferred Skills

Candidates with the following skills will have an edge:

• Experience in an Azure DevOps environment with tools like Microsoft Visual Studio Team Services and Terraform.
• Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
• Proficiency with MS SQL RDBMS and SQL Query Language.
• Knowledge of IoT, event-driven systems, microservices, and Containers/Kubernetes in the cloud environment.
• Familiarity with industry technology stacks for metadata management and data ingestion, including Kafka, StreamSets, and GoldenGate.
• Multi-cloud experience (Azure, AWS, Google) is a plus.

This role demands a flexible, proactive individual with a strong personal ownership of problem resolution and an excellent communicator capable of multitasking under pressure.

If you are ready to take on this challenging role, apply today and be part of a team that influences the data-driven decisions at a global level!

KPMG India is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.