Job Opportunity: Azure Data Engineer at KPMG India

Job Requirements

Mandatory Skills

• Minimum 10-14 years of consulting or client service delivery experience on Azure.
• Proven experience as an Azure Architect, designing and providing architectural solutions based on client requirements.
• Experience in setting up Azure environments by following Microsoft's best practices.
• Ability to own the architecture, define standards, guidelines, and best practices during the implementation phases.
• Track project status, review artifacts from team members, and provide directions for any deviations.
• Leadership experience in mentoring teams.
• At least 5 years of experience in developing data ingestion, processing, and analytical pipelines for big data, relational databases like MySQL, and data warehouse solutions like Snowflake.
• Extensive practical direction within Azure Native services and Hadoop.
• Hands-on experience with implementing data ingestion, ETL, and processing using Azure services (ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, Cosmo DB).
• Minimum 3 years hands-on experience with Azure and Big Data technologies such as Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive, and streaming technologies like Kafka, EventHub, NiFi.
• Proficiency with Pyspark development on Databricks.
• Experience in DevSecOps and CI/CD deployments.
• Understanding of cloud migration methodologies and tools like Azure Data Factory, Data Migration Service, Event Hub, Kafka.
• Minimum 3 years of RDBMS experience.
• Experience using Big Data File Formats and compression techniques.
• Proficiency in developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins.
• Experience with private and public cloud architectures, including pros and cons and migration considerations.
• Bachelor’s or higher degree in Computer Science or a related discipline; or equivalent (minimum 2 years work experience). If an Associate’s Degree, must have equivalent minimum 2 years work experience.

Primary Roles and Responsibilities

As an Azure Data Engineer, you will be responsible for designing, building, and maintaining the data infrastructure for our organization using Azure cloud services. Responsibilities include:

• Creating data pipelines and integrating data from various sources.
• Implementing data security and privacy measures.
• Monitoring and troubleshooting data flows.
• Optimizing data storage and processing for performance and cost efficiency.

Preferred Skills

• DevOps on an Azure platform.
• Experience developing and deploying ETL solutions on Azure.
• Knowledge of IoT, event-driven, microservices, and Containers/Kubernetes in the cloud.
• Familiarity with metadata management technology stack (Data Governance, Data Quality, MDM, Lineage, Data Catalog, etc.).
• Familiarity with data management technology stack (Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala).
• Multi-cloud experience is a plus (Azure, AWS, Google).

Join KPMG India as an Azure Data Engineer and help shape robust data solutions for our clients. Apply now to become part of a diverse and innovative team.