Job Offer: Data Engineer at KPMG India

Mandatory Skills

At least 2-4 years of consulting or client service delivery experience on Azure.

At least 2 years of experience in developing data ingestion, data processing, and analytical pipelines for big data, relational databases such as MySQL, and data warehouse solutions like Snowflake.

Extensive experience providing practical direction within the Azure Native services and Hadoop.

Extensive hands-on experience implementing data ingestion, ETL, and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, Cosmos DB, etc.

Minimum of 3 years of hands-on experience in Azure and Big Data technologies such as Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive, and streaming technologies like Kafka, EventHub, NiFi, etc.

Proficient with PySpark development on Databricks.

Proficient in DevSecOps and CI/CD deployments.

Experienced in cloud migration methodologies and processes, including tools like Azure Data Factory, Data Migration Service, Event Hub, Kafka, etc.

Minimum of 2 years of RDBMS experience.

Experience using Big Data file formats and compression techniques.

Experienced in using developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.

Experience with private and public cloud architectures, the pros/cons of each, and migration considerations.

Bachelor’s or higher degree in Computer Science or a related discipline, or equivalent (minimum 2 years of work experience). If Associate’s Degree, must have equivalent minimum 2 years of work experience.

Primary Roles and Responsibilities

An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.

Preferred Skills

DevOps on an Azure platform.

Experience developing and deploying ETL solutions on Azure.

Experience with IoT, event-driven, microservices, Containers/Kubernetes in the cloud.

Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog, etc.

Familiarity with the technology stack available in the industry for data management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, MapReduce, Hadoop, Hive, HBase, Cassandra, Spark, Flume, Hive, Impala, etc.

Multi-cloud experience is a plus - Azure, AWS, Google.

Apply Now to join our dynamic team at KPMG India and thrive in a role as an Azure Data Engineer.