Sr Data Engineer

KPMG India - Senior Data Engineer Job Offer

Mandatory Skills

We are looking for a highly skilled Senior Data Engineer with expertise in Azure to join our team. The ideal candidate must possess the following skills:

• At least 7 years of consulting or client service delivery experience on Azure.
• Minimum of 4 years developing data ingestion, data processing, and analytical pipelines for big data, MySQL, and Snowflake.
• Extensive experience with Azure Native services and Hadoop.
• Hands-on experience implementing data ingestion, ETL, and data processing using Azure services like ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, and Cosmo DB, among others.
• At least 3 years of experience with Azure and Big Data technologies such as Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive, Kafka, EventHub, and NiFi.
• Proficiency with Pyspark development on Databricks.
• Strong understanding of DevSecOps and CI/CD deployments.
• Familiarity with cloud migration methodologies and tools like Azure Data Factory, Data Migration Service, Event Hub, Kafka.
• Minimum of 3 years of RDBMS experience.
• Experience with Big Data File Formats and compression techniques.
• Proficient with developer tools such as Azure DevOps, Visual Studio Team Server, Git, and Jenkins.
• Experience with private and public cloud architectures, including pros/cons and migration considerations.
• Bachelor's or higher degree in Computer Science or a related discipline (minimum 2 years work experience) or equivalent.

Primary Roles and Responsibilities

As a Senior Data Engineer at KPMG India, you will be responsible for:

• Designing, building, and maintaining data infrastructure using Azure cloud services.
• Creating data pipelines, integrating data from various sources, and implementing data security and privacy measures.
• Monitoring, troubleshooting data flows, and optimizing data storage and processing for performance and cost efficiency.

Preferred Skills

While not mandatory, the following skills are highly preferred:

• DevOps expertise on an Azure platform.
• Experience developing and deploying ETL solutions on Azure.
• Knowledge of IoT, event-driven, microservices, and Containers/Kubernetes in the cloud.
• Familiarity with metadata management technologies such as Data Governance, Data Quality, MDM, Lineage, and Data Catalog.
• Knowledge of data management, ingestion, capture, processing, and curation stacks like Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, and Impala.
• Multi-cloud experience, including Azure, AWS, and Google, is a plus.

Join KPMG India as a Senior Data Engineer and be part of a team that is driving innovation in data management and cloud technology. Apply now!