Azure Data Engineer - Assistant Manager
- Azure
- Other places
- 06/16/2024
- -
Join KPMG India as an Azure Data Engineer and advance your career in a leading global consulting company.
A. Mandatory Experience:
• Minimum 4+ years of consulting or client service delivery experience on Azure.
• At least 4+ years of expertise in developing data ingestion, data processing, and analytical pipelines for big data, relational databases (e.g., MySQL), and data warehouse solutions (e.g., Snowflake).
• Extensive experience providing practical direction within Azure Native services and Hadoop.
• Strong hands-on experience in implementing data ingestion, ETL, and data processing using Azure services such as ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, and Cosmo DB.
• Proficient in Azure and Big Data technologies like Java, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive, and streaming solutions like Kafka, EventHub, NiFi.
• Knowledgeable in DevSecOps and CI/CD deployments.
• Familiar with cloud migration methodologies and processes including Azure Data Factory, Data Migration Service, Event Hub, Kafka.
• Minimum 4+ years of RDBMS experience.
• Experience in using Big Data File Formats and compression techniques.
• Proficiency with developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins.
• Experience with both private and public cloud architectures, understanding their pros/cons, and migration considerations.
• Bachelor's or higher degree in Computer Science or related discipline, or equivalent (minimum 7 years work experience).
The Azure Data Engineer will:
• Design, build, and maintain the data infrastructure using Azure cloud services.
• Create data pipelines and integrate data from various sources.
• Implement data security and privacy measures.
• Monitor and troubleshoot data flows.
• Optimize data storage and processing for performance and cost efficiency.
B. Complementary Skills:
• DevOps expertise on the Azure platform.
• Experience in developing and deploying ETL solutions on Azure.
• Proficiency with IoT, event-driven, microservices architecture, and Containers/Kubernetes in the cloud.
• Familiarity with the industry's metadata management technology stack: Data Governance, Data Quality, MDM, Lineage, Data Catalog.
• Familiarity with data management, ingestion, capture, processing, and curation technologies: Kafka, StreamSets, Attunity, GoldenGate, MapReduce, Hadoop, Hive, HBase, Cassandra, Spark, Flume, Impala.
• Multi-cloud experience (Azure, AWS, Google) is a plus.
If you meet these qualifications and are excited about leveraging your expertise in Azure data engineering, we encourage you to apply for the Assistant Manager position at KPMG India.
Embark on your career journey with KPMG India today!