Data Engineer Opportunity at Kotak Mahindra Bank

Position: Data Engineer -1 (Experience: 0-2 years)

Join us at Kotak Mahindra Bank where we are on a mission to build trust and transform banking with a technology-first approach. Enhance customer experiences by providing superior banking services and become a part of our mission to make banking seamless and swift. Discover meaningful work that impacts the lives of many.

About Our Team

The Data Exchange (DEX) team is the central data organization at Kotak Bank, managing the entire data experience. Comprising Data Platform, Data Engineering, and Data Governance charters, DEX works closely with the Analytics team. We are undertaking a greenfield project to transition our on-premise data solutions to a scalable AWS cloud-based platform. Join us to build cutting-edge data lake house solutions from the ground up, leveraging your skills in Python, Spark (PySpark, SparkSQL, Scala), Advanced SQL, and Data modeling for Analytics.

Based in Bangalore, our team is set to grow to over 100 members with ~10 sub-teams driving their respective charters. This role offers you a chance to dive into the fintech domain, be an early contributor to Kotak's digital transformation journey, and utilize technology to build complex data platform solutions, including real-time, micro-batch, batch, and analytics solutions, all with a futuristic approach leveraging AI technologies.

Our Team's Key Verticals

Data Platform

This vertical focuses on building an optimized data platform for the bank, including a centralized data lake, managed compute, and serverless data solutions. Responsibilities include creating a central data warehouse for high concurrency use cases, developing connectors for different sources, building customer feature repositories, implementing cost optimization solutions like EMR optimizers, and driving data engineering excellence through training and knowledge sharing.

Data Engineering

The Data Engineering team manages data pipelines for thousands of datasets, sourcing data from over 100 systems, and enabling data consumption for 30+ analytics products. The team develops data models in a configurable and programmatic manner, supports centralized reporting, and serves data needs for 20K+ branch consumers, RMs, Branch Managers, and various analytics use cases.

Data Governance

This team is responsible for the Metadata platforms, Data Privacy, Data Security, Data Stewardship, and Data Quality platforms at Kotak Bank.

If you have the right data skills and are excited to build high concurrency data lake solutions from scratch, this team is for you.

Responsibilities

• Drive business decisions with technical input and lead the team.
• Design, implement, and support data infrastructure from scratch.
• Manage AWS resources, including EC2, EMR, S3, Glue, Redshift, and MWAA.
• Extract, transform, and load data from various sources using SQL and AWS big data technologies.
• Explore and learn the latest AWS technologies to enhance capabilities and efficiency.
• Collaborate with data scientists and BI engineers to adopt best practices in reporting and analysis.
• Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
• Build data platforms, data pipelines, or data management and governance tools.

Basic Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field
• Experience in data engineering
• Strong understanding of AWS technologies, including S3, Redshift, Glue, and EMR
• Experience with data pipeline tools such as Airflow and Spark
• Experience with data modeling and data quality best practices
• Excellent problem-solving and analytical skills
• Strong communication and teamwork skills
• Experience in at least one modern scripting or programming language, such as Python, Java, or Scala
• Strong advanced SQL skills

Preferred Qualifications

• Expertise in AWS cloud technologies: Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, IAM, Airflow
• Experience in the Indian banking segment and/or fintech
• Experience with non-relational databases and data stores
• Experience with highly available