Data Engineer (Experience: 0-2 Years) at Kotak Mahindra Bank

What We Offer

At Kotak Group, our mission is to build trust. We prioritize our customers' trust not only in securing their assets but also in the reliability of our digital services. Our technology-first approach aims to transform banking by enhancing the customer experience through superior banking services. We invite the best technological minds in the country to join us in making banking seamless and swift. Here, we offer meaningful work that positively impacts many lives.

About Our Team

Our Data Exchange (DEX) team is the central data organization for Kotak Bank, managing the entire data experience. This includes our Data Platform, Data Engineering, and Data Governance efforts. We are revamping our on-premise solutions to scalable AWS cloud-based platforms, working on a greenfield project. Join us in building one of the best-in-class data lake house solutions from scratch, using skills such as Python for platform building on AWS, Spark for ETL development, and advanced SQL for analytics. Our team is expected to grow to over 100 members based in Bangalore, divided into ~10 sub-teams.

Key Verticals

Data Platform

This vertical is tasked with building and optimizing data storage for the entire bank, creating a centralized data lake, managing compute and orchestration frameworks, and ensuring high concurrency use cases. We also develop cost optimization solutions and perform automations, while being the center for Data Engineering excellence and driving training and knowledge sharing within Kotak.

Data Engineering

This team handles data pipelines for thousands of datasets sourced from over 100 systems, enabling data consumption for more than 30 analytics products. We build data models and ensure centralized reporting for Kotak Bank, used by over 20K branch consumers, RMs, Branch Managers, and various analytics use cases.

Data Governance

This team manages Metadata platforms, Data Privacy, Data Security, Data Stewardship, and Data Quality for Kotak Bank, centralizing data governance efforts.

If you have the right data skills and are ready to build high-concurrency data lake solutions from scratch, this team is for you.

Your Day-to-Day Role

• Drive business decisions with technical input and lead the team.
• Design, implement, and support data infrastructure from scratch.
• Manage AWS resources, including EC2, EMR, S3, Glue, Redshift, and MWAA.
• Extract, transform, and load data from various sources using SQL and AWS big data technologies.
• Explore and learn the latest AWS technologies to enhance capabilities and efficiency.
• Collaborate with data scientists and BI engineers to adopt best practices in reporting and analysis.
• Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
• Build data platforms, data pipelines, and data management and governance tools.

Basic Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field
• Experience in data engineering
• Strong understanding of AWS technologies, including S3, Redshift, Glue, and EMR
• Experience with data pipeline tools such as Airflow and Spark
• Experience with data modeling and data quality best practices
• Excellent problem-solving and analytical skills
• Strong communication and teamwork skills
• Experience in at least one modern scripting or programming language, such as Python, Java, or Scala
• Strong advanced SQL skills

Preferred Qualifications

• AWS cloud technologies: Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, IAM, Airflow
• Prior experience in the Indian Banking segment and/or Fintech
• Experience with non-relational databases and data stores
• Building and operating highly available, distributed data processing systems for large datasets
• Professional software engineering and best practices for the full software development lifecycle