Job Opportunity: Data Engineer -1 (0-2 Years Experience)

Join Kotak Mahindra Bank to accelerate your career as a Data Engineer. We're looking for innovative minds to help drive our mission of building trust through dependable digital offerings. Become a part of our technology-first approach in banking and make a positive impact on millions of lives.

What We Offer

At Kotak Group, our mission is simple: Building trust. This trust encompasses more than just the safety of assets; it extends to the dependability of our digital offerings. We strive to enhance the customer experience by providing superior banking services through technology. We invite the best tech talents to join us in making banking seamless and swift. Here, we promise meaningful work that positively impacts many lives.

About Our Team

The Data Engineering & Exchange (DEX) team at Kotak Bank is a central data organization managing the holistic data experience. DEX encompasses Data Platform, Data Engineering, and Data Governance, working closely with the Analytics team. We are rebuilding our entire data platform from on-premise solutions to a scalable AWS cloud-based platform. Being a ground-up initiative, this is an excellent opportunity for talented technologists to create top-tier data lake house solutions.

Primary skills for our team include software development (preferably Python), data engineering with Spark (pyspark, sparksql, scala), advanced SQL, and data modeling for analytics.

The team is expected to grow to 100+ members based out of Bangalore, split into ~10 sub-teams, each driving their independent charters.

Join us to learn about the fintech space, contribute to the digital transformation of Kotak, and leverage technology to build complex data platforms, including real-time, micro-batch, batch, and analytics solutions. Be futuristic and build systems operable by AI technologies.

Data Platform

This vertical is responsible for building and optimizing the entire bank's data storage, central data lake, managed compute, and orchestrations framework, including serverless data solutions. Responsibilities also include managing the central data warehouse, building connectors for different sources, creating customer feature repositories, and implementing cost optimization solutions. Additionally, the team will drive Data Engineering excellence through training and knowledge-sharing sessions.

Data Engineering

This team will manage data pipelines for thousands of datasets, source data from 100+ systems, and enable data consumption for over 30 analytics products. They will build data models in a configurable and programmatic way, enabling centralized reporting for Kotak Bank, consumed by over 20,000 branch users and all analytics use cases.

Data Governance

The Data Governance team manages metadata platforms, data privacy, data security, data stewardship, and data quality platforms.

If you have the right data skills and are enthusiastic about building data lake solutions from scratch for high concurrency systems, join our team!

Role and Responsibilities

• Drive business decisions with technical input and lead the team.
• Design, implement, and support data infrastructure from scratch.
• Manage AWS resources, including EC2, EMR, S3, Glue, Redshift, and MWAA.
• Extract, transform, and load data from various sources using SQL and AWS big data technologies.
• Explore and learn the latest AWS technologies to enhance capabilities and efficiency.
• Collaborate with data scientists and BI engineers to adopt best practices in reporting and analysis.
• Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
• Build data platforms, data pipelines, or data management and governance tools.

Basic Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Experience in data engineering.
• Strong understanding of AWS technologies, including S3, Redshift, Glue, and EMR.
• Experience with data pipeline tools such as Airflow and Spark.
• Experience with data modeling and data quality best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork skills.
• Experience in at least one modern scripting or programming language, such as Python, Java, or Scala.
• Strong advanced SQL skills.

Preferred Qualifications

• AWS cloud technologies: