Head of Data Engineering

Our Purpose We strive to connect and energize an inclusive, digital economy that benefits everyone, everywhere by making transactions secure, straightforward, intelligent, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their maximum potential. Our decency quotient, or DQ, fuels our culture and everything we do inside and outside our company. We nurture a culture of inclusion for all employees that recognizes their unique strengths, views, and experiences. We believe that our differences allow us to form a better team – a team that makes better decisions, promotes innovation and produces better business outcomes. Title and Summary Principal Data Engineering Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions assist individuals, financial institutions, governments, and businesses in realizing their greatest potential. Our decency quotient, or DQ, governs our culture and everything we do within and outside our company. Operating in over 210 countries and territories, we are constructing a sustainable world that unlocks inestimable possibilities for everyone. Overview The Data Warehouse team is hunting for a Big Data Lead Engineer to promote our mission to unlock the potentials of data assets by constantly innovating, easing users' access to data from its Big Data repositories, and enforce standards and principles in the Big Data field. The role is accountable for outlining and maintaining the data architecture, as well as associated data maintenance, integration, and loading processes for the organization. The Hadoop Data Warehouse is utilized by several groups to extract insights, conduct Machine Learning and Data Science operations which, in turn, support numerous revenue-generating initiatives across the organization. Role • Developing high-quality, secure, and scalable data pipelines using Spark, Scala / Python / Java on Hadoop or object storage. • Taking a leading consultative position in complicated initiatives of strategic importance (e.g., cross-functional/cross-geographies), including applying the most suitable data solutions for individual applications. • Designing and architecting data flow patterns in the Hadoop environment that can be scalable, repeatable and eliminate time-consuming steps. • Encouraging automation and efficiency in Data ingestion, data movement, and data access workflows through innovation and collaboration. • Comprehending, implementing and enforcing Software development standards and engineering principles in the Big Data area. • Closely working with business stakeholders and embedded engineering teams within business teams in a cooperative manner to help them construct scalable products swiftly. • Using new technologies and approaches to innovate with increasingly larger data sets. • Collaborating with the project team to meet scheduled due dates while identifying emerging issues and recommending solutions for problems. • Independently performing assigned tasks and resolving production incidents. • Proposing ideas to ensure that required standards and processes are in place and actively seeking opportunities to enhance standards and improve process efficiency. All About You • 10-16 years of experience in Data Warehouse related projects in a product or service-based organization. • Mastery in Data Engineering and implementing multiple end-to-end DW projects in a Big Data Hadoop environment. • Experience building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage. • Experience working with databases like Oracle, Netezza with strong SQL knowledge. • Experience working on real-time data flow systems, NiFi and Kafka will be an added advantage. • Experience working on automation in the data flow process in a Big Data environment. • Experience working in Agile teams. • Strong analytical skills needed for debugging production issues, providing root cause analysis and implementing a mitigation plan. • Strong communication skills - both verbal and written – and strong relationship, collaboration skills, and organizational skills. • The ability to multitask across multiple projects, liaise with external/internal resources, and provide technical leadership to junior team members. • High-energy, detail-oriented, proactive, and able to operate under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results. • The ability to swiftly learn and implement new technologies, and perform POC to explore the best solution for a problem statement. • Flexibility to operate as a member of a matrix-based diverse and geographically distributed project teams. • Successful leadership in complex cross-functional domain initiatives, expected to set project direction and anticipate/resolve bottlenecks. • Experience participating in a major automation and/or cloud delivery effort, including supporting financial decision-making. • Experience driving deliverables within the global database technology domains and sub-domains, expected to team with leaders in the technical community and derive new solutions. • Proven ability to act as a subject matter expert and trusted advisor on future-proofing big-data infrastructure and business strategies for cloud and on-prem. Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks come with an inherent risk to the organization, and, therefore, it is expected that everyone working for, or on behalf of, Mastercard is responsible for information security and must: • Adhere to Mastercard's security policies and practices. • Ensure the confidentiality and integrity of the information being accessed. • Report any suspected information security violations or breaches. • Complete all periodic mandatory security trainings in compliance with Mastercard's guidelines.