Lead Data Engineer

Company Description

Visa is a global leader in digital payments, facilitating over 215 billion payments transactions between consumers, merchants, financial institutions, and government entities across over 200 countries and territories every year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you become part of a culture of purpose and belonging – where your growth is a priority, your identity is valued, and the work you do impacts the world. We believe that economies that are inclusive of everyone, everywhere uplift everyone everywhere. Your work will directly affect billions of people around the world – enabling them to engage with finance in a way that shapes the future of money movement.

Join Visa: A Network Working for Everyone.

Job Description

New Payment Flows (NPF) division’s mission is to tap into new sources of money movement both in card and non-card flows, which includes Visa Business Solutions, Government Solutions and Visa Direct. This presents a huge opportunity for growth. Our team offers payment solutions and corresponding services to clients around the world. These global clients and partners utilize our solutions to address the needs of Small Businesses, Middle Market Clients, Large Corporate Clients, Multinationals, and Governments.

The Visa Business Solutions (VBS) and Visa Government Solutions (VGS) team is a world-class technology organization undergoing considerable growth as we launch products into new payment flows and continue to expand our core card solutions. It is a vibrant group to join as we further our global reach.

Essential Functions

• Strong technological and leadership background in developing enterprise-level applications using Scala/Java, Spring, REST APIs, RDBMS, and Angular/React. Skills in Machine Learning, Data Engineering (Hadoop, Hive, Spark), NoSQL, Kafka, Streaming and Data Pipelines are valuable.
• Design and establish data and pipeline management frameworks utilizing open-source components, which include Hadoop, Hive, Spark, HBase, Kafka streaming, and other Big Data technologies.
• Leader in Design and Coding best practices while technically steering a small group.
• Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef is beneficial
• Familiarity or experience with data mining, data science, machine learning and statistical modeling (e.g., regression modeling, clustering techniques, decision trees, etc.) is advantageous
• Accountable for designing and implementing advanced, scalable, and distributed systems that employ technology to allow standardization, security, punctuality and quality of data.
• Work with and manage remote teams
• Collaborate with product managers to develop a strategy and roadmap to offer compelling capabilities that help them achieve their business objectives.
• Work closely with senior engineers to develop the most efficient technical design and approach for new product development.
• Promote best practices for software development and documentation, ensure designs meet requirements, and deliver high-quality work within tight schedules.
• Project management: prioritization, planning of projects and features, stakeholder management, and tracking of external commitments
• Operational Excellence: monitoring & operation of production services
• Identify opportunities for further enhancements and refinements to standards and processes.
• Mentor junior team members, develop departmental procedures, and standardize best practices.
• Hire and retain world-class talent to deliver data platform projects.
• Strong Negotiation Skills: You will act as a distinguished representative for product development, collaborating, negotiating, managing trade-offs, and evaluating new opportunistic ideas with business partners.

This is a hybrid role. Hybrid employees balance their time between remote and office work. Employees in hybrid roles are expected to be in the office for 2-3 set days per week (as determined by leadership/site), spending around 50% or more of their time in the office according to business needs.

Qualifications

• Bachelor's degree in a technical field such as computer science, computer engineering or a related field required. Advanced degree is preferred
• Requires 10+ years of experience, at least 3 of which were in leading engineering teams
• 6+ years of practical experience in Hadoop using Core Java Programming, Spark, Scala, Hive, Pig scripts, Sqoop, Streaming, Kafka, or any ETL tool
• Strong knowledge of Database concepts and UNIX
• Proficient knowledge of CI/CD and engineering efficiency tools including code coverage
• Experience in handling very large data volumes in low latency or batch mode
• Proven experience in delivering large scale, highly available production software
• Ability to manage multiple competing priorities in a fast-paced environment
• Deep understanding of end-to-end software development in a team and a proven track record of shipping software on time
• Payment processing background is favorable but not required
• Experience working in an Agile and Test-Driven Development environment
• Strong business and technical insight
• Excellent verbal and written communication skills, along with the ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management
• Quick learner, self-starter, meticulous and can work with minimal supervision

Additional Information

Visa is an Equal Opportunity Employer. Qualified applicants will be considered for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner compliant with EEOC guidelines and applicable local law.