Senior Data Engineer - Data Ventures
Join our team as a Senior Data Engineer, where you will guide and assist your team in navigating technical directions and implementing best practices. You will leverage your deep understanding of Data Engineering methodologies and hands-on experience to build highly scalable solutions.
About Data Ventures Team
Our team develops reusable technologies to streamline customer acquisition, onboarding, and merchant empowerment while ensuring a seamless experience for all stakeholders. We also focus on optimizing tariffs and assortment in line with Walmart's Everyday Low-Cost philosophy. Our goal is to create affordability and provide customized experiences across in-store, mobile app, and online channels. We support US Marketplace sellers by offering immediate solutions to their cases and interacting with multiple teams to enhance seller experience.
Responsibilities
As a Senior Data Engineer, you will:
- Lead a team of 3-5 engineers, including offshore associates, on assigned Engineering projects by providing documentation, direction, and examples
- Identify short- and long-term solutions and timelines, review and approve proposed solutions
- Execute multiple business plans and projects by identifying operational needs and developing business
- Participate in medium- to large-scale, complex, cross-functional projects
- Conduct unit testing, communicate status and issues, and troubleshoot open issues and bug-fixes
- Implement and review new architectural patterns and perform design and code reviews
- Promote and support company policies, procedures, mission, values, and standards of ethics and integrity
- Evaluate the ongoing effectiveness of current plans and initiatives by consulting with business partners and stakeholders
Requirements
Must Have:
- Strong hands-on experience with Hadoop, Hive, Apache Spark
- Proven track record in coding with Scala (preferred) or Python
- Expertise in cloud computing platforms like Google Cloud Platform (GCP) or Microsoft Azure
- Experience in building scalable Big Data solutions and ETL ecosystems
- Experience with integration tools like Automic and Airflow
- Strong skills in data modeling and data migration protocols
- Working knowledge of CI/CD pipelines
- Ability to design data architecture for data warehouses, data lakes, or end-to-end pipelines
- Expertise in data architecture principles, distributed computing, and intake prioritization
- Excellent communication skills for technical and non-technical team members
- Ability to lead technical relationships with partners and mentor senior software developers
Nice to Have:
- Knowledge of Databricks, ThoughtSpot, Druid, Big Query, and ClickHouse
- Experience with NoSQL databases like Cosmos DB and RDBMS like MySQL, Postgres
- Experience with messaging platforms like Kafka
- Skill in improving team efficiency through processes in software development, requirement intake, and effort estimation
- Creative, critical thinking, and troubleshooting skills
About Walmart Global Tech
At Walmart Global Tech, one line of code can simplify life for hundreds of millions. We are a team of software engineers, data scientists, cybersecurity experts, and service professionals within the world’s leading retailer. Our innovations are powered by people, and we are committed to training our team in future skillsets. Whether you're just starting your career in tech or seeking the opportunity to redefine it, we offer the chance to gain new skills and experience across various industries and make a significant impact on the future of retail.
Flexible, Hybrid Work
Leverage our hybrid work model that combines in-office and virtual work. Our campuses serve as collaboration hubs to foster quicker decision-making, remove geographical barriers, and provide personal flexibility.
Benefits
Our comprehensive benefits package includes:
- Competitive compensation with performance-based bonuses
- 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, and multiple health plans
- Short-term and long-term disability, company discounts, Military Leave Pay, and adoption and surrogacy expense reimbursement
- Live Better U program offering Walmart-paid education benefits, including high school completion, bachelor's degrees, and