Senior Data Engineer Job at Walmart Global Tech [Sunnyvale, CA]

Position Summary: Join the innovative Walmart Advertising Technology group, connecting supplier brands with retail shoppers at unprecedented scale. As part of our Display Ads Server engineering team for Backend Services, you will build next-generation omni-advertising platforms aimed at delivering performance and value. This hands-on role involves owning major components of our display advertising solution, driving alignment with other teams, and making key architectural and technology choices.

What You'll Do:

• Develop data pipelines to consolidate log data emitted by our various backend microservices.
• Expand existing data pipelines and integrate new data sources to drive new insights.
• Develop data quality checks to identify data gaps and notify upstream teams.
• Build data quality dashboards to monitor data quality.
• Drive projects of high visibility across the organization.
• Mentor and guide mid-to-junior engineers.
• Show your expertise as an exceptional and experienced coder.

What You'll Bring:

• Bachelor's/Master’s degree in Computer Science or related field.
• 5+ years of experience in developing big data technologies/data pipelines.
• Expertise in one or more programming languages (Python, Java, etc.).
• Proficiency in managing and manipulating terabyte-scale datasets.
• Expertise in big data technologies like Hadoop, Apache Spark, Apache Hive, or similar frameworks.
• Strong skills in integrating data from multiple sources.
• Strong data modeling skills.
• Experience with large-scale databases.
• Ability to clean and transform data from different sources.
• Proficiency in optimizing queries for better performance.
• Understanding of distributed computing principles.
• Knowledge of data security and privacy best practices.
• Strong problem-solving and troubleshooting skills.
• Effective communication and collaboration skills.
• Willingness to continuously learn and adapt to new technologies.

Technologies: HDFS, Spark/Hive, Kafka, Apache Parquet, Avro, GCS, GCP, BigQuery, Python.

Nice to have: Previous experience in the advertising domain.

About Walmart Global Tech:

Join a team where one line of code can make life easier for hundreds of millions of people. As part of Walmart Global Tech, you'll work alongside software engineers, data scientists, cybersecurity experts, and service professionals within the world’s leading retailer. Here, you'll innovate at scale, impact millions, and reimagine the future of retail.

Flexible, Hybrid Work:

We adopt a hybrid way of working that is primarily in-office, complemented by virtual work when not onsite. This approach enhances collaboration, decision-making, and flexibility in our personal lives.

Benefits:

Beyond a competitive compensation package, you can earn performance-based incentive awards. Perks include a 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, and multiple health plans among others.

Equal Opportunity Employer: Walmart, Inc. is an Equal Opportunity Employer – By Choice. We value diversity and inclusivity.

Note: The information provided outlines the general nature and level of work performed in this role. The full Job Description can be made available during the hiring process.

At Walmart, you'll enjoy competitive pay, performance-based bonuses, health benefits, financial benefits, paid time off, and numerous other perks.

Live Better U: Walmart-paid education benefit program offering a range of programs from high school completion to bachelor’s degrees.

Eligibility: Benefits are subject to job classification and length of employment.

Minimum Qualifications:

• Bachelor’s degree in Computer Science and 3 years' experience in software engineering, or 5 years' experience in software engineering, or a Master's degree in Computer Science and 1 year’s experience.

Preferred Qualifications:

• Master’s degree in Computer Science and