(USA) Data Engineer III - Data Ventures
- Data Engineer
- California
- 06/23/2024
- -
Are you driven by boundless energy and a passion for engineering data to solve dynamic problems shaping the future of retail? At Walmart, you'll work with some of the biggest big data sets to help unleash the power of retail data science. As a Walmart Data Engineer, you will create and maintain data pipelines, enabling our Data Scientists and Analysts to leverage targeted and valuable data assets effectively.
Our team at Data Ventures focuses on developing reusable technologies to enhance customer acquisition, onboarding, and merchant empowerment. We ensure seamless experiences across all channels, including in-store, mobile app, and websites, while optimizing tariffs and assortment in line with Walmart's Everyday Low-Cost philosophy. Our primary goal is to offer immediate solutions to US Marketplace sellers by interacting with multiple teams across the company.
Extract data from identified databases, create data pipelines, and transform data to solve problems by selecting appropriate techniques. Stay updated with current analytics trends.
Understand requirements and service level agreements to identify the most suitable data source. Perform initial data quality checks on extracted data.
Analyze complex data elements and systems to contribute to conceptual, physical, and logical data models. Define relational tables, primary and foreign keys, and stored procedures to create a data model structure, ensuring efficient data flows.
Write code for required solutions and application features, validate proposed solution designs, create proofs of concept, and deploy software to production servers. Contribute to code documentation and provide timely progress updates.
Provide recommendations to solve complex business issues, develop business cases with projected ROI, translate business requirements into projects, and recommend new processes and ways of working.
Establish, modify, and document data governance projects. Implement data governance practices and educate others on processes, practices, and policies. Provide updates and inputs into governance policies.
- Expertise in Hadoop, Spark, Cloud, Python/PySpark, Java, Streaming, and Kafka.
- Track record coding with at least one programming language (e.g., Scala, Python).
- Experience with cloud computing platforms (e.g., GCP, Azure).
- Skilled in data modeling and data migration protocols.
- Experience with data warehousing, BI, and integration tools like Automic and Airflow.
- Knowledge of building scalable Big Data solutions and ETL ecosystems.
- Familiarity with Databricks.
- Hands-on knowledge in NoSQL (e.g., Cosmos DB) and RDBMS (e.g., MySQL, Postgres).
- Experience with messaging platforms like Kafka.
- Ability to set up efficient processes for Software Development, Requirement Intake, and Effort Estimation.
- Strong creative, critical thinking, and troubleshooting skills.
At Walmart Global Tech, we create technologies to make life easier for millions. Our team includes software engineers, data scientists, cybersecurity experts, and service professionals driven by a passion for innovation. We offer opportunities for both new entrants and experienced professionals to develop skills, gain industry experience, and drive retail transformation at scale.
We offer a hybrid work model that combines in-office and virtual collaboration. This approach enhances collaboration, facilitates quicker decisions, and supports work-life balance.
Our compensation package includes incentive awards for performance, 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, and multiple health plans. Walmart is an Equal Opportunity Employer dedicated to diversity and inclusion, offering numerous benefits to support our associates.
Option 1: Bachelor’s degree in Computer Science and 2 years' experience in software engineering.
Option 2: 4 years' experience in software engineering.
Option 3: Master’s degree in Computer Science.
- Experience in data engineering, database engineering, business intelligence, or business analytics.
- Master’s degree in Computer Science or related field with 2 years' experience.
- Knowledge in implementing Web Content