Senior Data Engineer

As a leading industrial distributor with operations primarily in North America, Japan, and the United Kingdom, Grainger proudly serves over 4.5 million customers worldwide. We deliver products through innovative technology and deep customer relationships, truly embodying our mission to Keep The World Working®. With 2023 sales reaching $16.5 billion, Grainger remains dedicated to providing value for customers, fostering an engaging culture for team members, and driving strong financial results.

Our welcoming workplace enables you to learn, grow, and make a difference by keeping businesses running and their people safe. Recognized as a 2024 Glassdoor Best Place to Work and a Great Place to Work-Certified™ company, we invite passionate individuals to join our team as we continue to lead the industry over the next 100 years.

Position Details

We are seeking a Senior Data Engineer to join our search team. This team comprises the e-commerce search platform, backend services, machine learning endpoints, and our search engine, enabling grainger.com customers to find products efficiently. You will report to the Manager of Product Engineering.

Your Responsibilities Will Include

• Designing and implementing technical solutions and processes to ensure data reliability and accuracy.
• Building pipelines that feed embedding models and vector databases while collaborating with platform-oriented teams to meet database response time expectations.
• Developing data models, mappings, and new data assets required by data science teams, while performing exploratory data analysis on existing products and datasets.
• Understanding trends and emerging technologies, evaluating the performance and applicability of potential tools for our requirements.
• Enabling data discovery and curation for analytical purposes by collaborating with data scientists and providing data integration solutions.
• Creating secure and efficient data products in collaboration with stakeholders, including team and product managers.
• Ensuring data processing pipelines and ETL jobs are designed for scalability, utilizing distributed technologies for efficient data handling.
• Working within an Agile delivery/DevOps methodology to deliver product increments in iterative sprints.

Qualifications

• 3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. Experience with Snowflake and Databricks is a must.
• 3+ years orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.
• 3+ years of experience prepping structured and unstructured data for data science models.
• 3+ years of experience with containerization and orchestration technologies (Docker, Kubernetes) and shell scripting in Bash, Unix, or Windows shell.
• Experience working with vector databases like Milvus, Pinecone, or Weaviate.
• Experience incorporating machine learning in data pipelines to discover, classify, and clean data.
• Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD.
• Familiarity with AWS Services including but not limited to Glue, Athena, Lambda, S3, and DynamoDB.
• Demonstrated experience implementing the data management lifecycle using data quality functions like standardization, transformation, rationalization, linking, and matching.

Rewards and Benefits

With benefits starting on day one, our programs provide choice and flexibility to meet team members' individual needs. Check out the highlights below and review all our benefits at .

• Medical, dental, vision, life, and pet insurance plans.
• Six free sessions each year with a licensed therapist to support your emotional wellbeing.
• Paid time off (PTO) and six company holidays per year.
• 6% company contribution to a 401(k) Retirement Savings Plan each pay period, no match required.
• Employee discounts, tuition reimbursement, student loan refinancing, and free access to financial counseling, education, and tools.

We are committed to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an