Staff Engineer, Data Analytics Engineering ( 6+ yrs Apache ,Spark ,Python and PySpark )

Job expired!

Join Western Digital as a Staff Engineer in Data Analytics Engineering

At Western Digital, we are not just shaping the future of technology; we're making the once impossible, possible. Our commitment to innovation allows us to play a crucial role in powering major advancements—from creating platforms that make cities smarter to systems that make connectivity a breeze. Now, we're searching for a talented Staff Engineer, Data Analytics Engineering to join our team.

Company Overview:

Western Digital is a dynamic force in the technology field, known for an expansive portfolio of technologies, storage devices, and platforms for business and consumers alike. By pushing the boundaries of technology, we provide data-centric solutions under the Western Digital®, G-Technology™, SanDisk®, and WD® brands. As we expand, our need for highly skilled and innovative team members grows.

Job Description:

We are looking for a Staff Engineer, Data Analytics Engineering with a strong background in ETL, Apache Spark, and real-time data streaming. This role requires at least 6 years of experience in developing ETL jobs using industry-leading ETL tools and a proven track record in large-scale data processing.

  • Design, develop, and optimize Apache Spark applications.
  • Implement data transformation using Spark RDDs and Data Frames.
  • Develop and maintain Apache Kafka pipelines for real-time data streaming.
  • Expertise in Python, PySpark, Scala, NIFI, and SQL/Procedure is essential.
  • Familiarity with Unix/Linux OS, Postgres, Redshift/Snowflake databases, and CI/CD tools such as Jenkins, Docker, Kubernetes preferred.
  • Create and schedule jobs using Airflow, integrate data pipelines with monitoring tools like Splunk and Grafana.

Qualifications:

The ideal candidate will have a Bachelor’s degree in Computer Science or Engineering, with a Master’s degree preferred. AWS developer certification, along with any certifications in SDLC methodologies, would be advantageous.

Why Western Digital?

At Western Digital, we foster an inclusive environment that encourages diversity and innovation. We believe that a blend of varying perspectives results in better outcomes not only for our team but also for the technology we create. We are committed to supporting all our staff members through a diverse and inclusive workplace.

Apply Now

If you have the skills and the passion for technology, we invite you to join us in developing solutions that make an impact on a global scale. Please ensure your application includes a detailed resume and any relevant certifications. For accommodation requests during the hiring process, please contact .

Be the catalyst for next-gen data solutions at Western Digital—where innovation meets impact.