Principal Developer - Data Integration Engineer - DevOps

Company Description

At Western Digital, we're not just pushing the boundaries of technology; we're setting new standards. Our commitment to innovation powers global advances, transforming the impossible into reality. As problem solvers, our technology has historically enabled monumental achievements, such as the moon landing. Today, we play a vital role in driving the technology behind gaming platforms, smart cities, connected vehicles, and the data centers of some of the world’s leading corporations.

Our robust portfolio—featuring renowned brands such as Western Digital®, G-Technology™, SanDisk®, and WD®—offers cutting-edge data-centric solutions for both businesses and consumers. Whether it's binge-watching shows, online shopping, or capturing precious moments on a flash memory card, Western Digital is the unseen backbone supporting these experiences.

Embark on a journey with us at Western Digital, where your unique skills contribute to a brighter, smarter future. Together, let’s be the next big thing in data.

Job Description

Principal Developer - Data Integration Engineer - DevOps

Essential Duties and Responsibilities:

• Develop and deploy scalable data integration pipelines using state-of-the-art cloud tools aligned with Western Digital design principles.
• Troubleshoot and enhance performance of existing pipelines utilizing BASH, Python, Java.
• Create robust data solutions on the AWS EMR platform using Java/Spark/Scala, orchestrated with AirFlow.
• Optimize data table design for swift loading and efficient querying.
• Refine SQL procedures and debug issues within Postgres and Redshift databases.
• Implement CI/CD workflows using tools like Bitbucket, Jenkins, Ansible, and more.

Qualifications

Required Education: Bachelor’s degree in Computer Science or Engineering is necessary. Preference for candidates with a Master's degree or AWS developer certification. Additional certifications in Software Development Life Cycle methodologies are advantageous.

Required Experience: At least 8 years in Data Integration/Engineering with a proven track record using cloud-based or on-premises ETL tools. Experience in managing and executing Java UDFs within AWS EMR, and familiarity with Unix/Linux platforms are expected. Proficiency in Transact SQL and script debugging, as well as experience with Postgres and/or Redshift databases, are highly valued. Knowledge of Semiconductor manufacturing datasets is beneficial but not required.

Compensation & Benefits Details

Western Digital offers a competitive salary and benefits package, including but not limited to performance-based incentives both short-term and potentially long-term, comprehensive health benefits, 401(k) plan, employee stock purchase plan, and much more. Specific details regarding salary and the full range of benefits will be provided upon hiring and depend on qualifications, location, and company needs.

Additional Information

Western Digital is committed to equal employment opportunities and to respecting diversity in the workplace. We ensure that all applicants and staff members are treated fairly, with no discrimination. For any necessary accommodations during the application or interview process, please contact [email protected].

Ready to make a global impact with your data expertise? Join us at Western Digital and turn groundbreaking ideas into everyday reality.