Join Our Team as a Senior Big Data Engineer

About the Role:

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team at Rackspace Technology. The ideal candidate will have a strong background in developing batch processing systems, extensive experience with Oozie, Airflow, and the Apache Hadoop ecosystem, along with a solid understanding of public cloud technologies, especially Google Cloud Platform (GCP). This role allows flexibility with remote work settings, requiring excellent communication skills and the ability to solve complex problems independently and creatively.

What You Will Be Doing:

• Develop scalable and robust code for batch processing systems, utilizing technologies such as Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase.
• Manage and optimize data workflows using Oozie and Airflow within the Apache Hadoop ecosystem.
• Leverage GCP for scalable big data processing and storage solutions.
• Implement automation and DevOps best practices for CI/CD, IaC, and more.

Requirements:

• Proven experience with GCP managed services and understanding of cloud-based batch processing systems.
• Strong proficiency in Oozie, Airflow, Map Reduce, Java.
• Excellent programming skills with Java (specifically Spark), Python, Pig, and SQL.
• Expertise in public cloud services, particularly in GCP.
• Experienced in Infrastructure and Applied DevOps principles, utilizing tools like Terraform for CI/CD and IaC.
• Ability to tackle complex challenges and devise effective solutions independently.
• Effective communication skills for remote work settings.

Must Have:

• Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification.
• 10+ years of experience in customer-facing software/technology or consulting.
• 5+ years of experience with “on-premises to cloud” migrations or IT transformations.
• 5+ years of experience building and operating solutions on GCP (ideally) or AWS/Azure.
• Technical degree in Computer Science, software engineering, or a related field.

About Rackspace Technology:

We are the multicloud solutions experts, combining our expertise with the world’s leading technologies — across applications, data, and security — to deliver end-to-end solutions. We are continuously recognized as a best place to work according to Fortune, Forbes, and Glassdoor. Join us in our mission to embrace technology, empower customers, and deliver the future.

Our Culture:

At Rackspace, we thrive through our connection to a central goal: being valued members of a winning team on an inspiring mission. We bring our whole selves to work every day, and we believe that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe.

We are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.

Apply Today!

Are you ready to take your career to the next level as a Sr Big Data Engineer specializing in Airflow and Oozie at GCP with Rackspace? We welcome you to apply today and join us in shaping the future of technology!