Join Our Team as a Sr Big Data Engineer (GCP) - Airflow and Oozie at Rackspace Technology

About the Role:

We are on the hunt for a proficient Senior Big Data Engineer to enhance our dynamic team at Rackspace Technology. The candidate should have profound expertise in developing and optimizing batch processing systems and an excellent grasp of public cloud technologies, particularly Google Cloud Platform (GCP). Our ideal candidate thrives in a remote environment, exhibits outstanding communication skills, and is capable of solving complex challenges independently with innovative solutions.

What You Will Be Doing

- Develop high-quality, scalable, and robust code for batch processing systems utilizing tools like Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), and Python.

- Design, manage, and optimize data workflows using Oozie and Airflow within the Apache Hadoop ecosystem.

- Utilize GCP for efficient big data processing and storage solutions.

- Implement automation/DevOps best practices such as CI/CD and Infrastructure as Code (IaC).

Requirements

- Deep experience with GCP-managed services and an understanding of cloud-based batch processing systems.

- Strong programming skills in Java (specifically Spark), Python, Pig, and SQL.

- Expert knowledge of public cloud services, focusing on GCP, and familiarity with BigTable and Redis.

- Proficiency across the Apache Hadoop ecosystem including Oozie, Pig, Hive, and Map Reduce.

- Experience with DevOps principles and tools for continuous integration and deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform.

- Excellent problem-solving skills with the ability to think critically and offer innovative solutions.

- Proven ability to work effectively in a remote setting with strong written and verbal communication skills.

- Extensive experience in engineering batch processing systems at scale.

Must-Have Credentials

- Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification.

- At least 10 years of experience in customer-facing software/technology roles or consulting.

- Minimum 5 years of experience with "on-premises to cloud" migrations or IT transformations.

- Over 5 years of building and operating solutions on GCP, AWS, or Azure.

- A technical degree in Computer Science, Software Engineering, or a related field.

About Rackspace Technology

As the multicloud solutions experts, we combine our expertise with the world’s leading technologies across applications, data, and security to deliver end-to-end solutions. We are renowned for advising customers based on their business challenges, designing scalable solutions, and optimizing returns into the future. Consistently named a best place to work by Fortune, Forbes, and Glassdoor, we attract and develop top-tier talent. Join our mission to embrace technology, empower customers, and deliver the future.

We believe in inclusivity and are committed to providing equal employment opportunities. We respect and seek out diversity of experience, perspectives, and abilities among our team members worldwide. If you require accommodations or have special needs, please inform us during the application process.

Apply today and become a valued member of our winning team!

Additional Information:

Company Name: Rackspace

Job Title: Sr Big Data Engineer (GCP) - Airflow and Oozie