AWS- Data Engineer - AU (Melbourne)

Job expired!

AWS Data Engineer - Framework Specialist

Job Description

Join Rackspace as an AWS Data Engineer in Melbourne, where you'll play a vital role in building and maintaining data engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. Your efforts will be pivotal in developing and optimizing data pipelines to align with our bank's data strategy.

Key Responsibilities

  • Utilize AWS data services, including AWS EMR, Glue, S3, and Redshift.
  • Build advanced data engineering frameworks on AWS EMR/Glue and Apache Spark.
  • Develop efficient, reliable, and maintainable data workflows.
  • Apply software engineering principles, including Object-Oriented Design (OOD) and design patterns.
  • Optimize data processing pipelines for performance and scalability.
  • Collaborate with data architects to implement best practices and enhance data framework capabilities.
  • Resolve technical challenges and support the data engineering team.

Minimum Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field.
  • 3+ years of hands-on experience with AWS services, particularly EMR and Glue.
  • Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.
  • Solid understanding of SQL, data modeling, and ETL processes.

Preferred Qualifications

  • Experience with version control systems and CI/CD pipelines.
  • Familiarity with additional AWS services and data analytics tools.

Company: Rackspace

Job Title: AWS Data Engineer - Framework Specialist

Location: Melbourne, Australia