FlightAware- Senior Data Engineer (Remote)

Date Posted: 2024-06-17

Country: United States of America

Location: HNC99: Field Office - NC Remote Location, Remote City, NC, 27601 USA

Position Role Type: Remote

Unlock New Value in Aviation with FlightAware as a Senior Data Engineer 2

Are you ready to unlock additional value from the world's most comprehensive aviation dataset? FlightAware, a part of Collins Aerospace's Connected Aviation Solutions, has built an industry-leading aviation software platform. We process over 180+ million messages an hour from 30,000+ data feeds—accumulating a staggering 2 terabytes daily and growing! We offer the most complete and accurate real-time flight-tracking service, which forms the backbone of various successful products central to the aviation industry.

About the Role:

As a Senior Data Engineer 2 at FlightAware, you will provide technical leadership and expertise as we enhance our data engineering capabilities. The Aviation Insight group in Engineering delivers real-time and historical data insights via streaming data processing to generate our single source of truth. These insights are pivotal for training our predictive models. Your goals will include improving access to historical data and refining ETL jobs to support machine learning and reporting use-cases.

Key Responsibilities:

• Lead technical projects in data engineering, including platform improvements and workflow processes.
• Quickly develop proofs-of-concept and transition systems into production.
• Design and redesign ETL processes to prepare data for machine learning model training.
• Transform data to support Business Intelligence and analytics products.
• Archive data feeds into queryable Iceberg tables.
• Work with stakeholders to define technical roadmaps, focusing on high-ROI projects.
• Mentor peers and support their career growth, sharing your expertise across FlightAware.

What You Will Learn:

• Gain a deep understanding of aviation data and associated insights.
• Learn how FlightAware’s data products support customer-facing applications.
• Get exposure to machine learning systems making thousands of predictions per second.
• Experience the impact of your work on the efficiency of the entire company.

Required Qualifications:

• STEM degree and minimum 10 years of relevant experience, or an Advanced Degree with 7 years of experience, or 14 years of relevant experience without a degree.
• Must be authorized to work in the U.S. without sponsorship now or in the future.
• Experience as a Lead or Senior Data Engineer/Scientist or Software Engineer.
• Proficiency with message queues or pub/sub systems like Kafka, Redis, or RabbitMQ.
• Experience with Python, Docker, Kubernetes, and SQL/NoSQL databases.
• Experience with streaming processing platforms like Spark or Flink, and public cloud providers, notably AWS.
• Familiarity with tools like Debezium for CDC.
• Experience with the Databricks platform.

Preferred Qualifications:

• Experience with Rust or Scala.
• A passion for aviation or a private pilot license.

What We Offer:

Our competitive benefits package includes:

• Medical, dental, and vision insurance
• Three weeks of vacation for new hires
• Generous 401(k) plan with employer matching and separate employer retirement contribution
• Tuition reimbursement and Student Loan Repayment Programs
• Life and disability insurance
• Optional coverages including pet insurance, home and auto insurance, additional life and accident insurance, and more
• Parental leave benefits and Ovia Health, fertility, and family planning
• Employee Assistance Plan, offering up to 10 free counseling sessions
• Wellness rewards program and virtual doctor visits
• Child and elder care services

Salary Information:

The salary range for this role is $118,000 -