Senior Data Engineer

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimize and innovate. We turn big ideas into the products, content and services millions of people love. And we do it all right here at Sky. We are looking for a Big Data Engineer to join our Anti-Piracy team who will be responsible for designing and implementing software systems as well as expanding and optimizing our data pipeline whilst optimizing data flow and collection within the Anti-Piracy Team. The Big Data Engineer will support our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. What you'll do: Responsible for designing and implementing software systems Create and maintain optimal data pipeline architecture on the cloud Create the data products and ingest the data from GCS/GCP to BigQuery Assemble large, complex data sets that meet the AP teams requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build robust systems required for optimal extraction, transformation, and loading of data from a wide variety of data sources for data processing Keep our data separated and secure across boundaries Work with data and analytics experts to strive for greater functionality in our data systems. Research various new methods to obtain data and improve its quality. What you'll bring: Build processes supporting data transformation, data structures, metadata, dependency, and workload management. Expert knowledge in ETL and Data warehousing Experience with data mining, data wrangling, and data modeling techniques A successful history of manipulating, processing and extracting value from large, disconnected datasets. Strong organizational skills. Experience supporting and working with cross-functional teams in a dynamic environment. Experience using the following software/tools: GCP, Tableau, Splunk Writing tools to extract and process data from REST APIs. Hands-on experience in building CI/CD Pipelines, Terraform or serverless & Git as version control. Data orchestration technologies like Cloud Composer Airflow. Experience with containers, Kubernetes. Experience with scripting languages such as Python, Java, C++ & Scala would be a nice to have bonus. Team overview: Group Data Hub Want to unlock the power of data? Our Group Data Hub works with millions of data transformations every day to deliver value, improve customer experience and enable new product launches. From architecture to analytics and engineering to science: it’s how we bring customers more of what they love. The rewards: There's one thing people can't stop talking about when it comes to LifeAtSky: the perks. Here’s a taster: Sky Q, for the TV you love all in one place The magic of Sky Glass at an exclusive rate A generous pension package Private healthcare Discounted mobile and broadband A wide range of Sky VIP rewards and experiences Inclusion & how you'll work: Recognised by The Times and Stonewall, we take pride in our approach to diversity and inclusion. Investing in society, fighting racial injustice and setting ambitious targets for representation at Sky. We’ve embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You’ll find out more about what hybrid working looks like for your role later on in the recruitment process. Your office space: Osterley Our Osterley Campus is a 10-minute walk from Syon Lane train station. Or you can hop on one of our free shuttle buses that run to and from Osterley, Gunnersbury, Ealing Broadway and South Ealing tube stations. There are also plenty of bike shelters and showers. On campus, you’ll find 13 subsidised restaurants, cafes, and a Waitrose. You can keep in shape at our subsidised gym, catch the latest shows and movies at our cinema, get your car washed, and even get pampered at our beauty salon. We'd love to hear from you Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It’s a place where you can explore what if, how far, and what next. But better doesn’t stop at what we do, it’s how we do it, too. We embrace each other’s differences. We support our community and contribute to a sustainable future for our business and the planet. If you believe in better, we’ll back you all the way. Just so you know: if your application is successful, we’ll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer.