Big Data Engineer - Data & AI

Job Description

The range for this position is (employment contract):

mid: 12,300 - 17,600 PLN in gross terms

senior: 16,100 - 23,200 PLN in gross terms

A hybrid work model that integrates solutions developed by the leader and the team.

As part of the Data & AI field, we carry out projects based on practical applications of "data science" and "artificial intelligence" on an unprecedented scale in Poland. Data & AI is a group of over 150 experienced BigData engineers organized into more than a dozen teams with diverse specializations. Some of them build dedicated tools for initiating and launching BigData processes or introducing ML models for the entire organization. Others work more closely with the client and are responsible for implementing the search engine, generating recommendations, creating a buyer profile or developing an experimental platform. We also have research teams in the area whose goal is to find solutions to non-trivial problems requiring the use of machine learning.

We are looking for BigData engineers who want to construct a highly scalable and fault-tolerant data ingestion for millions of Allegro customers. The platform accumulates 5 billion clickstream events each day (up to 150k / sec) from all Allegro sites and Allegro mobile applications. This is a hybrid solution using a mixture of on-premise and Google Cloud Platform (GCP) services like Spark, Kafka, Beam, BigQuery, Pubsub or Dataflow.

We are seeking individuals who:

• Program in languages like Scala or Java
• Have a solid understanding of distributed systems, data storage, and processing frameworks like Hadoop, Spark, Kafka, Flink, or similar.
• Are knowledgeable about GCP or other public cloud environments like Azure or AWS
• Use good practices (clean code, code review, TDD, CI/CD)
• Are proficient within Unix/Linux systems
• Show interest in the application of ML AI
• Possess a positive attitude and team-working skills
• Are eager for personal development and keeping their knowledge current
• Possess English proficiency at B2 level and Polish at minimum C1 level

What we offer:

• A hybrid working model that you will agree with your leader and team. We provide well-located offices (with fully equipped kitchens and bicycle parking) and excellent working tools (height-adjustable desks, interactive conference rooms).
• An annual bonus of up to 10% of the annual gross salary (depending on your annual assessment and the results of the company).
• A broad selection of fringe benefits in a cafeteria plan – you choose what suits you (e.g. medical, sports or lunch packages, insurance, purchase vouchers).
• We pay for English classes that are relevant to your specific job nature.
• A laptop with m1 processor, 32GB RAM, SSD - a 16” or 14” MacBook Pro or corresponding Dell with Windows (if you prefer), two monitors and all other necessary equipment.
• Be part of a supportive team of top-class specialists and experts in their fields.
• A high degree of autonomy in organizing your team's work; we encourage continuous development and trying new things.
• Participation in hackathons, team tourism, training budget and an in-house educational platform, MindUp (including courses on work organization, means of communication, motivation to work and various technologies and technical issues).
• If you want to learn more,

Why is it worth working with us?

• At Allegro, you will be responsible for processing petabytes of data and billions of events daily.
• You will become part of one of the largest projects to build a data platform in GCP.
• Your development will be in line with the latest technological trends based on open source principles (data mesh, data streaming).
• You will have a real impact on the direction of product development and technology selection. We use the latest and best technologies, tailored to our needs.
• You will get the chance to work within a team of experienced engineers and big data specialists who are keen to share their knowledge, even publicly through .
• Once a year, you can seize the opportunity to work in a different team (known as ).

Upload your CV and discover why it is #dobrzetubyć (#goodtobehere)