Senior Data Engineer

São Paulo-SP, Brazil or Porto Alegre-RS, Brazil

Who We Are

In 2021, Poatek was purchased by WillowTree, an award-winning digital product consultancy acknowledged as one of the fastest expanding and best places to work in the United States. Now a , with offices all around the world, we continue to join forces with the world’s leading brands, such as Fox, Capital One, HBO, PepsiCo, Domino’s and more, to design, construct, and revamp their digital products and strategies. We’re looking to expand our Poatek offices in Brazil with first-rate talent eager to work together with team members worldwide to create innovative solutions for our clients.

Location and Flexibility

This is a hybrid role, which we've termed Work from Near (WFN). This model demands the ability to work on-site from our São Paulo - SP or Porto Alegre - RS office throughout the week based on team requirements, whilst also allowing the flexibility to work remotely on other days. Our WFN culture is designed to encourage in-person innovation, collaboration, and connection with team members locally and visiting from other global offices.

The Opportunity

As a Data Engineer part of our growing Data Science team, you will be in charge of designing, implementing, and maintaining robust and scalable data pipelines, enabling efficient data integration, storage, and processing across our numerous data sources. You will work together with cross-functional teams, including Data Scientists, Software Engineers, and other technical stakeholders, to ensure data quality and support data-driven decision-making.

Responsibilities 

• Be responsible for developing and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams;
• Create and maintain optimal data pipeline architecture;
• Assemble large, complex datasets that meet business needs;
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructures for greater scalability, and so on;
• Construct the infrastructure required for optimal extraction, transformation, and loading of data from a wide range of data sources using SQL, AWS, and Azure 'big data' technologies;
• Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications

• BSc, MSc, and/or PhD in Statistics, Mathematics, Physics, CS, or another related subject
• Experience in building and optimizing data pipelines, architectures, and 'big data' datasets
• Proficiency with Apache Spark with a general-purpose programming language such as Python or Scala
• Ability to create processes supporting data transformation, data structures, metadata, dependency, and workload management
• Should also have experience using the following software/tools:
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases
  • Experience with data pipeline and workflow management tools
  • Experience with AWS, Azure cloud services

Why Poatek?

Besides being part of an innovative consultancy firm with an international culture, you will have:

• Participation in an innovative consultancy company
• Flexible hours and autonomy
• Work on international and agile projects
• International travels
• Voucher for health activities
• English classes
• Support in national and international courses
• Food allowance
• Snacks, drinks and video game in the office
• Work in a company with highly-skilled professionals
• Transportation or parking spot
• Annual attractive bonus.

Equality is a principle here at Poatek. We are devoted to building an inclusive team that represents a diverse array of backgrounds, viewpoints, beliefs, and experiences. Therefore, we offer equal employment opportunities to all employees and applicants regardless of race, color, religion, gender identity, sexual orientation, national origin, age, or disability.

We will only utilize the information you provide to process your application and to generate tracking statistics. Since we do not request sensitive personal data, we ask you to refrain from sharing this information with us.

For more details on how we use your information, see our Privacy Policy.