Principal Data Engineer

Job expired!

Join Creditas as a Principal Data Engineer

Creditas, a pioneering digital platform in Latin America, is dedicated to enhancing lives through three main ecosystems: automotive, real estate, and corporate benefits. Since its inception in 2012, Creditas has been at the forefront of delivering an extensive array of products and services, including fintech solutions, digital insurance, and consumer solutions, facilitated by our proprietary technology to offer a distinctive experience to our customers. Our extensive portfolio incorporates home loans, vehicle finance, and payroll loans, offering integrated financial solutions and refinancing options.

In the digital insurance sector, we stand as Brazil's largest independent broker, providing automotive, residential, and corporate insurance in collaboration with over 17 operators. Employing more than 2,500 team members across offices in São Paulo, Valencia (Spain), and Mexico City, Creditas has raised over US$829 million from international venture capital funds and has been recognized by KPMG, Business Insider, and Glassdoor as one of the world's most promising fintechs.

Our Product Technology Team

At Creditas, technology is the driving force behind our business scalability, process optimization, cost reduction, and delivering premier experiences to pave the way for our clients' new achievements. With technology developed entirely in-house, we work with all market programming languages and thrive on challenges and problem-solving. If technology fuels your drive and making a difference is your passion, join us on this remarkable journey!

Key Responsibilities

As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring efficient handling of large-scale data processing and storage, supporting the construction of the Creditas Data Platform. You will:

  • Design, build, and maintain scalable and reliable data pipelines and database systems.
  • Manage solutions and automate processes using tools like Spark, AirFlow, Redash, EMR, and Redshift while ensuring adherence to data governance policies.
  • Develop scalable data processing solutions on AWS, implement CI/CD processes for these solutions, and leverage Infrastructure as Code (IaC) tools to streamline data operations and enhance data solution deployments.
  • Implement cutting-edge data solutions using technologies such as Spark, Python, and various AWS services (S3, Redshift, EMR, Athena, Glue).
  • Guide and mentor team engineers, promoting an environment of continuous growth and improvement.
  • Identify and address gaps in team capabilities and processes to enhance efficiency and success.

Requirements:

  • Proven experience in data engineering, with significant involvement in data engineering and BigData projects.
  • Strong programming skills in Python, Java, Scala, or similar languages.
  • Hands-on experience in building scalable data platforms and reliable data pipelines using technologies such as Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, Kafka, etc.
  • Comfortable with modern backend system building blocks, event-driven architecture, and able to articulate pros/cons of different approaches with recommended solutions.
  • Deep knowledge in data processing, comfortable working with large datasets and distributed data processing at scale.
  • Familiarity with industry databases and analytical technologies, including Data Warehousing, Data Lakes, ETL, and relational databases.
  • Comfortable working with containerization and orchestration technologies (Docker, Kubernetes…).
  • Commitment to quality, pride in delivering precise, high-performance, and reliable data work, setting a high standard for the team and organization.
  • Strong analytical and problem-solving skills, with the ability to innovate and adapt in fast-paced environments.
  • Technical reference for fellow engineers, demonstrating empathy, creativity, curiosity, and customer handling skills.
  • Designed and built scalable and secure solutions.
  • Availability to work onsite one week per month at our headquarters in São Paulo.

Recruitment Process

The selection process starts from the application stage; some opportunities might include additional tests. The duration of the process is flexible, but don't worry! Our Talent Acquisition team is prepared to provide the best experience possible. We meticulously review all profiles and consistently provide feedback, regardless of the application stage. Instructions will be sent via email.

Benefits at Creditas

  • Life Insurance; Health Insurance (SulAmérica); Dental Insurance (SulAmérica).
  • Corporate University (Academy); Zenklub: free psychological or coaching sessions.
  • Gympass: access to gyms and studios; Meditas