Job expired!
Company Description
At KLYM, the first online platform offering 100% digital financial solutions to businesses, we are looking for a Data Engineer
Job Description
Be responsible for designing, developing, deploying standards and data pipelines that cover everything from data acquisition to the architecture and storage of this data, using best practices and cutting-edge solutions. Responsible for structuring and establishing the necessary processes for scaling and developing the data engineering team.
Functions:
Manage the architecture and development of data products using technologies such as Docker, Airflow, Python and AWS effectively and efficiently by considering best practices for software architecture and cost-benefit analysis.
Develop the company's information architecture, as well as using effective and efficient loads.
Ensure good practices throughout the company's data journey.
Execute processes of validating the quality and consistency of the data.
Requirements
- Minimum of three (3) years of experience in similar roles
Professional in mathematics, statistics, physics, economics, engineering or related careers.
Desirable, with specialization courses related to the area.
Previous experience in the use of Data Engineering and Big Data to solve business questions and to deliver end-to-end data products.
Additional Information
Technical Competencies:
Competency with Python and data transformation framework.
Mastery of Airflow and job programming.
Competency in AWS or similar cloud providers.
Knowledge of shell programming.
Linux server management.
Competency in the use of non-SQL databases.
Mastery of SQL for analytical queries: Window Functions, Joins, Aggregations, Subqueries, INSERTS, UPDATE, UPSERT and CREATE.
Understanding of Data Architecture: Data Structures, Complexity and Algorithms.
Desirable, competency with Docker and/or Kubernetes.
Competency in database design, data warehouse and data lake
At KLYM we are committed to building diverse teams and under conditions of equality, regardless of gender, ethnicity, religion, sexual orientation or background.
