Job Opportunity: Senior Data Engineer at Globaldev Group
We are seeking an experienced Data Engineer to join our team at a renowned Swedish multinational telecommunications company and mobile network.
Key Responsibilities
As a Senior Data Engineer, you will be pivotal in designing, implementing, and maintaining robust data pipelines that power our analytics and business intelligence platforms. Your responsibilities will include:
- Onboarding and integrating new data sources into our data infrastructure.
- Designing, developing, and maintaining ETL processes to ensure timely and accurate data loading.
- Scheduling and managing data workflows using Apache Airflow.
- Optimizing and troubleshooting data processing jobs for performance and reliability.
- Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensuring data quality and consistency across various data sources and formats.
- Implementing and maintaining data storage solutions using HDFS, Object Storage, and S3.
- Working with data formats such as AVRO, Parquet, JSON, and XML.
- Utilizing CI/CD tools to automate deployment and ensure seamless integration.
- Maintaining and documenting code repositories using GitHub.
Qualifications
To be successful in this role, you should have:
- Proven expertise working with Apache Spark and Scala.
- Strong experience with Apache Airflow for workflow scheduling and management.
- Familiarity with various forms of data storage (HDFS, Object Storage, S3).
- Proficiency in handling different data formats (AVRO, Parquet, JSON, XML).
- Solid understanding of CI/CD processes and tools.
- Strong problem-solving skills and the ability to troubleshoot complex data issues.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team in a fast-paced environment.
What We Offer
At Globaldev Group, we value our employees and are proud to offer:
- 20 days of leave plus public holidays.
- The ability to work remotely or join our tech hub in Warsaw.
- Support from our caring HR team.
- Opportunities to exchange experiences and work with talented colleagues.
If you are passionate about data engineering and eager to work with a dynamic and innovative team, we would love to hear from you. Apply now to join Globaldev Group as a Senior Data Engineer.
Company Name: Globaldev Group
Job Title: Senior Data Engineer