Join Our Team as a Senior Data Engineer at 3Pillar Global
🌟 Are you a tech visionary eager to drive innovation in software development? 3Pillar Global is looking for a passionate Senior Data Engineer to lead transformative data projects using cutting-edge technologies. This role is your gateway to influencing the data-driven decisions that revolutionize industries. 🔮🌐
Key Responsibilities
As a Senior Data Engineer, your main tasks will include:
- Designing, developing, and maintaining advanced data pipelines using AWS and other technologies to ensure optimal data availability and quality.
- Building and maintaining RESTful APIs to streamline data access and system integration.
- Developing and optimizing SQL queries for efficient data extraction, transformation, and loading (ETL).
- Managing multiple projects, prioritizing tasks effectively, and adhering to deadlines.
- Ensuring data quality, accuracy, and performance across large datasets.
- Working closely with both technical teams and business stakeholders to translate data requirements into robust technical solutions.
- Implementing data transformation, integration, and validation processes to support analytics and reporting needs.
- Optimizing data pipelines for enhanced speed, reliability, and efficiency.
- Adhering to best practices for data storage, retrieval, and archival to guarantee data security and accessibility.
- Diagnosing and resolving data-related issues in collaboration with the team.
- Documenting data processes and technical specifications for consistency and future reference.
- Participating in code reviews to ensure compliance with coding standards and best practices.
- Collaborating with DevOps teams to automate the deployment and monitoring of data pipelines.
- Leveraging cloud services, particularly AWS, to design and implement scalable and cost-effective data solutions.
- Staying current with new technologies, tools, and methodologies in the ever-evolving landscape of data engineering.
Minimum Qualifications
The ideal candidate should have:
- Proven experience in data engineering with specialization in designing, developing, and maintaining data pipelines using AWS.
- Expertise in Python for data processing and analysis and comprehensive knowledge of AWS for data storage, computation, and analytics.
- A solid foundation in cloud concepts, services (preferably AWS), SQL, and REST APIs.
- A good understanding of data architecture, modeling, and warehousing concepts.
- Experience in DevOps practices, including CI/CD automation with tools like Terraform and Jenkins.
- Fluency in English, enabling effective communication within a diverse and global team.
What is it like working for 3Pillar Global?
Experience a flexible work culture that supports both office and remote working alternatives. At 3Pillar Global, you're part of a dynamic global workforce, enjoying top-tier benefits focused on enhancing your well-being and accelerating your career growth through diverse projects and opportunities. We are firmly committed to equality and diversity, upholding values such as Intrinsic Dignity and Open Collaboration.
Interested in becoming a pivotal part of a leading tech firm? Visit our Careers page and LinkedIn to learn more and apply today! Be ready for an exhilarating career journey at 3Pillar Global! 🌍💼 #LI-Remote
Company Name: 3Pillar Global
Job Title: Senior Data Engineer (AWS+Python)