Azure Data Engineering Consultant

ProCogia is a data consulting firm based in Vancouver, BC, with employees and clients in the United States and Canada. We specialize in Data Operations, Data Engineering, BI & Analytics, Data Science & Bioinformatics across numerous industries including Telecom, Pharma, Biotechnology, Retail, Logistics, Technology, Financial Services, Media & non-profit. As a technology-agnostic firm, we prioritize our client's needs in offering our Data solutions. We are a diverse, tightly-knit team that strives to provide superior, all-encompassing data solutions for our clientele. As a demonstration of appreciation for your skills and technical knowledge, you will receive a competitive salary, generous benefits package, and ample opportunities for personal development. We consistently seek a 'growth mindset' from all our new employees, and this has markedly contributed to our recent expansion throughout North America. Our unique approach emphasises pushing the boundaries and value derived from data. Being a part of ProCogia's dynamic environment will allow you to fully realise your career potential. In the last two years, ProCogia has seen significant growth and we place a high value on maintaining gender equality throughout the company. Our diversity and differences enable us to create innovative and efficient data solutions for our clients. Our Mission: We empower our customers to make intelligent and agile decisions through strategically tailored data solutions. We attract, develop, and retain diverse, motivated, and collaborative team players who are passionate about their chosen field. Our Values: TRUST: We establish trust in all our relationships, both internally and externally GROWTH: We advocate lifelong learning, both personally and professionally INNOVATION: Our technology-agnostic & innovative approach allows us to provide cutting-edge data solutions EXCELLENCE: We are dedicated to achieving excellence in all we do Job Description: The Data Engineering Consultant will carry out the following responsibilities and duties: - Design, implement, and maintain robust and scalable data pipelines on Azure - Implement and manage CI/CD pipelines for data engineering projects, using tools like Azure DevOps - Collaborate with Data Scientists and Analysts to facilitate the availability of clean, structured data for analytical purposes - Understand existing implementation and enhance as necessary - Work with other Data Engineers, Data Ingestion Specialists, and experts across cross-functional teams - Working with large datasets to fulfill functional and business requirements Requirements: The Data Engineering Consultant should have the following skills, education, and experience: Skills Required: - Expertise in SQL, Python, and PySpark using Spark framework - Strong knowledge of Microsoft Azure cloud services for building scalable data pipelines and workflow management - Experience with ETL/ELT and familiar with Data Warehouse concepts - Expertise in designing and working with efficient Data Models in big data ecosystem - Knowledge of API-based integration and security (Restful and SOAP) - Experience with Data Visualization tools such as Power BI - Ability to quickly learn and turn data into actionable results - Excellent communication skills with onsite team and client stakeholders Skills Preferred: - Experience with JSON Programming - Experience working with Azure DevOps - Experience with Docker/containerization - Solid Linux programming skills - Knowledge of Cosmos DB, Teradata, SQL Server Education Required: - Bachelor's degree in a quantitative field such as computer science or computer engineering, or other related disciplines Education Preferred: - Master’s or Ph.D. degree in a quantitative field such as computer science, computer engineering, or other related disciplines Experience: - At least 5+ years of professional experience in a Data Engineering role with a Master’s degree or 7+ years of experience in a Data Engineering role with a Bachelor's degree ProCogia is proud to be an equal opportunity employer. We are committed to creating a diverse and inclusive workspace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.