Join Our Team as a Tech Lead Data Engineer in the Food and Beverage Industry!

Company Background: At Coherent Solutions, we are proud leaders in the food and beverage sector globally, reaching operations on five continents and boasting annual sales surpassing $7 billion. We collaborate with top-tier retailers, restaurants, and distributors to deliver excellence across the board.

Technical Expertise Required:

• Azure Databricks
• PySpark
• SQL
• Azure Data Factory
• Azure Data Lake
• Azure SQL DW
• Azure SQL
• Python

Your Role:

As a Tech Lead Data Engineer, your responsibilities will include:

• Developing a detailed technical plan for migration encompassing data ingestion, transformation, storage, and access control utilizing Azure Data Factory and Data Lake.
• Designing and implementing scalable data pipelines with Azure Databricks to facilitate smooth data movement from multiple sources.
• Creating scalable, reusable frameworks for data ingestion.
• Maintaining data integrity and quality throughout the data pipeline with robust validation and cleansing mechanisms.
• Utilizing event-based/streaming technologies for data ingestion and processing.
• Providing technical leadership and resolving technical challenges during and post-migration.
• Staying updated with advancements in cloud computing, data engineering, and analytics, recommending best practices and industry standards.

Job Requirements:

• 8 to 10 years of IT experience, particularly in Azure Databricks and PySpark.
• Proficiency in SQL and Python programming tailored to data engineering.
• Proven ability to manage data profiling, cataloging, and mapping for building technical data flows.
• Experience with data visualization tools.
• Technical leadership skills to guide teams effectively.
• Strong problem-solving skills and expertise in translating business requirements into practical data science solutions.
• Excellent communication skills for interacting with both technical and non-technical stakeholders.
• Upper-Intermediate level in English (both written and spoken).

Desired Skills:

• Microsoft Certified: Azure Data Engineer Associate.
• Experience in preparing data for Data Science and Machine Learning projects.
• Familiarity with Jupyter or Databricks Notebooks for Python development.

What Do We Offer:

Joining Coherent Solutions means being part of a firm that values your professional growth and personal well-being. Our comprehensive benefits package includes:

• Extensive technical and non-technical training opportunities.
• Participation in internal conferences and meetups with industry experts.
• Support and mentorship from experienced professionals.
• An internal startup incubator to foster innovation.
• Comprehensive health insurance.
• English language courses.
• Company-supported sports activities to promote health.
• Flexible working arrangements including remote and hybrid options.
• An employee referral program to encourage bringing new talent on board.
• Work anniversary recognition and extra vacation days.

If you are ready to take your career to the next level in an impactful industry, apply today to become our next Tech Lead Data Engineer!