Azure Lead: Databricks

Job expired!

Azure Lead Job Opening at Birlasoft

Job Title: Azure Lead: Databricks

Experience Required: Minimum 8 years, including at least 3 years in Azure-related projects

Job Responsibilities

We are seeking a skilled Azure Data Engineer with expertise in multiple Azure technologies including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Spark SQL, Azure Blob Storage, Azure Delta Lake Storage, and Azure SQL Server Database. As an Azure Lead at Birlasoft, your key responsibilities will include:

  • Leading data ingestion from various source systems such as Oracle, SQL Server, and SharePoint, ensuring data integrity, accuracy, and quality.
  • Developing a metadata-driven framework for efficient data ingestion from relational databases and files.
  • Creating advanced data modeling views such as silver views and custom views using Synapse Analytics based on source queries.
  • Managing the Ingestion team, setting clear tasks and deadlines, resolving issues, and monitoring overall progress.
  • Overseeing and optimizing ADF Pipelines operational in production settings.
  • Designing and implementing pipeline jobs and scheduling triggers using Azure Data Factory.
  • Utilizing Azure Databricks for managing clusters, working with Notebooks, and developing code using Spark SQL and Dataframes.
  • Adapting to both Software Development Life Cycle (SDLC) and AGILE methodologies during the project lifecycle.

Preferred Qualifications and Skills

The ideal candidate for the Azure Lead position will possess the following:

  • Proven experience as an Azure Data Engineer with comprehensive knowledge of Azure Data Services.
  • Strong leadership skills with experience in managing technical teams.
  • Expertise in data engineering, data integration, and establishing data workflows tailored to business requirements.
  • Efficient in problem-solving, with an analytical mindset conducive to handling complex datasets.
  • Excellent communication and collaboration skills, capable of working closely with cross-functional teams.

This role is critical in driving the strategic data capabilities for Birlasoft. If you are looking to lead exciting Azure projects and advance your career in a vibrant technological environment, we would love to hear from you.

Location: Opportunities available nationwide. Please specify your preferred location in your application.

How to Apply: Submit your resume and a cover letter outlining your relevant experience and why you are the best fit for the Azure Lead position at Birlasoft.

We look forward to your application and possibly welcoming you to the Birlasoft team!