Senior Software Engineer (Azure databricks)
- Azure
- Other places
- 06/12/2024
- -
Job Title: Senior Software Engineer (Azure Databricks)
Company: Emids
Experience Required: 4 to 8 years
Location: Bangalore
Data Pipeline Design and Development: As a Senior Software Engineer, you will collaborate with data scientists, analysts, and other stakeholders to design, develop, and implement efficient data pipelines. Your role will involve integrating various data sources to transform raw data into actionable formats, supporting our company's data-driven goals.
Cloud Data Platform Management: Utilize your expertise in cloud-based platforms, particularly Azure, to architect, deploy, and maintain scalable and reliable data infrastructures.
Databricks Expertise: Demonstrate a robust understanding of Databricks, utilizing it as the primary platform for big data processing, analytics, and machine learning initiatives.
ETL Processes: Implement robust Extract, Transform, Load (ETL) processes to manage data from diverse sources, ensuring it is transformed into suitable formats before loading into our analytical systems or data warehouse.
Data Security and Compliance: Ensure the highest levels of data security and compliance with relevant data privacy regulations throughout our data engineering processes.
Collaboration and Technical Support: Work closely with cross-functional teams, including data scientists and business analysts, to deeply understand data requirements, share insights, and provide essential technical support.
Troubleshooting and Issue Resolution: Proactively identify and address data-related issues to ensure smooth data operations. Your quick problem-solving skills will be crucial in maintaining operational excellence.
Documentation: Maintain detailed documentation of data pipelines, architecture, and processes. This will aid in ensuring clarity and ease of understanding for team members and will facilitate ongoing and future data engineering initiatives.
Join Emids in Bangalore as a Senior Software Engineer specializing in Azure and Databricks, and contribute to leading-edge data solutions in a dynamic, technology-driven environment. Apply now to become part of a visionary team dedicated to innovative projects and professional growth. Your expertise in data engineering and cloud platforms will help us continue to lead and innovate in this vibrant tech landscape.