Data Engineer

Job expired!
About Us Zuru Tech is digitizing the construction process of buildings worldwide. We have a multinational team developing the world's first digital building fabrication platform - you design, we build it! At ZURU, we develop the Zuru Home app, a BIM software tailored for the general public, architects, and engineers. From here, anyone can purchase, design, and send any type of building to manufacturing with complete design freedom. Welcome to the future! What are you Going to do? You will be responsible for developing and maintaining complex data pipelines, ETL, data models, and standards for various data Integration & data warehousing projects from source to sinks on Saas/Paas platforms such as snowflake, databricks, Azure Synapse, Redshift, BigQuery, etc. You will develop scalable, secure, and optimized data transformation pipelines and integrate them with downstream sinks. You will provide support to technical solutions from a data flow design and architecture perspective, ensure the right direction, and propose a resolution to potential data pipeline-related problems. You will participate in developing proofs of concept of key technology components to project stakeholders. You will develop scalable and reusable frameworks for ingesting geospatial datasets and develop connectors to extract data from sources, and use event/streaming services to persist and process data into sinks. You will collaborate with other project team members to support the delivery of additional project components. You will participate in evaluating and creating points of view around the performance aspects of data integration tools in the market against customer requirements. You will work within an Agile delivery/DevOps methodology to deliver proof of concept and production implementation in iterative sprints. What are we Looking for? You must have 2+ years of experience working as a Data Engineer in cloud transformation projects in the areas of data management solutions such as AWS or Azure or GCP or Snowflake, Databricks, etc. You must have hands-on experience in at least one end-to-end implementation of data lake/warehouse projects using Paas and Saas like Snowflake, Databricks, Redshift, Synapse, BigQuery, etc and 6 month+ data warehouse/data lake implementations on-premise. You should have experience in data pipeline development, ETL/ELT, implementing complex stored Procedures, and standard DWH and ETL concepts. You should be familiar with setting up resource monitors, RBAC controls, warehouse sizing, query performance tuning, IAM policies, and Cloud networking. You should have experience in Data Migration from on-premise RDBMS to cloud data warehouses. You should have a good understanding of relational as well as NoSQL data stores, methods, and approaches (star and snowflake, dimensional modeling). You should have hands-on experience in Python, PySpark, and programming for data integration projects. You should have good experience in Cloud data storage, data pipeline services, data integration services, and data visualization. You should support in providing resolution to a wide range of complex data pipeline-related problems, proactively and as issues occur. What do we Offer? We offer competitive compensation and an annual Performance Bonus. We operate on a five working day schedule with flexible hours. We provide annual trips & team outings, and medical insurance for you and your family. We also engage in training and skill development programs, give you the opportunity to work with a global team, and hold multiple pizza parties. There is a lot more on offer, come discover us!