Data Engineer II

Company Description

As Canada's largest aggregator of structured risk information and property data, Opta Information Intelligence is a premier supplier of property intelligence and ground-breaking technology solutions. Leveraging proprietary technology, Opta enables clients to access, comprehend, and integrate previously unattainable information, transforming it into intelligence that uncovers and clarifies business risks.

Job Description

We are seeking a competent Data Engineer with a solid foundation in Geographic Information Systems (GIS) to spearhead the creation and application of geospatial data pipelines and solutions within our dynamic Research & Development team. Working in synergy with departments such as data science, IT, and product teams, you will play a critical role in integrating spatial data to augment the value of our products and services. The ideal candidate will have an in-depth understanding of GIS principles, expertise in data engineering, and a passion for transforming complex geospatial data into actionable insights.

Key Responsibilities:

• Data Pipeline Development:
  • Design, develop, and manage efficient and scalable data pipelines for ingesting property-related data from different sources, integrating spatial data using GIS tools and approaches.
  • Lead the design and application of GIS data models and databases for efficient storage and retrieval of spatial data.
  • Ensure data accuracy by implementing data validation, cleaning, and transformation processes.
• Data Storage and Management:
  • Implement and oversee data storage solutions, considering spatial databases and data lakes, to store property data in a structured and accessible format.
  • Optimize data storage for performance, reliability, and cost-effectiveness.
• ETL (Extract, Transform, Load) Processes:
  • Develop ETL procedures to convert raw property data into usable formats for analytics and reporting reasons.
  • Cooperate with data analysts and scientists to comprehend data needs and carry out appropriate transformations.
• Data Integration:
  • Combine property data with other pertinent datasets to offer a comprehensive view of the real estate market, such as demographic, economic, and geographic data.
• Performance Monitoring and Optimization:
  • Monitor data pipelines and systems for performance issues and bottlenecks, proactively identifying areas for optimization.
  • Apply solutions to improve data pipeline efficiency, speed, and reliability.
• Data Security and Compliance:
  • Ensure the security and privacy of property data by implementing suitable access controls, encryption, and adherence to data protection regulations.
• Collaboration:
  • Work together with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data needs and offer solutions that accommodate their objectives.
• Documentation:
  • Keep detailed documentation of data pipelines, actions, and infrastructure to facilitate knowledge sharing and team collaboration.
• Emerging Technologies:
  • Stay up-to-date with industry trends and emerging innovations in geospatial and data engineering and identify opportunities to adopt innovative solutions that enhance data capabilities.

Qualifications

• A Bachelor's or Master's degree in Computer Science, Statistics, Mathematics, or a related field.
• At least 3 years of practical experience in data engineering, with a significant emphasis on GIS data integration and processing.
• Proficiency in designing and executing data pipelines, ETL processes, and data transformation workflows.
• Demonstrated experience working with geospatial data formats, geodatabases, and spatial databases.
• Experience with GIS tools and frameworks such as ArcGIS, QGIS, PostGIS, or similar.
• Familiarity with AWS services, including data-related ones such as S3, Lambda, Glue, and RDS.
• Strong programming skills in languages such as Python, along with experience in geospatial libraries and tools.
• Knowledge of geospatial visualization tools and techniques to support exploratory data analysis.
• Effective communication skills, capable of collaborating with technical and non-technical teams.
• A genuine passion for both Data Engineering and GIS, complemented by a growth mindset that fuels continuous learning.

Additional Information

We are proud to be a part of the Verisk family of companies!

Our fundamental goal is to help clients manage risk. Verisk (Nasdaq: VRSK) furnishes data and insights to our customers in insurance, energy, and the financial services markets, enabling them to make quicker and more informed decisions.

Our global team utilizes AI, machine learning, automation, and other emerging technologies to gather and analyze billions of records. We offer advanced decision-support to prevent credit, lending, and cyber risks. Moreover, we monitor and advise companies on complex global matters such as climate change, catastrophes, and geopolitical issues.

But the reason why we do our work is what differentiates us. It originates from a commitment to making the world better, safer, and stronger.

Verisk is part of the UN Global Compact sustainability initiative. We've made a pledge to balance 100% of our carbon emissions. Our "returnship" program is for experienced professionals rejoining the workforce after taking time away. Every year, our Innovation Day identifies our next first-to-market innovations to solve our customers’ challenges.

At its essence, Verisk uses data to minimize risk and maximize value. But the reason why we do what we do is far more significant.

At Verisk, you can build an exciting career with significant work, create a positive and lasting impact on business, and receive the support, coaching, and training you need to advance your career. We received the Great Place to Work® Certification for five consecutive years. Forbes has recognized us as a World’s Best Employer and a Best Employer for Women, testaments to our culture of engagement and the value we place on inclusivity and diversity. Verisk’s Statement on Racial Equity and Diversity demonstrates our commitment to these values and making positive and lasting changes in the communities where we live and work.

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.

Unsolicited resumes sent to Verisk, including those sent to a Verisk business mailing address, fax document, email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the reception of an unsolicited resume.

All your information will be kept confidential according to EEO guidelines.