Senior Data Engineer

The Senior Data Engineer designs, constructs, and optimizes data pipelines for vital data and analytics capabilities within the company. This job requires collaboration with analytics and data warehousing staff, DBAs, and specialists to establish dependable processes that load specified data with quality and integrity, equipping it for strategic business use. Working within an agile and multidisciplinary team, the applicant must cooperate to deliver optimal data integration and transformation solutions. They will analyze data requirements, both functional and non-functional, to develop and design robust scalable automated data pipeline solutions for business and technology projects. The applicant will profile data to assess the accuracy and completeness of data sources and provide feedback in data-gathering sessions. Their responsibilities also include designing, constructing, maintaining, and operationalizing data pipelines for high volume and complex data using applicable tools and methods in development, test, and production environments. A crucial part of the role involves understanding and applying the suitable use of ELT, ETL, data virtualization, and other methods to optimize the balance of minimal data movement against performance, while also mentoring others on their appropriate use. The applicant should take the initiative in driving automation of data pipeline preparation and integration tasks to minimize manual, error-prone processes and increase productivity using modern data preparation, integration, and AI-enabled metadata management tools and techniques. In terms of experience, the applicant needs a Bachelor’s degree in computer science, data science, statistics, or economics, or related field, or equivalent experience. They should have excellent written and verbal communication skills, possessing the ability to gather requirements and effectively communicate technical concepts to all levels of employees and management. Having six or more years of experience in a development team providing analytical capabilities is required, along with six or more years of hands-on experience in the data space that includes data preparation, SQL, integration tools, ETL/ELT/data pipeline design. Preferred skills include experience in Azure, Azure Pipelines, Azure Devops, excellent understanding of T-SQL programming, critical thinking and problem-solving skills, and a familiarity with medical, insurance, and optical systems or industry. The salary range for this role is $80,000 to $135,000. VSP Vision is an equal opportunity employer, considering qualified applicants for employment without discrimination based on age, gender, race, color, religion, nationality, gender identity, sexual orientation, disability, or protected veteran status. The company maintains a drug-free workplace and conducts pre-employment substance abuse testing.