Senior Machine Learning Engineer

This role is responsible for the continuous development, communication and formation of the Generative AI strategy. Concurrently, it propels the corporation's preliminary use cases by constructing patterns and products, leading and advising stakeholders. The successful applicant will have a robust background in AI and machine learning, along with expertise in software development and engineering with an emphasis on LLM and Generative AI applications. He/she will be an integral part of the technical leadership team for Generative AI, in charge of turning business cases, approved by successful PoCs, into production, as well as expanding the future pipeline.

Responsibilities:

• Design Generative AI/LLM application solutions, with complete responsibility for delivering innovative and effective products that meet the needs of stakeholders and customers.
• Act as the Generative AI thought leader, advocate and SME within the bank and as a reliable advisor for stakeholders.
• Transform requests into actionable product/service requirements that fuel the development of technological solutions and influence the direction of the service.
• Responsible for ensuring that the products and services are supported by the appropriate architectures and solutions that meet customer needs.
• Ensure alignment between solutions and the platform architecture and roadmap, group norms and policies, and the overarching enterprise architecture for their function.
• Stay informed of the newest research and developments in LLM and Generative AI, using these insights to enhance our solutions.
• Design data preprocessing and integration pipelines for contextual embedding, with the potential for fine tuning LLM models.
• Conduct a PoC on prompt engineering practices, designing a prompt extraction flow for LLM apps based on user requirements and technical constraints.
• Coordinate with other engineers, architects, and business stakeholders to understand and direct the product or service's path.
• Establish a digital environment and automate processes to minimize inconsistency and guarantee predictable, high-quality code and data.
• Create technical test plans and records, including unit and integration tests, within automated test environments to ensure code quality. 
• Guide the Generative AI/LLM system's performance and accuracy improvement through experimentation, testing, assessment, and analysis.
• Provide training and support for business users to help them effectively utilize the Generative AI/LLM solutions.
• Ensure service resiliency, service sustainability, and recovery time objectives are met for all the software solutions provided.
• Support DevOps teams working at all stages of a product or service release/change, maintaining a customer focus and end-to-end journeys, and ensuring they have exceptional domain knowledge.
• Collaborate with Ops, Dev, and Test Engineers to ensure operational issues (performance, operator intervention, alerting, design defect related issues, etc.) are identified and addressed at all stages of a product or service release/change.
• Work with Ops Engineers to address operational issues (performance, operator intervention, alerting, design defect related issues, etc) and to resolve any design-related issues in a timely manner.
• Remain up-to-date and be an expert in current tools, technologies, and areas such as cyber security. Understand relevant regulations pertaining to aspects like data privacy, consent, data residency etc.
• Responsible for ensuring that the design of the product solutions are cost-effective and maintained throughout the agile development life cycle, managing the flow of the design activities backlog. 

Requirements:

• Minimum of 8 years of hands on experience with application design or solution architecture.
• Strong hands-on experience with solutions architecture and engineering, dealing with complex enterprise solutions, e.g. design for availability, scalability, functionality, resilience, and maintainability, and ensuring they can be executed. 
• Comprehensive knowledge of end-to-end application architecture with a focus on non-functional requirements that are critical in financial service applications.
• Experience in creating best practices for architecture, clear choices, guidelines, roadmap documents, and technical patterns and PoCs. 
• Familiarity with cloud platforms, and experience on at least one cloud platform among Azure, GCP, AWS and Ali Cloud.
• Knowledgeable with programming, database technology and relevant design patterns (e.g., Java/Python/Golang/Node.js/relational DB/NOSQL DB).
• Able to use and expand common open frameworks (e.g. Langchain, LlamaIndex, etc.), NLP algorithms/packages (e.g., embedding, word2vec, NLTK, Gensim, spacy, etc.) with knowledge and/or experience with vector databases.
• Experience with setting up a quick PoC environment on a cloud, container, etc.
• Experience managing a delivery program across multiple workstreams.
• Experience overseeing technological adoption from conception, design, development to production.
• Experience with hands-on delivery of digital products in a large enterprise 
• Fluent in Mandarin, Cantonese and English.
• Good written communication skills in both Chinese and English.
• Previous work experience in the financial industry or a related field is preferred.