Prompt Engineer - Join Vectra AI's Office of the CTO

Vectra AI is the leader in AI-driven threat detection and response for hybrid and multi-cloud enterprises. Our cutting-edge Vectra AI Platform delivers integrated signals across public cloud, SaaS, identity, and data center networks in a single, cohesive platform. Powered by patented Attack Signal Intelligence, Vectra AI empowers security teams to prioritize, investigate, and respond to sophisticated cyber-attacks swiftly and efficiently. With 35 AI-driven threat detection patents and extensive vendor references in MITRE D3FEND, organizations worldwide trust Vectra AI to keep pace with hybrid attackers.

About the Role

Vectra AI’s Office of the CTO is expanding its Emerging Technologies team to include a talented Prompt Engineer dedicated to contributing to our next generation of AI-based products and services. This role focuses on ongoing research initiatives and prototypes, mainly leveraging large language models (LLMs).

The ideal candidate will collaborate on the challenging aspects of early-stage research and development while also working independently in their specialized area. Comfort with open-ended research ambiguity and a strong drive to converge research into concrete, supportable specifications and implementations are crucial for this position.

Team Responsibilities

• Envision, develop, and test prototypes to demonstrate feasibility and potential impact on new or existing business lines.
• Transition prototypes from early-stage design to long-term, supportable states in partnership across organizational boundaries.
• Investigate emerging technologies to identify innovative opportunities.
• Promote continuous learning, experimentation, and collaboration within the CTO organization and across Vectra AI.

Individual Responsibilities

• Architect, build, and maintain infrastructure to support multi-agent LLM-based AI Assistants.
• Collaborate with security researchers, sales engineers, and UX teams to understand product use-cases and workflows.
• Prototype AI assistants and automation to achieve desired outcomes.
• Develop, test, and deploy machine learning models and AI algorithms, focusing on LLMs.
• Optimize models for performance, scalability, and reliability.
• Design and implement data pipelines and workflows to support AI and ML projects.
• Educate the engineering organization on AI/LLM infrastructure and facilitate knowledge transfer to broader teams.
• Leverage AI/ML expertise to collaborate with cross-functional teams to accelerate research through platform capabilities.
• Maintain research velocity by flexing into adjacent technical domains when necessary.

Qualifications

• Bachelor’s degree in Computer Science or a related field (Master’s or Ph.D. preferred).
• Extensive experience with Python and ML frameworks such as PyTorch, TensorFlow, and JAX.
• Expertise in working with and deploying large language models (LLMs), including proficiency in prompt-engineering techniques like chain-of-thought and self-reflection.
• Experience with Retrieval-Augmented Generation (RAG) and VectorDB technologies.
• Skills in fine-tuning models and accelerating LLMs.
• Experience with Reinforcement Learning from Human Feedback (RLHF) is a plus.
• Familiarity with frameworks like Langchain and MS Guidance.
• Understanding of LLM evaluation metrics (perplexity, accuracy, etc.).
• Experience developing and deploying for cloud platforms like AWS and Azure.
• Ability to understand and prototype novel ML methods from academic literature.
• Real-world experience in evaluating LLM performance in production scenarios is highly desirable.
• Experience working in R&D organizations and familiarity with machine learning and data processing frameworks.

Compensation and Benefits

Our competitive total rewards package includes cash compensation within the range of $115,000—$190,000 USD. Actual pay may vary based on location, experience, and relevant incumbent pay position. Vectra AI offers a comprehensive total rewards package supporting the financial, physical, mental, and overall health of employees and their families. Compensation includes competitive base pay, incentive plan eligibility, and participation in the employee equity plan (stock options). Specific benefits vary by location but commonly include health care insurance, income protection/life insurance, retirement savings plans, behavioral and emotional wellness services, generous time away from work, and a comprehensive employee recognition program.