Join Our Team as a QA Engineer for AI Platforms

Are you passionate about cutting-edge technologies and AI systems? Emergence is looking for a skilled QA Engineer to join our team and ensure the highest standards in our AI platforms. Dive into NLP concepts, LLM testing, and automation frameworks with us!

Responsibilities:

• NLP and LLM Expertise: Deep understanding of NLP concepts, LLM architectures, and evaluation metrics.
• Programming Skills: Strong programming skills in Python and test automation tools. Proven ability to write efficient test scripts, automation frameworks, and perform data analysis.
• LLM Testing Strategies: Extensive experience in designing and executing comprehensive LLM testing strategies. Ability to design and implement automation frameworks tailored for Large Language Models.
• CI/CD Integration: Integrate LLM automation tests into CI/CD pipelines.
• Software Testing Methodologies: Deep understanding of software testing methodologies and hands-on experience with defect management tools. Familiarity with version control systems and CI/CD pipelines.
• LLM-specific Tools: Hands-on experience with LLM-specific testing tools, text comparison tools, and data visualization libraries such as Weights and Biases, DeepEval etc.
• Data Privacy: Knowledge of data privacy regulations and experience designing tests to detect and mitigate biases in LLMs.

Qualifications:

• A BS in computer science or related field.
• A minimum of 3-5 years of experience in testing LLMs and LLM-based systems.
• Strong knowledge of LLMs, VLMs, or MLLMs.
• Proficiency in Python.
• Experience with Git, CI/CD.
• Familiarity with cloud deployment (GCP or AWS), and Docker.
• Strong communication skills.

Benefits:

• Every last Friday of the month Paid Time off for everyone.
• 401(k) matching.
• Dental insurance.
• Flexible schedule.
• Flexible spending account.
• Health insurance.
• Health savings account.
• Life insurance.
• Unlimited Paid time off.
• Parental leave.
• Vision insurance.

About Emergence

Emergence is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic. We are an equal opportunity employer and make hiring decisions based solely on qualifications, merit, and business needs.

Apply now to join Emergence as a QA Engineer for AI Platforms and contribute to innovative AI technologies!