Domain Expert - Others
Job summary
We are seeking highly qualified Subject Matter Experts (SMEs) across a wide range of academic, research, and industry disciplines to support the evaluation, testing, and improvement of state-of-the-art Large Language Models (LLMs). In this role, you will leverage your expertise to evaluate AI-generated responses, design domain-specific prompts, identify knowledge gaps, and provide evidence-based feedback to improve the quality and reasoning capabilities of advanced AI systems. This role exists to support thoughtful business decisions through accurate, dependable work. You will manage day-to-day responsibilities with a strong focus on quality and collaboration. Work is primarily asynchronous, with most tasks completed independently rather than through live meetings. The team is distributed across several countries and time zones.
Job descriptions & requirements
What You'll Do
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, and quality.
- Identify factual errors, logical inconsistencies, and model weaknesses.
- Develop challenging test cases that expose model limitations.
- Provide clear, evidence-based feedback to improve model performance. Day - to - day task
- Write domain-specific prompts of varying difficulty.
- Compare multiple AI responses and rank them.
- Explain why a response is correct or incorrect using authoritative references.
- Identify ambiguous questions and propose improved prompts.
What We're Looking For
- Master's degree or higher in a relevant domain.
- Minimum 3 years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical skills and exceptional attention to detail.
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.
Important safety tips
- Do not make any payment without confirming with the BrighterMonday Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.