Domain Expert Music
Job summary
We are seeking a highly qualified Music Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within music theory, genres, composers, artists, production, instruments. This role exists to support thoughtful business decisions through accurate, dependable work. You will manage day-to-day responsibilities with a strong focus on quality and collaboration. Work is primarily asynchronous, with most tasks completed independently rather than through live meetings. The team is distributed across several countries and time zones.
Job descriptions & requirements
What You'll Do
- Create advanced prompts covering music theory, genres, composers, artists, production instruments.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback with reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and documentation
What We're Looking For
- Master's degree or higher in a discipline related to Music.
- 3+ years of professional, research, or teaching experience.
- Excellent written English and analytical skills.
- Strong attention to detail.
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.
Important safety tips
- Do not make any payment without confirming with the BrighterMonday Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.