AI prompt and quality engineer

Website CoinMarketCap

CoinMarketCap is a website that provides information and data such as prices, trade volumes, market capitalization on cryptocurrencies. It was founded in 2013 in New York City by Brandon Chez.

Responsibilities

  • Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness
  • Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure
  • Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality
  • Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization
  • Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes

Requirements

  • Technical Skills
  • Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria
  • Basic data-analysis skills; proficient in SQL, Excel, and related tools
  • Foundational knowledge of Natural Language Processing (NLP) and Machine Learning
  • Experience
  • 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred
  • Experience with industry-leading AI Chatbot products is a strong plus
  • Soft Skills
  • Strong communication and collaboration abilities
  • Meticulous, patient, and adept at identifying and solving problems
  • Thrives in a fast-paced environment and demonstrates a strong learning aptitude
Upload your CV/resume or any other relevant file. Max. file size: 18 MB.

Share: