Role
Overview
Evaluate and compare the quality of responses from multiple AI chatbots across real-world small business use cases.
Responsibilities
Create realistic business-related prompts based on defined user goals
- Interact with multiple AI chatbots (max. 5 turns per conversation)
- Assess response quality across clarity usefulness and accuracy
- Provide structured feedback and comparative evaluations
- Submit conversation transcripts and evaluation results
Requirements
Business owner or strong understanding of small business operations
- Talents must have business-related documents available in English.
- Strong analytical and critical thinking skills
- Ability to follow structured evaluation guidelines
- Comfortable interacting with AI tools What you'll work on
- Create engaging visual content for marketing
- Help answer and evaluate situations related to day-to-day operations and customer interactions
- Conduct market research and contribute ideas in your area of expertise
- Work with data to support analysis and financial planning
- Review and evaluate AI-generated responses for small business use cases
- Use tools and input files such as spreadsheets PDFs and images as part of your workflow Note
- The business type does not matter.
- Candidates must submit their business portfolio in English. Application Question(s) Do you currently own or operate a small business or do you have strong hands-on experience managing small business operations? How many years of experience do you have in running/managing a business or working closely with small business operations? Are you comfortable working with AI chatbots and evaluating the quality of their responses? Have you previously used AI tools such as ChatGPT Gemini Claude or similar tools for business-related tasks? Are you comfortable creating realistic prompts based on real-world small business scenarios and comparing responses from multiple AI chatbots? Do you have business-related documents in English (such as spreadsheets PDFs financial records marketing materials reports or business documents) that you can use as part of this project?
Work Location
Remote