Medical/Public Health- Consultant

Job Description

1. Validation of QA Pairs for the AI Assistant

Verify accuracy of information in QA pairs against specified pages and documents.
Validate and update identified pages, indicate if the answers are not updated from mentioned pages.
Validate QA pairs for correctness, completeness, and relevance based on document pages and highlighted text.
Modify existing QA pairs or create new ones as necessary to ensure all document text is covered accurately.
Highlight text on document as per modifications made.

2. Qualitative Evaluation of AI Assistant

Creation of dataset for evaluation, ensuring variation in input text
Programmatic testing of the AI Assistant
Provide feedback for model responses
Refer to the training data and support feedback with reasoning as to how the AI Assistant should generate expected answers.

3. Programmatic support in creating evaluation datasets

Creation of question-answer pairs that require both field level and domain level knowledge

REQUIREMENTS

Should have or be in the final year of a degree in public health, medical science, or a related field.
Strong attention to detail to ensure accuracy and completeness of QA pairs and document updates.
Excellent written and verbal communication skills to document updates and provide clear feedback.
Clear and concise visual and written documentation skills to effectively communicate system enhancements to the development team.
Basic knowledge and keen interest to learn more about AI deployments for social impact.
Experience training or working with front-line healthcare workers is beneficial.