Senior Physician / Surgeon Expert (AI Clinical Evaluation)

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering tale solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for experienced physicians and surgeons to support the training and evaluation of advanced AI systems. The role focuses on creating and reviewing complex clinical scenarios that test AI capabilities in diagnostic reasoning, differential diagnosis, treatment planning, guideline interpretation, and clinical risk management.

This opportunity is best suited to senior clinicians with substantial post-residency practice who remain current with modern standards of care and can translate complex medical judgment into structured, technically precise evaluation tasks.

CONTRACT: Short-term contractor assignment, 9 weeks

COMMITMENT: At least 4 hours per day and up to 40 hours per week, including 4 hours of PST overlap

LOCATIONS: Remote - Brazil, Chile, Mexico, Canada, Colombia, Albania, Bosnia and Herzegovina, Croatia, Czech Republic, Estonia, Georgia, Hungary, Iceland, Latvia, Lithuania, Moldova, Monaco, Poland, Romania, Serbia, Slovakia, Slovenia, United Kingdom

PROCESS: 60 min Online test about Clinical & Health (MSQ questions)

NOTES: Candidates must have actively practiced within the last 3 years and hold an MD, DO, or regionally equivalent medical qualification with active or recent specialty board certification.

Responsibilities

• Create high-difficulty clinical tasks based on realistic physician and surgical scenarios.
• Develop gold-standard solutions covering diagnosis, workup, treatment planning, and clinical decision-making.
• Build cases involving complex histories, laboratory results, imaging, symptoms, and competing diagnostic hypotheses.
• Evaluate AI-generated clinical outputs for accuracy, completeness, safety, and adherence to current standards.
• Create scenarios involving differential diagnosis, treatment pathways, procedural decisions, and risk management.
• Apply established evaluation rubrics and grading standards consistently.
• Review and refine patient charts, clinical management plans, consultation notes, and treatment recommendations.
• Incorporate calibration feedback and revise task designs as required.
• Maintain strong alignment with current medical guidelines and patient-safety principles.
• Escalate genuine clinical edge cases or ambiguous evaluation criteria to the functional expert lead.

Requirements

• MD, DO, or equivalent medical qualification with recent board certification.
• 8-15 years of post-residency clinical practice.
• Active clinical practice within the last 3 years.
• Expertise in complex diagnostic reasoning and treatment planning.
• Proven track record of high-level medical deliverables.
• Exceptional analytical thinking and attention to detail.
• Superior written communication skills.
• Ability to work independently in a fast-paced environment.