anon-caa-neurips/klinikebench
KlinikeBench (Harbor RL environment): Harbor dataset on Hugging Face with 333 tasks. SFT & RL code 333 clinician-authored clinical consultations as Harbor tasks. In each task the agent plays the clinician: it interviews an LLM-simulated patient and uses a clinical tool sandbox (chart, labs…
Tasks
- Genetics consultation: My child is very short with bowed legs and snores loudly
- Genetics consultation: My child has a very nasal voice and keeps getting ear infections
- Genetics consultation: Lifelong learning and social difficulties with recent mood and behavior changes
- Genetics consultation: My child is getting weak and stiff, and isn’t growing well.
- Genetics consultation: My baby has unusual head shape, hand and foot differences, and a swollen neck sac
- Ophthalmology consultation: New double vision and one eye turning inward
- Internal Medicine consultation: Tired all the time with belly pain, aching joints, and yellow eyes sometimes
- Internal Medicine consultation: Trouble swallowing with black stools, tiredness, and belly bloating
- Internal Medicine consultation: Worsening breathing trouble, cough and rash.
- Sleep Medicine consultation: I keep falling asleep in the daytime and sometimes my body gives out
- Genetics consultation: Breathing trouble
- Internal Medicine consultation: Painful mouth and genital sores with red skin bumps
- Internal Medicine consultation: I'm thirsty all the time and lately I feel shaky and my heart races.
- Internal Medicine consultation: Tiredness, and shortness of breath with activity
- Internal Medicine consultation: a 6-year-old boy has been coughing up blood on and off for the past year, and lately he gets out of breath…
- Internal Medicine consultation: Sudden pounding heartbeat and bad headaches
- Internal Medicine consultation: New temple headache with blurry vision
- Internal Medicine consultation: Worsening wheezing and cough
- Internal Medicine consultation: jaw stuck and whole body tightening up
- Internal Medicine consultation: Stomach cramps, constipation, headaches, and trouble focusing
- Internal Medicine consultation: High fever, body aches, dry cough, and trouble breathing
- Internal Medicine consultation: Tired all the time, feeling unusually cold
- Genetics consultation: Getting weaker over time and having trouble walking
- Genetics consultation: My child is very pale, tired, and not growing well
- Internal Medicine consultation: Severe watery diarrhea and vomiting.
- Internal Medicine consultation: Deep belly and back pain with a throbbing feeling near my belly button
- Ophthalmology consultation: Sudden severe pain in one eye with blurry, doubled vision
- Internal Medicine consultation: Sharp pain low on the right side of my belly
- Internal Medicine consultation: My ear hurts, feels clogged, and has been itchy with some drainage
- Internal Medicine consultation: Ear pain with muffled hearing and a plugged feeling
- Internal Medicine consultation: My baby has a fever, cough, noisy breathing, and seems short of breath
- Internal Medicine consultation: Lower belly pain with unusual discharge
- Internal Medicine consultation: Coughing fits that end with throwing up, worse at night
- Dermatology consultation: Painful blisters and raw sores on my skin and in my mouth
- Internal Medicine consultation: Fever, cough, trouble breathing, and sharp pain in my chest
- Internal Medicine consultation: I can't see well in dim light and my eyes feel very dry
- Internal Medicine consultation: My skin and eyes are turning yellow and I've been losing weight
- Internal Medicine consultation: Sharp chest pain that gets worse when I breathe in or lie down
- Internal Medicine consultation: My heart suddenly starts racing out of nowhere
- Internal Medicine consultation: My leg suddenly hurts, feels numb, and is cold and pale
- ENT consultation: Gradually worsening hearing in one ear; my own voice sounds too loud
- Internal Medicine consultation: My belly feels bloated and I have a dull ache low in my stomach
- Gynecology consultation: Dull pain and pressure low in my belly
- Internal Medicine consultation: I keep leaking urine and also have trouble getting it out
- Internal Medicine consultation: Sudden sharp pain low in my belly with nausea and vomiting
- Mental Health consultation: Sudden wave of terror that came out of nowhere
- Internal Medicine consultation: I've been getting repeated kidney stone attacks with severe side pain
- Primary Care consultation: My toe is sore and the skin by the nail is red and puffy
- Internal Medicine consultation: Recurrent sudden palpitations with tachycardia and one episode of syncope.
- Gynecology consultation: Constant wetness and urine leaking from my vagina
- Gynecology consultation: A heavy, dragging feeling down below
- Internal Medicine consultation: Tingling and pins-and-needles in my hands and feet
- Internal Medicine consultation: Severe sharp belly pain
- Internal Medicine consultation: Severe sore throat on one side, hard to swallow
- Internal Medicine consultation: My throat is really sore
- Internal Medicine consultation: Sharp heel pain when I first get out of bed
- Internal Medicine consultation: Sharp pain on one side of my chest that started suddenly
- Internal Medicine consultation: Aching pain in my lower back that keeps coming back
- Gynecology consultation: I haven't had a period in months
- Internal Medicine consultation: I keep needing to pee all the time and have to rush to the bathroom
- Internal Medicine consultation: Itching around my bottom
- Internal Medicine consultation: Painful swollen stiff joints
- Internal Medicine consultation: Painful swollen joints in my hands and wrists
- Internal Medicine consultation: Burning when I pee with lower belly and side/back pain
- Pediatrics consultation: My child has a fever and a red rash
- Internal Medicine consultation: My fingers really hurt and sometimes go numb
- Internal Medicine consultation: Aching legs with a strong urge to move them at night
- Internal Medicine consultation: I've been getting more short of breath and have a cough
- Internal Medicine consultation: My knee is swollen, very painful, and I’ve had a fever
- Internal Medicine consultation: Joint pain and a rash
- Internal Medicine consultation: My lower leg is swollen, sore, red, and tender
- Internal Medicine consultation: My finger hurts, worse with movement
- Internal Medicine consultation: I've been gaining weight, my sugars are high, and my legs feel weak
- Internal Medicine consultation: Stomach pain with frequent loose stools
- Internal Medicine consultation: Trouble hearing and a constant ringing in one ear
- Dermatology consultation: Spreading pink rash on my chest and back that itches a little
- Internal Medicine consultation: Aching pain in my legs when I walk, and my feet feel cold
- Obstetrics consultation: Bad headache and swelling late in pregnancy
- Pediatrics consultation: My baby keeps throwing up after feeds and his belly looks swollen
- Dermatology consultation: Itchy, dry, scaly rash on my skin
- Internal Medicine consultation: I'm losing parts of my vision.
- Internal Medicine consultation: I've had a feeling of fullness under my left ribs.
- Internal Medicine consultation: Aching legs and shoulders with a lot of stiffness in the morning
- Internal Medicine consultation: Headaches and a feeling of fullness in my upper belly
- Internal Medicine consultation: My pee has turned really dark
- Internal Medicine consultation: Intense itching with small bumps, much worse at night
- Internal Medicine consultation: Feeling sick, throwing up, and very unsteady after drinking
- Dermatology consultation: Rough scaly spots on my face and hands
- Internal Medicine consultation: Painful swelling under my jaw with fever and bad taste in my mouth
- Internal Medicine consultation: Fluttering and skipped beats with occasional lightheadedness
- Pediatrics consultation: Baby is drooling, cranky, and chewing with swollen gums
- Oral Medicine consultation: Painful mouth sores that burn when I eat or talk
- Internal Medicine consultation: Feeling faint, slow pulse, nausea, and confusion.
- Internal Medicine consultation: Confused, seeing things, racing heart, can't pee, very dry mouth
- Internal Medicine consultation: My hands shake when I try to use them
- Medical Genetics consultation: I've had trouble getting words out since I was little, and I want to understand my body better.
- Medical Genetics consultation: My child is very floppy, far behind, and barely able to speak.
- Internal Medicine consultation: I can't catch my breath and my chest feels tight.
- Medical Genetics consultation: my son is 5 years old. He only says 'mama' and 'baba.' Other kids his age recite poems.
- Internal Medicine consultation: I've had repeated miscarriages and now I have painful sores on my legs.
- Ophthalmology consultation: My eyes keep itching on and off for months.
- Psychiatry consultation: I've been eating less and I'm getting scared about my weight and routines.
- Medical Genetics consultation: My baby's head shape seems unusual, and her arms and legs feel stiff.
- Internal Medicine consultation: I'm always thirsty and peeing all the time, even overnight.
- Medical Genetics consultation: I'm always thirsty, peeing a lot, and my sight and hearing keep getting worse.
- Internal Medicine consultation: the area around my mouth feels numb or buzzy, and sometimes my vision gets strange when I haven't eaten.
- Internal Medicine consultation: I've had a slowly growing swelling at the front of my neck.
- Internal Medicine consultation: a 7-year-old boy had a really high fever for days, with a bad cough, runny nose
- Internal Medicine consultation: I've been wiped out, losing weight, and getting dizzy when I stand.
- Internal Medicine consultation: months of bad sinus trouble
- Internal Medicine consultation: My hands shake and my body feels stiff and awkward.
- Internal Medicine consultation: My hands stay stuck after I grab things
- Internal Medicine consultation: I've had frequent nosebleeds and feel worn out.
- Internal Medicine consultation: I've had hard bumps on my hands and heels.
- Internal Medicine consultation: I'm having sudden sharp chest pain and trouble catching my breath.
- Internal Medicine consultation: I've been getting more short of breath and lightheaded when I exert myself.
- Internal Medicine consultation: I've been worn out for months, get short of breath, and my left side feels full and achy.
- Internal Medicine consultation: I keep getting painful lumps under my arms and in my groin that drain and won't go away.
- Internal Medicine consultation: My ears and nose keep getting painfully swollen, and several joints ache.
- Pediatrics consultation: My child is behind in learning and has had a strange body smell for years.
- Internal Medicine consultation: I've been coughing up blood and my urine looks dark, and I feel wiped out.
- Internal Medicine consultation: I've had high fevers, aching swollen joints, and a faint rash that comes and goes.
- Internal Medicine consultation: I've been wiped out, my pee is dark in the morning, and my belly keeps hurting.
- Internal Medicine consultation: I've been getting more short of breath when I walk, and I have a dry cough.
- Internal Medicine consultation: I have a bad pain under my right ribs .
- Internal Medicine consultation: I keep getting a burning pain high in my belly, especially after I eat.
- Internal Medicine consultation: I keep getting a burning feeling in my chest after meals.
- Internal Medicine consultation: I've had a bad headache that keeps getting worse, and my vision goes dim sometimes.
- Internal Medicine consultation: I get short of breath and chest tightness when I push myself.
- Internal Medicine consultation: I've had fevers and feel wiped out, and now I'm getting more short of breath.
- Internal Medicine consultation: I've been getting weak, short of breath.
- Internal Medicine consultation: I've turned yellow and feel wiped out with nausea and itching.
- Internal Medicine consultation: My legs are getting weaker and numb, and I'm swelling up all over.
- Orthopedics consultation: My lower leg still aches and I still can't put weight on it months after a small twist.
- Neurology consultation: The left side of my face suddenly went weak again
- Internal Medicine consultation: My skin and eyes turned yellow and the right side under my ribs really hurts.
- Ophthalmology consultation: My eyes are very uncomfortable.
- Internal Medicine consultation: My legs keep suddenly giving out and feeling too weak to move.
- Internal Medicine consultation: I'm always thirsty.
- Internal Medicine consultation: My periods stopped, my breasts are leaking, and I've been getting headaches.
- Dentistry consultation: Some of my teeth feel a little wobbly.
- Internal Medicine consultation: I've gotten really puffy around my eyes, belly, and legs.
- Pediatrics consultation: My newborn is very swollen, breathing hard, and not feeding well.
- Internal Medicine consultation: My fingers and toes get painful itchy purple spots when it's cold.
- Internal Medicine consultation: I've had urine that sometimes looks foamy.
- Internal Medicine consultation: I get really sick and queasy when I'm in a car or on a boat.
- Pediatrics consultation: My child keeps zoning out for a few seconds many times a day.
- Neurology consultation: My eyes keep squeezing shut and my mouth/jaw move on their own.
- Neurology consultation: I keep having random jerking movements and trouble holding things.
- Ophthalmology consultation: My left eye keeps watering and gets sticky near the inner corner.
183 more tasks.