Pod metrics requests can report misleading success when metrics are unavailable or behave inconsistently…
Pod metrics requests can report misleading success when metrics are unavailable or behave inconsistently…: a task in rh-swe-bench (Harbor dataset). What the agent is asked, how it is graded, what it runs in, and its files.
The task
Part of rounakbende/rh-swe-bench.