benchflow/openenv-smoke-fix-git
openenv-smoke-fix-git: Harbor dataset on Hugging Face with 10 tasks. Arena smoke test: the OpenEnv Terminal-Bench 2 fix-git task as source (environment/) and its built image as an OCI layout (images/fix-git/).
Tasks
- Evaluates the ability to implement async task concurrency control with proper cleanup on cancellation, including the edge case of queued…
- Find an optimal 1-hour meeting slot for three people with complex availability constraints by parsing ICS calendars and applying…
- Tests the ability to decrypt an XOR-encrypted SQLite WAL file and recover complete database contents including write-ahead log changes.
- Evaluates ability to parse ELF binary format and extract memory values from executable sections using Node.js.
- Evaluates the ability to identify and fix a CRLF injection vulnerability (CWE-93) in HTTP header handling code by adding input validation…
- Evaluates the ability to recover lost Git commits from a detached HEAD state and merge them back into the master branch.
- Evaluates the ability to recover secrets from unreachable git objects and completely remove them from repository history while preserving…
- Evaluates the ability to analyze date-stamped log files, calculate counts across multiple date ranges, and generate structured CSV output.
- Evaluates an agent's ability to generate self-signed TLS certificates using OpenSSL, manage cryptographic keys with proper permissions…
- Tests the ability to construct a complex regular expression that matches dates in log lines containing valid IPv4 addresses while handling…