Evaluates the ability to reverse-engineer a PyTorch Transformer model architecture from a state dictionary…
Evaluates the ability to reverse-engineer a PyTorch Transformer model architecture from a state dictionary…: a task in terminal-bench-2-1-apptainer-v1: Terminal-Bench 2.1 (offline Apptainer, v1) (Harbor dataset). Success Criteria: - The TorchScript model at /app/model.pt must be able to load the…
The task
Success Criteria: - The TorchScript model at /app/model.pt must be able to load the original weights from /app/weights.pt with no errors. - The only difference between the state dicts of /app/model.pt and /app/weights.pt should be in the weights of the output_layer. - The MSE loss using the updated output_layer must…