there’s about 25 programs in ProgramBench that cannot be reasonably discovered simply by having access to the binary. sometimes the grader checks for a hash, and sometimes it checks whether it’s a golden or not to validate it.
there’s about 25 programs in ProgramBench that cannot be reasonably discovered simply by having access to the binary. sometimes the grader checks for a hash, and sometimes it checks whether it’s a golden or not to validate it.