Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Clarification: Regarding the Performance of IQuest-Coder-V1 (github.com/iquestlab)
1 point by bbatsell 48 days ago | hide | past | favorite | 1 comment


Anchor to new information (HN strips it from the URL): https://github.com/IQuestLab/IQuest-Coder-V1/issues/14#issue...

Context: Earlier this week a new model was released and researchers discovered that during training it had "cheated" on SWEBench by issuing git commands to find information it should have been blinded to.

Previous discussion: https://news.ycombinator.com/item?id=46472667




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: