Opus 4.6 is smart enough to realize it is being evaluated.
It found the benchmark it was being evaluated on. It reverse-engineered the answer-key decryption logic.
Realized the file was not in the correct format on GitHub and found a mirror for the file. Then decrypted it and gave the correct response.
Models are getting so clever, it's almost scary.
@aipost
It found the benchmark it was being evaluated on. It reverse-engineered the answer-key decryption logic.
Realized the file was not in the correct format on GitHub and found a mirror for the file. Then decrypted it and gave the correct response.
Models are getting so clever, it's almost scary.
@aipost
Opus 4.6 is smart enough to realize it is being evaluated.
It found the benchmark it was being evaluated on. It reverse-engineered the answer-key decryption logic.
Realized the file was not in the correct format on GitHub and found a mirror for the file. Then decrypted it and gave the correct response.
Models are getting so clever, it's almost scary.
@aipost 馃彺
0 Commentarii
路0 Distribuiri
路177 Views
路0 previzualizare
