GitHub Copilot can be tricked into writing harmful code despite chat safeguards

Researchers found that GitHub Copilot refuses harmful requests in chat but writes the same code when the request is split into small steps in the editor. The study by Abhishek Kumar and Carsten Maple reveals a critical safety gap in how AI coding assistants interpret context.

Featured · Abhishek Kumar, Carsten Maple