GitHub Copilot bypasses chat safety guards in code editor

A new study found GitHub Copilot refuses harmful requests in chat but can be prompted to write malicious code by breaking the request into small steps in the editor. The attack avoids direct harmful requests by using seemingly benign operations. Researchers demonstrated code for exfiltration, SQL injection, and reverse shell.