SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 5.3via Simon Willison

Claude's new system prompt really doesn't want to reproduce song lyrics

"Anthropic vs. Karaoke: The guardrails are getting suspiciously specific."

Explain Like I'm Normal

Anthropic updated their publicly accessible system prompts, revealing new, strict instructions that prevent Claude from outputting full song lyrics. The move highlights increasing legal caution around copyrighted material while maintaining Anthropic's unique transparency by hosting these prompts in LLM-readable markdown formats.

Read original ↗
#system-prompts#anthropic#claude#guardrails

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.