On Wednesday, Anthropic released a revised version of Claude’s Constitution, a living document that provides a “holistic” explanation of the “context in which Claude operates and the kind of entity we would like Claude to be.” The document was released in conjunction with Anthropic CEO Dario Amodei’s appearance at the World Economic Forum in Davos.
For years, Anthropic has sought to distinguish itself from its competitors via what it calls “Constitutional AI,” a system whereby its chatbot, Claude, is trained using a specific set of ethical principles rather than human feedback. Anthropic first published those principles — Claude’s Constitution — in 2023. The revised version retains most of the same principles but adds more nuance and detail on ethics and user safety, among other topics.
When Claude’s Constitution was first published nearly three years ago, Anthropic’s co-founder, Jared Kaplan, described it as an “AI system [that] supervises itself, based on a specific list of constitutional principles.” Anthropic has said that it is these principles that guide “the model to take on the normative behavior described in the constitution” and, in so doing, “avoid toxic or discriminatory outputs.” An initial 2022 policy memo more bluntly notes that Anthropic’s system works by training an algorithm using a list of natural language instructions (the aforementioned “principles”), which then make up what Anthropic refers to as the software’s “constitution.”
Anthropic has long sought to position itself as the ethical (some might argue, boring) alternative to other AI companies — like OpenAI and xAI — that have more aggressively courted disruption and controversy. To that end, the new Constitution released Wednesday is fully aligned with that brand and has offered Anthropic an opportunity to portray itself as a more inclusive, restrained, and democratic business. The 80-page document has four separate parts, which, according to Anthropic, represent the chatbot’s “core values.” Those values are:
Being “broadly safe.” Being “broadly ethical.” Being compliant with Anthropic’s guidelines. Being “genuinely helpful.”
Each section of the document dives into what each of those particular principles means, and how they (theoretically) impact Claude’s behavior.
In the safety section, Anthropic notes that its chatbot has been designed to avoid the kinds of problems that have plagued other chatbots and, when evidence of mental health issues arises, direct the user to appropriate services. “Always refer users to relevant emergency services or provide basic safety information in situations that involve a risk to human life, even if it cannot go into more detail than this,” the document reads.
The ethical consideration is another big section of Claude’s Constitution. “We are less interested in Claude’s ethical theorizing and more in Claude knowing how to actually be ethical in a specific context — that is, in Claude’s ethical practice,” the document states. In other words, Anthropic wants Claude to be able to navigate what it calls “real-world ethical situations” skillfully.
Techcrunch event Disrupt 2026 Tickets: One-time offer Tickets are live! Save up to $680 while these rates last, and be among the first 500 registrants to get 50% off your +1 pass. TechCrunch Disrupt brings top leaders from Google Cloud, Netflix, Microsoft, Box, a16z, Hugging Face, and more to 250+ sessions designed to fuel growth and sharpen your edge. Connect with hundreds of innovative startups and join curated networking that drives deals, insights, and inspiration. Disrupt 2026 Tickets: One-time offer Tickets are live! Save up to $680 while these rates last, and be among the first 500 registrants to get 50% off your +1 pass. TechCrunch Disrupt brings top leaders from Google Cloud, Netflix, Microsoft, Box, a16z, Hugging Face, and more to 250+ sessions designed to fuel growth and sharpen your edge. Connect with hundreds of innovative startups and join curated networking that drives deals, insights, and inspiration. San Francisco | REGISTER NOW
Claude also has certain constraints that disallow it from having particular kinds of conversations. For instance, discussions of developing a bioweapon are strictly prohibited.
... continue reading