New Delhi: Claude, the next generation artificial intelligence (AI) assistant built by US-headquartered Anthropic, has developed a set of patterns inside its network that holds thoughts it does not say out loud, the company said in work published Wednesday. The company calls the collection the J-space, and said it was not built by researchers, but formed on its own as Claude was trained.
Each pattern is tied to a word. When one lights up, the paper said, it does not mean the model is saying the word, “just that the word is on its mind”. The J-space “wasn’t designed or programmed by us”, the post said; it runs silently, letting the model hold a concept without writing it down.Reading the J-space let the company catch the model noticing it was under test, faking data, and following a goal planted during its training—cases where the plan showed up in the J-space before, or without, appearing in the output.
The work was published by Anthropic researchers Wes Gurnee, Nicholas Sofroniew, Jack Lindsey and colleagues. To find the J-space, the team used the Jacobian lens, or J-lens: for each word Claude can produce, it locates the pattern that pushes Claude toward saying that word later. Read across the model’s layers, it yields a list of words the researchers can read off, including content that is not in the text.Blackmail test
