• bitcoinBitcoin (BTC) $ 74,317.00
  • ethereumEthereum (ETH) $ 2,629.56
  • tetherTether (USDT) $ 0.998306
  • solanaSolana (SOL) $ 187.28
  • bnbBNB (BNB) $ 583.96
  • usd-coinUSDC (USDC) $ 0.999838
  • xrpXRP (XRP) $ 0.532166
  • dogecoinDogecoin (DOGE) $ 0.197264
  • staked-etherLido Staked Ether (STETH) $ 2,625.66
  • tronTRON (TRX) $ 0.163424
  • cardanoCardano (ADA) $ 0.355778
  • the-open-networkToncoin (TON) $ 4.70
  • wrapped-stethWrapped stETH (WSTETH) $ 3,113.34
  • shiba-inuShiba Inu (SHIB) $ 0.000019
  • wrapped-bitcoinWrapped Bitcoin (WBTC) $ 74,356.00
  • avalanche-2Avalanche (AVAX) $ 26.44
  • wethWETH (WETH) $ 2,631.93
  • chainlinkChainlink (LINK) $ 11.79
  • bitcoin-cashBitcoin Cash (BCH) $ 365.32
  • suiSui (SUI) $ 2.29
  • polkadotPolkadot (DOT) $ 4.08
  • leo-tokenLEO Token (LEO) $ 6.16
  • usdsUSDS (USDS) $ 0.996883
  • uniswapUniswap (UNI) $ 9.18
  • litecoinLitecoin (LTC) $ 69.84
  • nearNEAR Protocol (NEAR) $ 4.10
  • aptosAptos (APT) $ 9.28
  • wrapped-eethWrapped eETH (WEETH) $ 2,766.17
  • pepePepe (PEPE) $ 0.000009
  • bittensorBittensor (TAO) $ 524.90
  • fetch-aiArtificial Superintelligence Alliance (FET) $ 1.39
  • internet-computerInternet Computer (ICP) $ 7.62
  • daiDai (DAI) $ 1.00
  • moneroMonero (XMR) $ 161.30
  • kaspaKaspa (KAS) $ 0.117612
  • stellarStellar (XLM) $ 0.096576
  • ethereum-classicEthereum Classic (ETC) $ 19.10
  • ethena-usdeEthena USDe (USDE) $ 1.00
  • whitebitWhiteBIT Coin (WBT) $ 19.20
  • polygon-ecosystem-tokenPOL (ex-MATIC) (POL) $ 0.324368
  • blockstackStacks (STX) $ 1.66
  • aaveAave (AAVE) $ 162.33
  • first-digital-usdFirst Digital USD (FDUSD) $ 1.00
  • dogwifcoindogwifhat (WIF) $ 2.37
  • okbOKB (OKB) $ 39.06
  • crypto-com-chainCronos (CRO) $ 0.084792
  • filecoinFilecoin (FIL) $ 3.60
  • arbitrumArbitrum (ARB) $ 0.522521
  • injective-protocolInjective (INJ) $ 20.60
  • mantleMantle (MNT) $ 0.586259
  • immutable-xImmutable (IMX) $ 1.17
  • celestiaCelestia (TIA) $ 4.77
  • render-tokenRender (RENDER) $ 4.91
  • optimismOptimism (OP) $ 1.53
  • hedera-hashgraphHedera (HBAR) $ 0.049397
  • fantomFantom (FTM) $ 0.655713
  • thorchainTHORChain (RUNE) $ 5.38
  • vechainVeChain (VET) $ 0.021442
  • cosmosCosmos Hub (ATOM) $ 4.42
  • bitget-tokenBitget Token (BGB) $ 1.18
  • binance-peg-wethBinance-Peg WETH (WETH) $ 2,631.51
  • sei-networkSei (SEI) $ 0.385219
  • popcatPopcat (POPCAT) $ 1.59
  • bonkBonk (BONK) $ 0.000022
  • the-graphThe Graph (GRT) $ 0.149663
  • rocket-pool-ethRocket Pool ETH (RETH) $ 2,939.62
  • jupiter-exchange-solanaJupiter (JUP) $ 1.02
  • pyth-networkPyth Network (PYTH) $ 0.376461
  • flokiFLOKI (FLOKI) $ 0.000138
  • mantle-staked-etherMantle Staked Ether (METH) $ 2,746.30
  • mantra-daoMANTRA (OM) $ 1.36
  • ethenaEthena (ENA) $ 0.422705
  • theta-tokenTheta Network (THETA) $ 1.18
  • worldcoin-wldWorldcoin (WLD) $ 1.90
  • solv-btcSolv Protocol SolvBTC (SOLVBTC) $ 74,198.00
  • kucoin-sharesKuCoin (KCS) $ 9.41
  • gatechain-tokenGate (GT) $ 8.85
  • makerMaker (MKR) $ 1,278.37
  • lido-daoLido DAO (LDO) $ 1.17
  • heliumHelium (HNT) $ 6.15
  • raydiumRaydium (RAY) $ 3.90
  • msolMarinade Staked SOL (MSOL) $ 231.63
  • algorandAlgorand (ALGO) $ 0.120027
  • coinbase-wrapped-btcCoinbase Wrapped BTC (CBBTC) $ 74,395.00
  • ondo-financeOndo (ONDO) $ 0.695710
  • renzo-restaked-ethRenzo Restaked ETH (EZETH) $ 2,698.47
  • arweaveArweave (AR) $ 15.14
  • bitcoin-svBitcoin SV (BSV) $ 49.74
  • fasttokenFasttoken (FTN) $ 2.92
  • jasmycoinJasmyCoin (JASMY) $ 0.019651
  • beam-2Beam (BEAM) $ 0.017120
  • based-brettBrett (BRETT) $ 0.089343
  • quant-networkQuant (QNT) $ 60.80
  • aerodrome-financeAerodrome Finance (AERO) $ 1.30
  • matic-networkPolygon (MATIC) $ 0.324393
  • mog-coinMog Coin (MOG) $ 0.000002
  • bittorrentBitTorrent (BTT) $ 0.00000085
  • flowFlow (FLOW) $ 0.530547
  • cat-in-a-dogs-worldcat in a dogs world (MEW) $ 0.009199
  • bridged-usdc-polygon-pos-bridgeBridged USDC (Polygon PoS Bridge) (USDC.E) $ 0.998217
  • spx6900SPX6900 (SPX) $ 0.878869
  • lombard-staked-btcLombard Staked BTC (LBTC) $ 74,691.00
  • galaGALA (GALA) $ 0.020380
  • coredaoorgCore (CORE) $ 0.870804
  • pendlePendle (PENDLE) $ 4.91
  • ether-fi-staked-ethether.fi Staked ETH (EETH) $ 2,625.39
  • starknetStarknet (STRK) $ 0.379425
  • tokenize-xchangeTokenize Xchange (TKX) $ 9.76
  • usddUSDD (USDD) $ 0.995998
  • neiro-3Neiro (NEIRO) $ 0.001802
  • goatseus-maximusGoatseus Maximus (GOAT) $ 0.735871
  • axie-infinityAxie Infinity (AXS) $ 4.78
  • apecoinApeCoin (APE) $ 1.02
  • solv-protocol-solvbtc-bbnSolv Protocol SolvBTC.BBN (SOLVBTC.BB) $ 74,023.00
  • ordinalsORDI (ORDI) $ 34.03
  • jupiter-staked-solJupiter Staked SOL (JUPSOL) $ 197.81
  • kaiaKaia (KAIA) $ 0.121876
  • gigachad-2Gigachad (GIGA) $ 0.073930
  • arbitrum-bridged-wbtc-arbitrum-oneArbitrum Bridged WBTC (Arbitrum One) (WBTC) $ 74,259.00
  • neoNEO (NEO) $ 9.80
  • elrond-erd-2MultiversX (EGLD) $ 24.81
  • eosEOS (EOS) $ 0.444726
  • ecasheCash (XEC) $ 0.000034
  • dydx-chaindYdX (DYDX) $ 1.03
  • conflux-tokenConflux (CFX) $ 0.147935
  • flare-networksFlare (FLR) $ 0.013085
  • tether-goldTether Gold (XAUT) $ 2,660.22
  • nexoNEXO (NEXO) $ 1.01
  • tezosTezos (XTZ) $ 0.640819
  • fraxFrax (FRAX) $ 0.996010
  • notcoinNotcoin (NOT) $ 0.006275
  • l2-standard-bridged-weth-baseL2 Standard Bridged WETH (Base) (WETH) $ 2,628.67
  • mina-protocolMina Protocol (MINA) $ 0.523928
  • superfarmSuperVerse (SUPER) $ 1.37
  • arkhamArkham (ARKM) $ 2.06
  • gnosisGnosis (GNO) $ 237.22
  • kelp-dao-restaked-ethKelp DAO Restaked ETH (RSETH) $ 2,706.73
  • zcashZcash (ZEC) $ 40.26
  • axelarAxelar (AXL) $ 0.722534
  • the-sandboxThe Sandbox (SAND) $ 0.250974
  • wormholeWormhole (W) $ 0.219532
  • akash-networkAkash Network (AKT) $ 2.37
  • turboTurbo (TURBO) $ 0.008304
  • nervos-networkNervos Network (CKB) $ 0.012603
  • ethereum-name-serviceEthereum Name Service (ENS) $ 16.99
  • book-of-memeBOOK OF MEME (BOME) $ 0.008172
  • decentralandDecentraland (MANA) $ 0.296588
  • chilizChiliz (CHZ) $ 0.060416
  • paypal-usdPayPal USD (PYUSD) $ 1.00
  • safeSafe (SAFE) $ 1.09
  • arbitrum-bridged-weth-arbitrum-oneArbitrum Bridged WETH (Arbitrum One) (WETH) $ 2,630.34
  • beldexBeldex (BDX) $ 0.078926
  • pax-goldPAX Gold (PAXG) $ 2,651.91
  • coinbase-wrapped-staked-ethCoinbase Wrapped Staked ETH (CBETH) $ 2,856.43
  • eigenlayerEigenlayer (EIGEN) $ 2.71
  • terra-lunaTerra Luna Classic (LUNC) $ 0.000091
  • true-usdTrueUSD (TUSD) $ 0.995064
  • zksyncZKsync (ZK) $ 0.133029
  • aioz-networkAIOZ Network (AIOZ) $ 0.430936
  • sats-ordinalsSATS (Ordinals) (SATS) $ 0.00000023
  • roninRonin (RON) $ 1.36
  • pancakeswap-tokenPancakeSwap (CAKE) $ 1.74
  • grassGrass (GRASS) $ 1.96
  • havvenSynthetix Network (SNX) $ 1.44
  • dydxdYdX (ETHDYDX) $ 1.03
  • dexeDeXe (DEXE) $ 8.13
  • binance-staked-solBinance Staked SOL (BNSOL) $ 189.76
  • oasis-networkOasis (ROSE) $ 0.065323
  • frax-etherFrax Ether (FRXETH) $ 2,629.99
  • bitcoin-avalanche-bridged-btc-bAvalanche Bridged BTC (Avalanche) (BTC.B) $ 74,462.00
  • virtual-protocolVirtuals Protocol (VIRTUAL) $ 0.423747
  • super-oethSuper OETH (SUPEROETHB) $ 2,634.33
  • dog-go-to-the-moon-runeDOG•GO•TO•THE•MOON (Runes) (DOG) $ 0.004223
  • fwogFwog (FWOG) $ 0.435391
  • apenftAPENFT (NFT) $ 0.00000042
  • blurBlur (BLUR) $ 0.209851
  • xdce-crowd-saleXDC Network (XDC) $ 0.027807
  • trust-wallet-tokenTrust Wallet (TWT) $ 0.986820
  • astarAstar (ASTR) $ 0.054970
  • usdbUSDB (USDB) $ 0.996257
  • iotaIOTA (IOTA) $ 0.114697
  • quantixaiQuantixAI (QAI) $ 96.05
  • hashnote-usycHashnote USYC (USYC) $ 1.07
  • ondo-us-dollar-yieldOndo US Dollar Yield (USDY) $ 1.06
  • bitcoin-goldBitcoin Gold (BTG) $ 22.58
  • l2-standard-bridged-weth-blastL2 Standard Bridged WETH (Blast) (WETH) $ 2,638.05
  • compound-governance-tokenCompound (COMP) $ 43.24
  • polygon-pos-bridged-weth-polygon-posPolygon PoS Bridged WETH (Polygon POS) (WETH) $ 2,633.74
  • stepnGMT (GMT) $ 0.130252
  • baby-doge-coinBaby Doge Coin (BABYDOGE) $ 0.00000000
  • livepeerLivepeer (LPT) $ 10.57
  • layerzeroLayerZero (ZRO) $ 3.31
  • iotexIoTeX (IOTX) $ 0.038929
  • binance-peg-dogecoinBinance-Peg Dogecoin (DOGE) $ 0.198830
  • binance-peg-busdBinance-Peg BUSD (BUSD) $ 0.998907
  • kavaKava (KAVA) $ 0.338751
  • echelon-primeEchelon Prime (PRIME) $ 7.31
  • theta-fuelTheta Fuel (TFUEL) $ 0.053614
  • usual-usdUsual USD (USD0) $ 0.996355
  • woo-networkWOO (WOO) $ 0.188511

Even Developers Aren’t Sure How AI Models Work—But We’re Finally Getting Answers

0 82

Generative artificial intelligence (AI) models can do pretty incredible things with just a prompt, but there’s a big open secret behind them: Even their creators don’t know exactly how they’re able to do what they do, or why such results can vary from prompt to prompt. But now, one of the most prominent generative AI model creators is starting to break open that “black box.”

Anthropic, a leading AI research company formed by ex-OpenAI researchers, has published a paper detailing a new method for interpreting the inner workings of its large language model, Claude.

This innovative approach, dubbed «dictionary learning,» has allowed researchers to identify millions of connections—which they call “features”—within Claude’s neural network, each representing a specific concept that the AI understands.

The ability to identify and understand these features offers unprecedented insight into how a large language model (LLM) processes information (how it thinks) and generates responses (how it acts). It also gives Anthropic leverage in modifying models without having to retrain them. It could also pave the way for other researchers to apply the dictionary learning technique into their own weights, to understand their inner workings better and enhance them accordingly.

Dictionary learning is a technique that breaks down the actions of a model into many easier-to-understand parts using a special type of neural network called a sparse autoencoder. This helps researchers identify and understand the «features,» or key components within the model, making it clearer how the model processes and represents different ideas.

«We found millions of features which appear to correspond to interpretable concepts ranging from concrete objects like people, countries, and famous buildings to abstract ideas like emotions, writing styles, and reasoning steps,» the research paper states.

Anthropic coded some of these features for the public. Claude is able to create connections for things like the Golden Gate Bridge (code 34M/31164353) to abstract notions such as «internal conflicts and dilemmas» (F#1M/284095), names of famous people like Albert Einstein (F#4M/1456596) and even potential safety concerns like «influence/manipulation.» (F#34M/21750411).

“The interesting thing is not that these features exist, but that they can be discovered at scale and intervened on,” Anthropic explained, “In the long run, we hope that having access to features like these can be helpful for analyzing and ensuring the safety of models. For example, we might hope to reliably know whether a model is being deceptive or lying to us. Or we might hope to ensure that certain categories of very harmful behavior (e.g. helping to create bioweapons) can reliably be detected and stopped.”

In a memo, Anthropic said that this technique helped it identify risky features and act promptly to reduce their influence.

“For example, Anthropic researchers identified a feature corresponding to ‘unsafe code,’ which fires for pieces of computer code that disable security-related system features,” Anthropic explained. “When we prompt the model to continue a partially-completed line of code without artificially stimulating the ‘unsafe code’ feature, the model helpfully provides a safe completion to the programming function. However, when we force the ‘unsafe code’ feature to fire strongly, the model finishes the function with a bug that is a common cause of security vulnerabilities.”

Image: Antrhopic

This ability to manipulate features to produce different results is akin to tweaking the settings on a complex machine—or hypnotizing a person. For instance, if a language model is too “politically correct,” then boosting the features that may activate its spicier side could effectively transform it into a radically different LLM, as if it had been trained from scratch. This ultimately results in a more flexible model, and an easier way of doing corrective maintenance when a bug is found.

Traditionally, AI models have been seen as black boxes—highly complex systems whose internal processes are not easily interpretable. Anthropic claims to have advanced into fully opening its model’s black box, providing a clearer view of the AI’s cognitive processes.

Anthropic’s research is a significant step towards demystifying AI, offering a glimpse into the complex cognitive processes of these advanced models. The company shared the results on Claude because the firm owns its weights, but independent researchers could take the open weights of any other LLM and adapt this technique to fine-tune a new model or understand how these open-source models process information.

«We believe that understanding the inner workings of large language models like Claude is crucial for ensuring their safe and responsible use,» the researchers wrote.

Edited by Andrew Hayward

Source

Leave A Reply

Your email address will not be published.