A provider could route requests to a cheaper model, or an attacker could interfere with responses, without customers having an obvious way to detect the switch. Now, Anthropic wants to change that. The company's Frontier Red Team has released FlashProve, an open-source cryptographic system designed to verify which AI model produced a response without exposing its underlying weights.
Announced Tuesday, the research could eventually help developers verify third-party AI services and detect compromised inference systems. But FlashProve remains a research prototype, and the cost of generating proofs makes it impractical for routine API traffic. But FlashProve remains a research prototype, and the cost of generating proofs makes it impractical for routine API traffic. How FlashProve proves the model FlashProve uses zkSNARKs to verify that a response came from a specific set of model weights without revealing those weights.
