Submission + - Cisco releases open-source 'DNA test for AI models' (scworld.com)
spatwei writes: Cisco released an open-source tool to trace the origins of AI models and compare model similarities for great visibility into the AI supply chain.
The Model Provenance Kit, announced Thursday, is a Python toolkit and command-line interface (CLI) that looks at signals such as metadata and weights to create a “fingerprint” for AI models that can then be compared to other model fingerprints to determine potential shared origins.
“Think of Model Provenance Kit as a DNA test for AI models,” Cisco researchers wrote. “[] Much like a DNA test reveals biological origins, the Model Provenance Kit examines both metadata and the actual learned parameters of a model (like a unique genome that comprises a model), to assess whether models share a common origin and identify signs of modification.”
The tool aims to address gaps in visibility into the AI model supply chain. For example, many organizations utilize open-source models from repositories like HuggingFace, where models could potentially be uploaded with incomplete or deceptive documentation.
The Model Provenance Kit, announced Thursday, is a Python toolkit and command-line interface (CLI) that looks at signals such as metadata and weights to create a “fingerprint” for AI models that can then be compared to other model fingerprints to determine potential shared origins.
“Think of Model Provenance Kit as a DNA test for AI models,” Cisco researchers wrote. “[] Much like a DNA test reveals biological origins, the Model Provenance Kit examines both metadata and the actual learned parameters of a model (like a unique genome that comprises a model), to assess whether models share a common origin and identify signs of modification.”
The tool aims to address gaps in visibility into the AI model supply chain. For example, many organizations utilize open-source models from repositories like HuggingFace, where models could potentially be uploaded with incomplete or deceptive documentation.