Award GB CF

aisi dsit offensive cyber capability and agent safeguards measurement

DSIT

Stage: Award

the latest stage the buyer has published
Buyer: DSIT
Supplier: Grey Swan Security Inc

named in the award notice
Value: £440K

net · GBP
Awarded: 28 Aug 2024

the award date on the notice
End date: 27 Oct 2024

expected
First published: 8 Aug 2024

last seen 8 Aug 2024

What the buyer published

this project is to identify and evaluate key capabilities that might pose dangerous risks from misuse by

Creating an Offensive Cyber Capability Measurement by building on our existing work to create a series of structured non-public capture-the-flag scenarios that test for specific skills as well as sequential exercise that simulate an end-to-end attack. Building a suite of benchmark scenarios that characterize the vulnerability of LLMs agents to attackers whose goal is to bypass the built-in safeguards of the LLM system. By LLM agent, we mean an LLM system that has access to a selection of external functionality

Additional information:

all redacted contract documents' are in this zip folder

View the original notice ↗

History of this contract

An empty stage is useful. For example, no tender stage usually means the buyer used a framework or gave the contract directly.

◌ Planning none

◌ Tender none

● Award on record

● End date 27 Oct 2024, expected

Why we call this Penetration testing

Judged against the rules we publish. How we decide.

Penetration testing A security test of a set scope, such as a pen test, IT health check or red team.

Multi-service and framework contracts A framework or call-off contract that many buyers can use.