Safeguards checked from outside
State law has the largest developers publish their own safety plans and report incidents. The bill adds a licensed outside examiner with access to unredacted records at any time, and gives the Secretary of Commerce power to halt a model that presents an imminent catastrophic risk. What that is worth depends on how likely such an event is, and nobody knows.
▸ Show reasoning & sources ▾ Hide reasoning & sources
Value
The stream is harm from the events the bill is written for: a single incident with fifty or more people killed or seriously injured, or damage above one billion dollars, to which one of the most capable models contributes [1]. Most of what can be estimated at all is destroyed property and interrupted business, which is money, and part of it is lives, which this site places at the top of the scale. The value therefore lies between the two, nearer to the money, because the one documented comparison is a cyberattack whose toll was counted in dollars. No extra weight is given for the novelty of the technology. The value is above the middle of the scale: mostly money destroyed, partly lives.
Impact
The bill defines a catastrophic risk by its floor, fifty casualties or a billion dollars of damage in one incident [1]. The costliest cyberattack on record did about ten billion dollars of damage worldwide in 2017 [9]. For this evaluation the chance that an event of that class occurs in a given year with one of these models contributing materially is set at two percent, in a range from half a percent to five, and its cost at about 23 billion dollars, in a range from the bill's floor to 120 billion. That is an expected 460 million dollars a year. State law already has developers publish a safety framework and report incidents [2][8]; what the bill adds is verification every six months by a licensed outside organization for the largest developers, an annual audit, and the power to suspend a model for up to ninety days [1][3]. The share of the expected harm that those additions avert is set at a tenth, in a range from two to twenty-five percent. The result is about 46 million dollars a year, and between 6 and 120 million once the ranges are taken together short of their joint extremes. The Impact is slightly below the cost of the verification that buys it, and all three of its factors are settings.
▸ Show calculation ▾ Hide calculation
| Chance a year of a catastrophic incident, as the bill defines it, with a frontier model contributing Setting, range 0.5 to 5 percent: no such incident has occurred; the bill's floor is fifty casualties or one billion dollars of damage [1] [1] | 2 % | 0.02 a year | |
| × | Cost of such an incident Setting, range 0.9 to 100 billion euro-equivalent (about 1 to 120 billion dollars): the costliest cyberattack on record did about ten billion dollars of damage [9], 8.6 billion euro-equivalent at 1.16 dollars to the euro; events with mass casualties would cost more [9] | 20 billion euro-equivalent (about 23 billion dollars) | 400 million euro-equivalent a year |
| × | Share averted by outside verification and suspension orders beyond what state law achieves Setting, range 2 to 25 percent: state law already requires published frameworks and incident reports [2]; examiners are chosen by the developer [4] [2][4] | 10 % | 40 million euro-equivalent a year |
| ÷ | Normalised Impact scale of this evaluation | 5 million euro-equivalent a point | 8 |
Plausibility
Nothing here has been measured, because the event has not occurred and the verification regime does not exist. The comparison is state law, under which developers write and publish their own frameworks and nobody outside checks them [2][8]. The chain has three links: outside examiners with full access find weaknesses the developer missed or discounted, the developer or the Secretary acts on them, and an incident that would have happened does not. The first link is supported by experience with financial audits and safety inspection in other industries and has no evidence for this one. Against it stands that developers choose their own examiner, which critics see as a conflict of interest, and that the decision to release a model stays with the developer [4]. The examiner market also has to be built first, which takes years [4]. Nothing suggests the link runs the other way. The Plausibility is low: the mechanism is ordinary, the probability and the averted share are set rather than known, and the examiners do not yet exist.
Open: The semiannual reports to the Under Secretary and the incident reports filed in the first two years would show how often outside examiners find what developers had not disclosed, which is the first link of the chain.