Equally Unproven, Unequally Inspectable: Jev versus Needle 3

Two companies shipped a calibrated typed-decision product within seventy-two hours of each other, and the obvious episode about them is not available: there is no shared benchmark between TypeSafe's Jev and Cactus Compute's Needle 3, and their ground truths are not even the same kind of object, one being agreement with two competitors' frontier models and the other exact match against human-authored gold labels. So we run the comparison on the openness axis instead. Both products are essentially unproven in the same specific way, because neither company has published a single calibration measurement for the property both of them are selling. But only one of them can be checked at all, and this episode is what happens when you check it: Needle's own BFCL v4 tab reverses its "beats models ten times its size" headline, its advertised size range is arithmetically impossible against its own published parameter count and quantisation floor, and its open issue tracker contains bugs nobody has answered. Every error in this episode was found on the open side, and none of it because Cactus is worse, but because Cactus is checkable. If you grade companies by how many mistakes the public caught, you will reliably conclude that the one which showed you nothing is the better one.