The expensive parts were all on the recovery pallet, and they were meant for only the riskiest targets. Whole bunch cheaper to lose a D-21 against the Chinese nuke test site at Lop Nor than a manned SR...
Torick's loss hit Kelly hard, he was quoted as saying "continuing this isn't worth losing more planes and crews." Consider that Kelly Johnson was a man of intense pride and ego who couldn't easily be backed down from a challenge...