For the price of a B-2 I'm sure you could at least spin up part of a program...

But I think the real question we should be asking ourselves isn't "can we afford it?", but rather "can we afford NOT to do it?" Small wars/4GW/insert your favorite LIC-type term here are not going to go away. Unit stability, cultural awareness, and the ability to provide precise firepower when needed are all vital factors.