You can dig up 1864 on your own, I expect. And I repeat that 8.5% (at most) does not mean a substantial impact. If you check out the linked article, it goes into much more detail regarding the situation in Wisconsin (a strong Union state, as were most of what were then the Western states).
Bookmarks