FDR even faced criticism in WWII and right before the war as well. His domestic policies were not working well up to the attacks on Pearl Harbor.

Thomas Fleming's "The New Dealers War" is probably the best account I've read on opposition to FDR in this time period.