The threat of another economic downturn is stalling a housing recovery, Fannie Mae said in a report Monday.