"Americans can have confidence that the banking system is safe. Your deposits will be there when you need them," Biden said from the White House.