Government officials in Finland said on Thursday the country would apply to join NATO "without delay."