"What I see in our country today is that for the first time in a long time we're going backward instead of forward," Castro said at a gathering.