Are carbon electrodes harmful?

No, but it would be sensible to wash them thoroughly with hot water if you intend prolonged handling, just to remove any other materials from the battery.