They are cleat covers!
They cover the cleat...
In order to attach to the pedal, the cleat must be exposed. However walking on the cleats will damage them.
The cleat covers should be carried in a jersey pocket, and attached to the cleats whenever you come off the bike.