Libraries welcome you to do it! So definitely don’t feel weird there.

Maybe they are thinking of how mugs and thermoses can be labeled “vacuum sealed,” and that the marketing implies that the vacuum between the walls insulates the outer wall (where the hand touches) against the heat.