Not all reactions give off heat like this. In fact, some actually take in or absorb energy from their surroundings, and the reacting substances feel cold. They’re called endothermic reactions.
Exothermic reactions transfer energy to the surroundings and the temperature of the surroundings increases. Endothermic reactions take in energy and the temperature of the surroundings decreases.