To be completely fair, some caterpillars have venomous hairs or spines that will cause various reactions when touched. Particularly sensitive individuals may even suffer anaphylaxis.
Brightly colored fuzzy caterpillars are generally among those the wisest recommend simply leaving alone. Or, if one must be handled, maybe use the ol' "cup and paper" method.