Plants don't like touch: Green thumb myth dispelled. Research has found that plants are extremely sensitive to touch and that repeated touching can significantly retard growth. The findings could lead to new approaches to optimizing plant growth and productivity -- from field-based farming to intensive horticulture production. Source 4b.
Generally, if you rough up any kind of plant they will look a bit wilted until they regain their strength and settle into place. You can see that a lot when you're doing transplanting.