But just like olive trees in winter, extreme weather can take its toll without precautionary measures in place. Do note that butterfly bushes sometimes die back over winter in colder hardiness ...