Rosemary growing wild might make you think it's unusually hardy, but like any plant, the wrong conditions can cause harm.