Lilies

They're lovely, but they are also a menace, and a declared weed in South Australia.  Mary hates them with a passion, so we've reached a compromise.  Because they are an iconic Victorian plant we allow them to flower but cut them down as soon as the flowers die.  In other words we don't allow them to seed.