Anemones

Only next door there is this amazing array of Japanese Anemones. They are growing in profusion, but just over the fence, they grow quite sparsely in my garden. I wonder what I do wrong.
N was playing golf today and it is always easier to do housework when he is out so I had a useful session.