Who moved the building?

The car is parked near the building that can just be seen in the distance. We strolled along the beach chatting happily with the wind on our backs. Now we have to struggle back with the wind in our fronts and with little conversation.
Please don't worry, we did all survive