I have the exact same issue as OP, moved about a month ago to a new place that's only about 900m away and the one cat has gone back twice, spending 5 days and 2 days away from home.
Ended up having to catch him and bring him back both times. I'm going to keep both inside now for a few weeks or...