No, usually if you have children together, you pick his caravan or hers. But it isn't a rule or anything, and he stayed with his people and we stayed with Grandfather.