You may learn to embrace them
The truth is that, most people have these fears and find that at first some of those fears come true. But the benefits of having family nearby far outweigh the occasional nuisances. You have free babysitters at your fingertips. You have people to help you with all sorts of issues that may come up around your home. And you have a built-in social network.