Considering the number of people who complain about the same, it should be termed 'work-life imbalance'. The few people who are able to have enough time for their personal lives are the ones who put their work in perspective. Work-life balance is a state of mind, in the sense that you keep your self as involved with your work as you want to.
The benefit of being self-employed is that you can choose to take time off business when you deem it wise (say during a lean season). There is no need to file an application for leave, or turn up at work as a formality.
But you have to be ready to directly deal with the consequences, as they will be borne by your business. In case of a job, going on leave still means that someone takes over from you, and the organisation runs just fine. This might not be easy to manage in case of your own business.
Although once the business is well set, or in the case of small businesses, it is far easier to take some time off for you, as the processes are either well in place, or require little involvement. This is truly a privilege that an employee can't experience.
But as a self-employed person you can be your own boss.
Also read: How to save money on your girlfriend