By that logic I should fire my company for making me work after hours and weekends on their projects.
If you're an hourly employee, its different. If you are a salaried employee you are paid to do a set of tasks and projects. If you complete those that's really what matters. If I need to work on side project for 20 minutes at 1PM and then need to work on a work project at 2AM it all works out in the end.