Read a bit about this problem, and realised it's caused by:
- Having too much to do in too little time
- Organising things too strictly
- Not being spontaneous

So these are the things I need to do now:
- Get up earlier to make more time
- Get some one off tasks done so I can forget about them
- Organise tasks so they are more spread out over more days instead of loads in one day
- Be more flexible with the organising
- Get the main/biggest task/s done first and out the way with
- Leave "free" time between where I can choose to do whatever "hobby" things I feel like at the time

I think I can do this, just might take some time. But I never used to be so strict with myself like this, it's only been in the last few years, I just need to get out of this pattern I've let myself get into and go back to how I was back then.