Got this note from the server host.
If it's early (before 6 AM) the server is processing statistics, and doing backups. When it's backing up your website, your website will get slow.
That's pretty much a tradeoff between the safety/security of having backups/restore points, and not having anything when your site crashes.
The server you are on is not overloaded, and never has high loads.