The guys over at WPBeginner have also put together a nice guide outlining how to boost your WordPress speed and performance.
Credit: Hosting Captain