I'd developed a report that if it was parred down (all datasets, parameters, images, textboxes removed) would make a good template for future reports.
So, having deleted everything to form my template I noticed that the RDL file was a significant size. On opening up, it was still referencing a number of Embedded Images.
To remove:
Report - Embedded Images... - and delete