A uniform design is great when everyone gets pretty uniform performance. The problem arises from the fact that I almost certainly have a different internet speed than you do, and from a lot of people. Then, unless you are using a CDN, geographic location comes into play, which further slows down page loads. It took this page almost 5 seconds to refresh! So even with nearly everything being cached, it still fetches it, and that takes time. I have attached the network results from my browser. Without caching, it took 7.04 seconds to load this page. If you want to run the same test with Firefox, right click on the page, inspect element, then click on the network tab.
The good news is the images are compressed, along with the JavaScript. The bad news is that I'm sure you want people to view the site from anywhere, which becomes a problem. I cannot use this site on my phone simply because the gallery is there and it makes the page insanely long and way too hard to read. I can't check the site really fast even on my desktop, since it takes 5 seconds to load a page that is cached! At the very least, a mobile theme should be available so that way the things that take time to load are not there, but you still present a pretty uniform view.
Honestly, the problem I am having with "I don't think we have much interest in making this toggleable." is that while G17 Media might not have that interest, at least three people have said they do and none have said they don't (I'm not including your no because you fall under G17 Media). If I am in the minority of the community, then you're absolutely right and shouldn't waste the time and energy to implement my suggestion. But, if I am not, then you should spend the time and energy to make the community happier.
Quick question: If I have another suggestion, should I put that in this topic as well, or should I create a new one?