What is HPC actually good for? Just you wait and see
Technology, if not money, does trickle down to your children
High Performance Computing (HPC) is all terribly exciting. We get announcements about this supercluster or that beating the number of teraflops of that other one (or, more likely these days, petaflops). Or maybe it's data throughput or storage size or even transfer rates.
And, perhaps the most interesting way of thinking about these edge-of-the-technological envelope machines isn't in fact about the strange and exciting problems that they can solve.
It's that they are, in fact, at the edge of the technological envelope and they're exploring the technologies we're all going to have on our desktops in a decades' time. That's the version of trickle-down economics that does actually work of course.
The caricature we're given is if the rich have all the money then it would trickle down to us in some manner. As if the evil plutocrats buying yachts meant that we could all have fulfilling careers as ship's chandlers.
This isn't, in fact, quite what the theory was (which was that the rich do not spend all their incomes, they save some of them and this becomes investment).
Investment is what raises the productivity of the workers and average wages depend upon the average productivity of labour. Thus, if the rich save and invest more then in the next turn around wages rise.
Take or leave that theory as you wish.
However, there is this other trickle-down theory that does really work. It is that most technological advance (most certainly in consumer goods but more widely applicable) is the result of people making insanely expensive (and often insanely stupid) toys for rich people.
The Model-T Ford, the first truly mass-market motor car
We've pointed this out before, but whatever Daimler created as the first car cost a lot more than a horse and was worse than a horse at doing everything.
However, a couple of decades of the application of manufacturing techniques to that basic idea gave us the Model-T, the first truly mass-market motor car.
I've seen this in my own crisscrossing of the computer industry. I once did some marketing for Aglient (the most expensive failed start up at that time until the likes of Pets.com came along to claim records). The very basic idea was sound: graphics really is the thing. So, let's build “superminicomputers” aimed at being a graphics workstation and engineers and scientists will love us.
What killed the business was not realising the speed at which trickle down works. What was stunning graphics performance in a £200,000 workstation then is less than a reasonable gaming PC will provide today.
So it is with much of what we call HPC today. Yes, it is all terribly exciting. The latest machines can do climate models (the Met Office has traditionally been the first adopter of whatever supercomputer technology might be out there for the UK), protein folding (also addressed by using spare processor cycles over the internet), figure out whether Higgs was right at CERN and all sorts of lovely other things.
And yes, those do push at the boundaries of human knowledge in a lovely and wondrous manner (the ongoing shouting matches about climate change might indicate rather further beyond them than many are comfortable with). But that's not, to my mind at least, the most important thing about what's going on in this sector of computing.
It's not what they're researching as they push out that envelope of what it is possible to compute. Rather, it's the techniques they are developing as they do so which will then trickle down to us and our desktops. And that's when things get really exciting. No, not because we can then all play a game based on protein folding techniques.
Wider access, better ideas
Take or leave Simon's cornucopian economics as you wish, but this idea seems to me to be obvious. There's seven billion of us floating around the planet today and it would be ridiculous to claim that all are provided with the tools that they could use.
It just isn't true that every megabrain on the planet is already using those cutting-edge tools: just as it wasn't true five centuries ago that everyone capable of reading and writing could (that's not even true today).
As these tools become ever cheaper then an ever-larger portion of the global population will have access to them. And as that happens then there's going to be people who don't currently have access to them who come up with bright ideas that benefit us.
And that, in perhaps my slightly warped view, is what the value of this HPC work is. Sure, it's nice to know how proteins are folded. But the techniques and the technologies we develop to produce those petaflops will, soon enough, be on a $25 chip that is incorporated into standard computing devices.
And that's when things will get really interesting, when billions of people (yes, including billions minus a handful who have no idea at all) have that technology then that handful will, undoubtedly, astonish us all with the fruits of their ingenuity.
That development frontier might best be viewed as being useful not for the problems they're working on at that frontier but for the later trickle down effects of the technologies they develop at that frontier.
If you prefer, HPC is really R&D into the techniques of computing and as such is a bargain for the rest of us. Or perhaps, if we're honest about it, for our children. ®