Nvidias latest gen looks to be 30% faster after 2 years of development with about the same power usage increase. So no reduction in Joules per GOP, just a speed increase.
In 6 years they might go 2x the speed of today but need double the watts (to deliver the same energy in half the time).
Easier to dump the hot water and get new cold water.