Here is an imaginary dialogue between a physicist and an economist who is not Georgescu-Roegen. The physicist is skeptical about the prospect for continued exponential growth, excerpt:
Physicist: Well, we could (and do, somewhat) beam non-thermal radiation into space, like light, lasers, radio waves, etc. But the problem is that these “sources” are forms of high-grade, low-entropy energy. Instead, we’re talking about getting rid of the waste heat from all the processes by which we use energy. This energy is thermal in nature. We might be able to scoop up some of this to do useful “work,” but at very low thermodynamic efficiency. If you want to use high-grade energy in the first place, having high-entropy waste heat is pretty inescapable.
…we’re too close to an astounding point for me to leave it unspoken. At that 2.3% growth rate, we would be using energy at a rate corresponding to the total solar input striking Earth in a little over 400 years. We would consume something comparable to the entire sun in 1400 years from now. By 2500 years, we would use energy at the rate of the entire Milky Way galaxy—100 billion stars! I think you can see the absurdity of continued energy growth. 2500 years is not that long, from a historical perspective. We know what we were doing 2500 years ago. I think I know what we’re not going to be doing 2500 years hence.
For the pointer I thank Sam Penrose, Jim Nichols, Jason Ketola, and Mark Weaver. It is interesting throughout, though I expect war to intervene at some point to break the exponential growth.
Addendum: Here is a related paper by Robin Hanson.