AlphaZero Ideas

by  Tyler Cowen in

That is a new and exciting paper from Julio González-Díaz and Ignacio Palacios-Huerta, here is the abstract:

Can artificial intelligence (AI) uncover new ideas? As machines are learning fast and becoming increasingly intelligent, can AI not only automate the production function of goods and services, but also of ideas? Economic growth arises from people creating ideas, and thus an affirmative answer to these questions may have drastic implications for a host of important issues. Yet, to date, there is no empirical evidence showing that AI can in fact generate tabula rasa ideas that improve human understanding. Using as an exogenous shock the introduction of AlphaZero, we provide the first causal evidence of the impact of unsupervised AI on the production function of ideas. Specifically, AlphaZero is considered a milestone of scientific progress in AI research. This program rediscovered ideas known in centuries of human chess, and created new ideas as well. We study world experts at the frontier of knowledge and find that at least the player with the highest classical rating in the history of chess learned and adopted new ideas uncovered by AlphaZero. Other players may have also done the same. We contend that obtaining evidence of the impact of AI on the production function of ideas is a necessary first step to think about AI’s impact on the innovation and research processes that drive the advancement of knowledge and economic growth.

The main new ideas I have seen come from AlphaZero are the following:

1. Pushing the h pawn is often better than you thought! (emphasized by the authors)

2. Said pawn can be worth more on h6 (h3), as an aggressive weapon, than you might have thought.

3. Qa1 (a8) is occasionally a better move than it looks.

4. The chess openings that were preferred in the early 20th century, such as the Queen’s Gambit, are in fact pretty lindy and pretty good.  You can debate whether that is a “new” idea, but it is a meaningful revision of sorts.  (Of course plenty of earlier patzers had some fondness for #1-3, one might add, though perhaps not for the right reasons.)

So that is something.  But I think in terms of a percentage of the total improvement in play, it is quite small.  “Finding more good players through the internet” would come in first by a long mile.  “Giving more players more time on convenient services such as chess.com” likely would be next.  Even “just having good players improve their endgame play using basic study and standard chess engines” would be much larger than these AlphaZero effects.  “More top players copying the physical training regimen of Magnus” would be more significant as well.

I am also skeptical of the claim that very much of Carlsen’s 2019 improvement (he didn’t lose a game that year) came from AlphaZero.  He has lost some games since then!  And it is not as if all of his subsequent opponents are zapping him with surprise “Qa1” moves.  I see AlphaZero as a series of innovative but ultimately modest advances that have been incorporated by some of the top players with barely noticeable overall gains in move quality.

I am not an AI skeptic, and furthermore I see special value per se in “advancing the frontier,” even when various infra-marginal gains (“swim more!”) are more significant in quantitative terms.  Still, my estimate of the chess innovative advances from AlphaZero are more modest than what this paper would seem to suggest.

Friday assorted links

by  Tyler Cowen

1. Our response to Monkeypox has been less than impressive.

2. Why are some nations more entrepreneurial than others?

3. Robin Hanson on AI competition and risk.

4. When did perfume stop being about sex? (NYT)  Interesting throughout.

5. By one new estimate Covid vaccines saved 20 million lives in their first year.  That is why I say the great stagnation is over, at least for now, though of course we could slip back into it.

6. Weird facts to toy with your sense of historical time.

7. “Slow and negligible senescence among testudines challenges evolutionary theories of senescence” — anything to this?  And here is the NYT coverage.  Big if true!

8. Dating services for the D.C. set.

*Super-Infinite: The Transformations of John Donne*

by  Tyler Cowen in

This new book by Katherine Rundell, now out in the UK but still pending in the United States for September, is one of the very best studies of an individual poet I ever have read.  The book’s style is so energetic and so carefully crafted as a whole, it is difficult to excerpt from.  What is striking to me is that the blurbs are from super-smart people, and they all are literally accurate (has that ever been the case?). So for instance Claire Tomalin wrote:

Katherine Rundell’s brave and detailed new biography of John Donne is just the book we need…Every page sparkles…

Simon Jenkins wrote:

Rundell has a wonderful touch, light yet profound, which perfectly suits her extraordinary subject…Unmissable.

The great Maggie O’Farrell wrote:

A wonderful, joyous piece of work…with fierce, interrogative intelligence. I just loved it.

All true!  Recommended, a sure thing for the year’s best of non-fiction list.  You don’t even have to like poetry, as a history book it is first-rate as well.

An AI does a CWT between me and “Janet Yellen”

by  Tyler Cowen

TYLER COWEN: I want to ask you a series of questions about what’s overrated and underrated. It can be in your area of expertise, it could be in life in general, up to you. JANET YELLEN: Sure. TYLER COWEN: Let me start with an easy one. Bitcoin, overrated or underrated? JANET YELLEN: Oh, that’s a tough one. I’m going to say overrated. TYLER COWEN: Why? JANET YELLEN: Well, it doesn’t produce anything. It doesn’t earn any income for anybody. It’s just essentially speculative, people thinking it will be worth more in the future because other people think it will be worth more in the future. And so it’s kind of a bubble. TYLER COWEN: If we think about the Federal Reserve and its role in society, is it overrated, underrated, or properly rated? JANET YELLEN: I think it’s properly rated. We have a very important role in setting monetary policy, which can affect economic activity and employment and inflation. So, I think the public understands that we play an important role. TYLER COWEN: How about the role of the United States in the world economy? Overrated, underrated, or properly rated? JANET YELLEN: Oh, that’s a tough one. I would say we are probably rated about right. We are the largest economy in the world. We are a very important player in the global economy. TYLER COWEN: How about the role of academic economists in society? Overrated, underrated, or properly rated? JANET YELLEN: Oh, that’s a tough one, too. I would say we are probably a bit overrated. We have a lot of smart people and we do good work, but we don’t always get it right. TYLER COWEN: Last one. In terms of your own career, looking back, is there anything you would have done differently? JANET YELLEN: Oh, that’s a tough question. I don’t know. I’ve been very lucky. I’ve had a great career. I’ve loved what I’ve done. I can’t think of anything I would have done differently.

Here is the program (authentication required, you can’t use it), and the work here on feeding the prompts was done by Michael Tolhurst.  And here is me with Oscar the Grouch.

That was then, this is now

by  Tyler Cowen in

On July 7 [1917], while the unsuccessful hunt for fugitive Bolsheviks continued, Prince Lvov resigned as leader of the Provisional Government.  He was replaced by Kerensky.  This had nothing to do with either the July uprising or the failed offensive.  Five days earlier, Kadet ministers had resigned in protest at a decision to allow Ukraine a degree of autonomy.

Both liberals and socialists in the reconstituted Provisional Government wanted to keep the Russian empire together.  They had accepted in March that after the war Poland, now behind German lines, would break away to become fully independent, but they were determined to hold on to the Grand Duchy of Finland, the Baltic provinces and Ukraine.  their view was that the grievances and aspirations of national minorities were purely the product of Tsarist oppression, above all the ‘russification’ programmes introduced under Nicholas II which had discourages any diversity of culture or language.  A few limited concessions to autonomy were thought to be sufficient.

…Russians in Kiev never expected the Ukrainian forces to put up much of a fight.  Deliberately ignoring the reality of Ukrainian culture and history, they had taken Ukrainian patriotism as little more than a joke.

That is from the new and excellent Anthony Beevor book, Russia: Revolution and Civil War 1917-1921.

What I’ve been reading

by  Tyler Cowen

1. Ian Morris, Geography is Destiny: Britain and the World: A 10,000 Year History.  None of the book is bad, and half is quite interesting.  Think of the treatment as “Deep Roots for Brexit,” though willing to noodle over earlier and more interesting topics in history.  From a good FT review by Chris Allnutt: “Morris succeeds in condensing 10,000 years into a persuasive and highly readable volume, even if there are moments that risk a descent into what he seeks to avoid: “a catalogue of men with strange names killing each other”, as historian Alex Woolf put it.”  Now if only he would explain why their hot and cold water taps don’t run together…

2. Michel Houellebecq, Interventions 2020.  Grumpy non-fiction essays, with plenty of naive anti-consumerism.  You need to read them if you are a fan, but I didn’t find so much here of interest.  I was struck by his nomination of Paul McCartney (!) as the most essential musician, with Schubert next in line.  Mostly it is MH being contrary.  He has earned the right, but he wasn’t able to make me care more.

3. Frank O’Connor, “Guests of the Nation.”  One of the best short stories I have read, Irish.  Can’t say any more without spoilers! 11 pp. at the link.

4. Ursula K. Le Guin, The Word for World is Forest.  Has anyone done a systematic accounting of which Vietnam era fictional works have held up and which not?  Maybe this one gets a B+?  Not top drawer Le Guin, but good enough to read, and better yet if you catch the cross-cultural references and all the anthropological background works.

5. Jonathan Swift, Gulliver’s Travels, some cheap paperback edition.  I did a quick, non-studied reread of this, in prep for the new Cambridge University Press reissue edition due out June 30, which has excellent notes and I will study and reread in more detail.  One of the very best books!  Not only is the story fully engaging and deeply humorous, but it is one of the seminal tracts on progress (largely skeptical), a blistering take on political correctness, wise on the virtues and pitfalls of travel, and one of the first novels to truly engage with science and politics and their interaction.  Straussian throughout.  Swift is one of the very greatest thinkers and writers and his output has held up remarkably well.

The great stagnation and the primacy of foreign policy

by  Tyler Cowen in

One cause (and effect) of the great stagnation, as emphasized by Peter Thiel and others (including myself), is our inability to imagine a future radically different from the immediate past.  We view progress as gentrification and more nice restaurants, not fundamental transformation.

This same lack of imagination makes it difficult to understand the primacy of foreign policy in understanding the world on a day-to-day basis.  If you lack imagination, you will tend to assume that the current configurations of countries, alliances, and so on are simply going to last.

But they are not, and they never have.  And thus the primacy of foreign policy considerations.  But for many people this is difficult to grasp.

The Birds and the Bees

by  Alex Tabarrok in

Ocean City, NJ hires falconers to keep the seagulls off the boardwalk–in fact, they are looking for more trainees. West Coast Falconry explains more generally:

Falconry based bird abatement is quiet, discrete, organic, eco-friendly, and very sustainable. The objective is not killing the nuisance birds, but scaring them off the premises.

West Coast Falconry conducts pest bird abatement by contract. We have professionals on staff that can help rid your establishment of a number of pest bird species including pigeons, starlings, and seagulls. Regular flyovers are key to this environmentally-friendly service.

I am reminded of the extensive markets in bees.

Hat tip: Luke Froeb.

Rereading Edward Gibbon on the fall of Rome

by  Tyler Cowen in

I hadn’t looked at this work for a long time, and I was struck by how much he does not blame Christianity for the decline of the Roman Empire.  Here is one bit, closer to Ibn Khaldun than anything:

The rise of a city, which swelled into an empire, may deserve, as a singular prodigy, the reflection of a philosophic mind.  But the decline of Rome was the natural and inevitable effect of immoderate greatness.  Prosperity ripened the principle of decay; the causes of destruction multiplied with the extent of conquest; and as soon as time or accident had removed the artificial supports, the stupendous fabric yielded to the pressure of its own weight.  The story of its ruin is simple and obvious; and instead of inquiring why the Roman empire was destroyed, we should rather be surprised that it had subsisted for so long. (p.435)

Gibbon also puts forward the hypothesis that basic knowledge in agriculture and the manufactures is never lost, so the overall course of history will be progressive. (pp.442-443)

He is worried about existential risk from comets, volcanoes, and earthquakes, though despairs we cannot do much about it. (p.578)

All from the Penguin abridged edition, edited by David Womersley.

Regulatory quality is declining

by  Tyler Cowen in

One example of such evidence-free regulation in recent years comes from the Department of Health and Human Services (HHS). In 2021, HHS repealed a rule enacted by the Trump administration that would have required the agency to periodically review its regulations for their impact on small businesses. The measure was known as the SUNSET rule because it would attach sunset provisions, or expiration dates, to department rules. If the agency failed to conduct a review, the regulation expired.

Ironically, in proposing to rescind the SUNSET rule, HHS argued that it would be too time consuming and burdensome for the agency to review all of its regulations. Citing almost no academic work in support of its proposed repeal — a reflection of the anti-consequentialism that animates so much contemporary regulatory policy — the agency effectively asserted that assessing the real-world consequences of its existing rules was far less pressing an issue than addressing the perceived problems of the day (by, of course, issuing more regulations).

Through its actions, HHS has rejected the very notion of having to review its own rules and assess whether they work. In fact, the suggestion that agencies review their regulations is an almost inexplicably divisive issue in Washington today. “Retrospective review” has become a dirty term, while cost-benefit analysis has morphed into a tool to judge intentions rather than predict real-world consequences. The shift highlights how far the modern administrative state has drifted from the rational, evidence-based system envisioned by the law-and-economics movement just a few decades ago.

Here is more from James Broughel at Mercatus.

Very interesting Edward Nevraumont review of *Talent*

by  Tyler Cowen in

The review makes many points, here is one excerpt:

 Everywhere I have worked, the organization’s hiring processes were tilted in favor of experience over intelligence. Interviews include behavioral questions or assessments of specific skills. Rarely is anyone on the hiring loop running problem-solving sessions that require the candidate to demonstrate how they might deal with the real-world challenges they will encounter in the workplace.

And:

Most of the time you can win candidates by getting the basics right:

  1. Reach out to people, don’t wait for them to come to you.
  2. Build relationships before you need them.
  3. Develop followership (so people that work with you once will want to work with you again).
  4. Get candidates excited for the job before you start screening them.
  5. Make your workplace a good place to work for smart and talented people (which is NOT the same as making it a “good place to work” generally, or anything from the HR/PR lists.)
  6. Be the type of manager that top talent will want to work for.
  7. Ensure that you have someone selling the candidate once you know you want to make an offer and start the selling process before the offer is made.
  8. Be polite.
  9. Be fast.

Interesting throughout, though I feel the author significantly overestimates the extent to which we think the current talent assessment market is efficient.