What is the single best way of improving your GPT prompts?
I have a nomination, and here is an excerpt from my new paper with Alex:
You often can get a better and more specific answer by asking for an answer in the voice of another person, a third party. Here goes: What are the causes of inflation, as it might be explained by Nobel Laureate Milton Friedman?
By mentioning Friedman you are directing the GPT to look at a more intelligent segment of the potential answer space and this directing will usually get you a better answer than if you just ask “What are the causes of inflation?” Similarly, you want all of the words used in your query to be intelligent-sounding. Of course, you may not agree with the views of Friedman on inflation. Here are a few economists who are well known and have written a lot on a wide variety of issues:
Paul Samuelson
Milton Friedman
Susan Athey
Paul Krugman
Tyler Cowen
Alex TabarrokBut you don’t have to memorize that list, and it is not long enough anyway. When in doubt, ask GPT itself who might be the relevant experts. How about this?: “I have a question on international trade. Which economists in the last thirty years might be the smartest experts on such questions?” The model will be very happy to tell you, and then you can proceed with your further queries.
Of course this advice generalizes far beyond economics. A friend of mine queried GPT-4 about Jon Fosse, a Norwegian author, and received a wrong answer. He retried the same question, but asking also for an answer from a Fosse expert. The response was then very good.
The title of my paper with Alex is “How to Learn and Teach Economics with Large Language Models, Including GPT,” but again most of the advice is generalizable to education with GPTs more generally. Recommended, the paper is full of tips for using GPT models in more effective ways.
Imagine if humanity ends up divided into two classes of people: those who are willing/not embarrassed to tack on extra “silly bits” to their prompts, and those who are not so willing. The differences in capabilities will end up being remarkable. Are perhaps many elites and academics unwilling to go the extra mile in their prompts? Do they feel a single sentence question ought to be enough? Are they in any case constitutionally unused to providing extra context for their requests?
Time will tell.
Lots of announcements from Glen Weyl
Today may be the most important/culminating of my professional life. Together with dozens of colleagues and collaborators, I’m releasing/launching a series of papers, initiatives and other work. Thanks especially to one of my favorite journalists, @RanaForoohar,
— ⿻(((E. Glen Weyl/衛谷倫))) 🇺🇸/🇩🇪/🇹🇼 🖖 (@glenweyl) March 19, 2023
Sunday assorted links
1. Claims about Neom (speculative, three-minute video).
2. Keep your eye on the bank holding company.
3. This guy was described to me as “the Michael Orthofer of cinema.”
4. Explaining word embeddings in LLMs.
5. GPT-4’s multi-modal capabilities: a preview.
6. Daniel Gross/Nat Friedman podcast on using AI to decipher ancient scrolls. With Brent Seales, recommended.
7. Orson Welles on innovation and creative control (short video).
Antologia De Música Atípica Portuguesa Vol 2: Regiões (2019)
Where are all the Indonesians?
Here is an old reader email query from 2015:
I started by asking, why are there so few Indonesians in the US? The email subject is just a juicy comparison. Indonesians are outnumbered in the U.S. by 14 other Asian-American sub-groups. Most estimates give an answer of about 100,000 total, this from a country of 250+ million.
Theories:
History – Indonesia’s colonial experience is Dutch (although less than 500,000 live in the Netherlands). There do not seem to be many self-identifying South African Americans. The country has more recent independence/consolidation than some.
Religion – Islam reduces immigration demand and supply
Economics – Indonesians are very poor and/or less skilled for particular types of migrant labor. Perhaps why so many are in the Middle East (maybe 1.5 million in Saudi Arabia, although this seems more a recent phenomenon).
Internal markets – Indonesia is large and diverse. Opportunity and adventure are an island away, not a country.
Conflict – Sukharno/Suharto rule uniquely dampened emigration.
Reporting – The range of Indonesian ethnicities is not suitable to census counts. Ask Sir Jervoise Baines about this.
Some combination of the Philippines, Pakistan, India, and Myanmar nix all of the above. The more I think and ask others, the more my answer is “the sum of the valid remainder of all the other explanations.” It is not satisfying.
I am in Indonesia now and ask the question often. Most Indonesians don’t know that there are so few, relatively speaking. One told me about the roughly 500 Indonesians at her alma mater Ohio State University, home of the Center of SouthEast Asia Studies and Professor R. William Liddle (that is why she went there).
Bailouts of insolvent banks don’t lead to hyperinflation
Let’s say there is a big hole in the solvency of a banking system. Left unaddressed, that is radically deflationary. Demand (and other) deposits will disappear, crushing aggregate demand. Cascading financial failures will occur elsewhere, again with negative demand effects. If a government “prints money,” or more likely creates new electronic bookkeeping entries, that offsets the deflationary pressures. These bailouts may have other negative effects, such as on future moral hazard and rent-seeking, but they won’t bring hyperinflation. If you wanted to create hyperinflation, the bailout would have to look something like “for every dollar you used to have in your bank account, the Fed says you now have five!” But that is not on the agenda.
Saturday assorted links
1. Who should next run the NIH?
2. Did 18th century British firefighters just let buildings burn if they hadn’t paid up? Short video.
3. “Developers demolished a historic pub. They must rebuild from the rubble.” The heritage culture that is England. I recommend the photo of the pile of rubble. Was the original building so attractive in the first place?
4. “The Microsoft Copilot “future of work” demo is incredible. Your boss will soon be able to ask their Copilot to create a summary of who does the least work on average and have their termination letter already drafted in Outlook.” Here is the Sam Hammond tweet.
5. Ethan Mollick paper on effective teaching strategies with GPT. And GPT-4 is playing chess at an OK level, though it was never taught that skill.
What do I think of the economists’ Israel petition?
It is signed by many luminaries, and it opens with this:
The governing coalition in Israel is considering an array of legislative acts that would weaken the independence of the judiciary and its power to constrain governmental actions. Numerous Israeli economists, in an open letter that some of us joined, expressed concerns that such a reform would adversely affect the Israeli economy by weakening the rule of law and thereby moving Israel in the direction of Hungary and Poland. Although we significantly vary in our views on public policy and on the challenges facing Israeli society, we all share these concerns. A strong and independent judiciary is a critical part of a system of checks and balances. Undermining it would be detrimental not only to democracy but also to economic prosperity and growth.
I would say I haven’t made up my mind on the substantive issue, as I have seen credible (not saying they are true, I don’t know) arguments that the current Israeli judiciary has too much power. The proposed reforms still might be a badly timed and significant overreach, but my intuition is that the arguments are more complicated than this petition is making them out to be. As economists, are they not at least obliged to tell us what the relevant trade-off is?
I also wonder if these outside voices have influence in Israeli politics, or whether they might occasion backlash. Again, I don’t know, but I do see an argument for reserving collective petitions for very clear cut cases when the transmitted signal will be positive. Is the binding constraint here “not having enough elite academic foreigners in opposition to Netanyahu”?
More generally and perhaps most importantly, will this petition be effective? Many kinds of petitions should be saved up for when they will change something. If they are not going to matter, in essence the signers are signaling their weakness rather than their strength. They are spending down their reputational capital, rather than building it up. And in those cases, why have the petition at all?
Steven Pinker on existential risk
He is harsh, but my view is not far from his:
The AI-existential-threat discussions are unmoored from evolutionary biology, cognitive psychology, real AI, sociology, the history of technology and other sources of knowledge outside the theater of the imagination. I think this points to a meta-problem. The AI-ET community shares a bad epistemic habit (not to mention membership) with parts of the Rationality and EA communities, at least since they jumped the shark from preventing malaria in the developing world to seeding the galaxy with supercomputers hosting trillions of consciousnesses from uploaded connectomes. They start with a couple of assumptions, and lay out a chain of abstract reasoning, throwing in one dubious assumption after another, till they end up way beyond the land of experience or plausibility. The whole deduction exponentiates our ignorance with each link in the chain of hypotheticals, and depends on blowing off the countless messy and unanticipatable nuisances of the human and physical world. It’s an occupational hazard of belonging to a “community” that distinguishes itself by raw brainpower. OK, enough for today – hope you find some of it interesting.
That is by no means the only harsh paragraph. Here is the entire dialogue with Richard Hanania. And be careful what you write in the MR comments section, the AIs are reading you!
What should I ask Jonathan Swift?
Yes, I would like to do a Conversation with Jonathan “G.P.T.” Swift. Here is Wikipedia on Swift, excerpt:
Jonathan Swift (30 November 1667 – 19 October 1745) was an Anglo-Irish satirist, author, essayist, political pamphleteer (first for the Whigs, then for the Tories), poet, and Anglican cleric who became Dean of St Patrick’s Cathedral, Dublin, hence his common sobriquet, “Dean Swift”.
Swift is remembered for works such as A Tale of a Tub (1704), An Argument Against Abolishing Christianity (1712), Gulliver’s Travels (1726), and A Modest Proposal (1729). He is regarded by the Encyclopædia Britannica as the foremost prose satirist in the English language.[1] He originally published all of his works under pseudonyms—such as Lemuel Gulliver, Isaac Bickerstaff, M. B. Drapier—or anonymously. He was a master of two styles of satire, the Horatian and Juvenalian styles.
His deadpan, ironic writing style, particularly in A Modest Proposal, has led to such satire being subsequently termed “Swiftian”.
So what should I ask him? I thank you in advance for your suggestions.
First book written with GPT-4?
I wrote a new book with @OpenAI’s latest, most powerful large language model.
It’s called Impromptu: Amplifying our Humanity through AI.
This, as far as I know, is the first book written with GPT-4.
Here’s how it all began… https://t.co/M19e1ISGpb
— Reid Hoffman (@reidhoffman) March 15, 2023
Friday assorted links
Singaporean hawker centre in Manhattan
Urban Hawker, On 135 W.50th, 17 vendors Here is a NYT review, good photos of the key dishes. The Hainanese chicken rice was amazing, worthy of Singapore, get it poached of course. Condiments! The Malaysian lontong was quite good, the beef rendang decent. The lamb biryani I enjoyed, with a thick sauce than you would not find in Hyderabad, laden with cloves and cinnamon. Most of the people there are not Singaporean, but many have “that Singaporean look,” so it feels fairly authentic, except for the prices, which run about $20 a course. Ordering your meal and finding/keeping a table can be difficult, also making it authentic. (Choping needed!) Ordering a meal and getting a drink of water on the same trip can be difficult, making it more authentic yet. Overall, not as good as it could be but better than you might be expecting. Some of the vendors verge on Pan-Asian rather than Singaporean proper, but ultimately Singapore itself is headed in that direction. So I will go again, though I can’t imagine the chili crab is worth the price. Most of all, you need to go early rather than at peak times.
And if you are wondering what “that Singaporean look” means, I suppose it refers to looking down a bit, earnest, and seeming not entirely happy, all the while focused on getting some excellent food.
How will AI transform childhood?
That is the topic of my latest Bloomberg column, here is one excerpt:
In the future, every middle-class kid will grow up with a personalized AI assistant — so long as the parents are OK with that.
As for the children, most of them will be willing if not downright eager. When I was 4 years old, I had an imaginary friend who lived under the refrigerator, called (ironically) Bing Bing. I would talk to him and report his opinions to my parents and sister.
In the near future, such friends will be quite real, albeit automated, and they will talk back to our children as directly as we wish. Having an AI service for your child will be as normal as having a pet, except the AI service will never bite. It will be carried around in something like a tablet, though with a design that is oriented toward the AI.
Recent developments suggest that AI models can be both commoditized and customized more easily and cheaply than expected. So parents will be able to choose what kind of companion they want their kids to have — in contrast to the free-for-all of the internet. The available services likely will include education and tutoring, text or vocalizations of what the family pet might be thinking, dancing cartoon avatars, and much more. Companies will compete to offer products that parents think will be good for their kids. Some of the AIs might even read bedtime stories (in fact, I’ve already heard some of them).
Many parents may be reluctant to let their kids become attached to an AI. But I predict that most families will welcome it. For one, parents will be able to turn off the connection whenever they wish. Simply clicking a button is easier than yanking an iPad out of a kid’s grasp.
Most of all, letting your kid have an AI companion will bring big advantages. Your child will learn to read and write much faster and better, and will do better in school. Or maybe you want your kid to master Spanish or Chinese, but you can’t afford an expensive tutor who comes only twice a week. Do you want your child to learn how to read music? The AI services will be as limited or as expansive as you want them to be.
It is an open question how quickly schools will embrace these new methods of learning. At some point, however, they will become part of the curriculum. Competitive pressures will make parents reluctant to withhold AI from their kids. Even if the AIs are not present in the classroom, some kids will use them to help do their homework, gaining a big advantage, and the practice will likely spread.
Of course children will use these AIs for purposes far beyond what their parents intend. They will become playthings, companions, entertainers and much more. When I was a kid, with no internet and mediocre TV, I created imaginary worlds in the dirt, or with simple household items, and my parents often had no clue. The AI services will become part of this model of spontaneous play, even if parents try to make them purely educational.
What about teenagers? Well, many parents may allow their kids to speak with AI therapists. It might be better than nothing, and perhaps better than many human therapists.
Recommended, and I do discuss some potential risks as well.
Evading your local monopsonist
By Matthew E. Kahn and Joseph Tracy:
Over the last thirty years, there has been a rise in several empirical measures of local labor market monopsony power. The monopsonist has a profit incentive to offer lower wages to local workers. Mobile high skill workers can avoid the lower monopsony wages by moving to other more competitive local labor markets featuring a higher skill price vector. We develop a Roy Model of heterogeneous worker sorting across local labor markets that has several empirical implications. Monopsony markets are predicted to experience a “brain drain” over time. Using data over four decades we document this deskilling associated with local monopsony power. This means that observed cross-sectional wage gaps in monopsony markets partially reflects sorting on worker ability. The rise of work from home may act as a substitute for high-skill worker migration from monopsony markets.
Here is the full NBER working paper. Many university faculty of course are subject to monopsony power…