Results for “Tests” 811 found
Markets in everything those new service sector jobs
A woman who took about 150 theory and practical tests for other drivers has been jailed for eight months.
Police said she was taking tests for people who had difficulty with English.
…Det Ch Insp Steven Maloney said Kaur’s crimes were motivated by greed.
Here is the full story, via Michael B.
What Caused the Murder Spike?
I think there’s clear evidence that the current murder spike was caused primarily by the 2020 BLM protests. The timing matches the protests well, and the pandemic poorly. The spike is concentrated in black communities and not in any of the other communities affected by the pandemic. It matches homicide spikes corresponding to other anti-police protests, most notably in the cities where those protests happened but to a lesser degree around the country. And the spike seems limited to the US, while other countries had basically stable murder rates over the same period.
I agree with Scott Alexander, although I would emphasize a little more the mediating factor of the police pullback.
I would also add that each step in the mechanism–protests lead to police pullback which leads to an increase in murders–is well supported on its own in the academic literature. Step one, for example, is that protests lead to police pullback. In The effect of highly publicized police killings on policing: Evidence from large U.S. cities Cheng and Long document exactly this:
Our regression discontinuity and difference-in-differences estimates provide consistent and strong evidence that those high-profile killings reduced policing activities, including police self-initiated activities and arrests.
That’s step one. Step two is that police on the street reduce crime which you can find from my research using the terror alert level as well as that of many others. Step one plus step two leads to a spike in murders following the 2020 BLM protests.
As Alexander noted, we also have plenty of evidence on a micro level. For example, I showed clear evidence of police pullback–a “blue strike”–and consequent increase in crime in Baltimore after the Freddie Gray protests. Put it all together along with the timing and other evidence and the case is strong that the 2020 BLM protests led to police pullback which led to a spike in murders, especially in black communities.
GiveDirectly to Administer Cash Grants Pilot in Chicago
Long time readers will know that both Tyler and I have been promoting GiveDirectly since its creation in 2011. GiveDirectly was started by four economists and it gives money directly to the very poor in Kenya and Uganda. Unusually for any charity, GiveDirectly has published substantial, high quality, pre-registered RCTs on its work and is a top-rated charity by GiveWell. GiveDirectly, the charity, continues to do great work helping the world’s poorest people but they are now also using their experience to help design and administer programs in the United States.
A nonprofit that originally focused on giving cash to impoverished people in Africa will soon be delivering money to poor residents of Chicago, in one of the largest tests of a guaranteed basic income program in the US.
GiveDirectly is administering a program that will give $500 a month to each of 5,000 households in Chicago as soon as the end of June. The city is using $31.5 million from the federal government’s American Rescue Plan Act for the year-long pilot, and hoping the payments will help it recover faster from the pandemic.
I look forward to seeing the results.
Cognitive Endurance as Human Capital
A favorite topic of mine:
Schooling may build human capital not only by teaching academic skills, but by expanding the capacity for cognition itself. We focus specifically on cognitive endurance: the ability to sustain effortful mental activity over a continuous stretch of time. As motivation, we document that globally and in the US, the poor exhibit cognitive fatigue more quickly than the rich across field settings; they also attend schools that offer fewer opportunities to practice thinking for continuous stretches. Using a field experiment with 1,600 Indian primary school students, we randomly increase the amount of time students spend in sustained cognitive activity during the school day—using either math problems (mimicking good schooling) or non-academic games (providing a pure test of our mechanism). Each approach markedly improves cognitive endurance: students show 22% less decline in performance over time when engaged in intellectual activities—listening comprehension, academic problems, or IQ tests. They also exhibit increased attentiveness in the classroom and score higher on psychological measures of sustained attention. Moreover, each treatment improves students’ school performance by 0.09 standard deviations. This indicates that the experience of effortful thinking itself—even when devoid of any subject content—increases the ability to accumulate traditional human capital. Finally, we complement these results with quasi-experimental variation indicating that an additional year of schooling improves cognitive endurance, but only in higher-quality schools. Our findings suggest that schooling disparities may further disadvantage poor children by hampering the development of a core mental capacity.
Here is the full paper by Christina L. Brown, Supreet Kaur, Geeta Kingdon & Heather Schofield. What are you doing to improve your cognitive durability?
And don’t forget that the Candidates’ Match starts today!
Direct Instruction Produces Large Gains in Learning, Kenya Edition
In an important new paper, Can Education be Standardized? Evidence from Kenya, Guthrie Gray-Lobe, Anthony Keats, Michael Kremer, Isaac Mbiti and Owen Ozier evaluate Bridge International schools using a large randomized experiment. Twenty five thousand Kenyan students applied for 10,000 scholarships to Bridge International and the scholarships were given out by lottery.
Kenyan pupils who won a lottery for two-year scholarships to attend schools employing a highly-structured and standardized approach to pedagogy and school management learned more than students who applied for, but did not win, scholarships.
After being enrolled at these schools for two years, primary-school pupils gained approximately the equivalent of 0.89 extra years of schooling (0.81 standard deviations), while in pre-primary grades, pupils gained the equivalent of 1.48 additional years of schooling (1.35 standard deviations).
These are very large gains. Put simply, children in the Bridge programs learnt approximately three years worth of material in just two years! Now, I know what you are thinking. We have all seen examples of high-quality, expensive educational interventions that don’t scale–that was the point of my post Heroes are Not Replicable and see also my recent discussion of the Perry Preschool project–but it’s important to understand the backstory of the Bridge study. Bridge Academy uses Direct Instruction and Direct Instruction scales! We know this from hundreds of studies. In 2018 I wrote (no indent):
What if I told you that there is a method of education which significantly raises achievement, has been shown to work for students of a wide range of abilities, races, and socio-economic levels and has been shown to be superior to other methods of instruction in hundreds of tests?….I am reminded of this by the just-published, The Effectiveness of Direct Instruction Curricula: A Meta-Analysis of a Half Century of Research which, based on an analysis of 328 studies using 413 study designs examining outcomes in reading, math, language, other academic subjects, and affective measures (such as self-esteem), concludes:
…Our results support earlier reviews of the DI effectiveness literature. The estimated effects were consistently positive. Most estimates would be considered medium to large using the criteria generally used in the psychological literature and substantially larger than the criterion of .25 typically used in education research (Tallmadge, 1977). Using the criteria recently suggested by Lipsey et al. (2012), 6 of the 10 baseline estimates and 8 of the 10 adjusted estimates in the reduced models would be considered huge. All but one of the remaining six estimates would be considered large. Only 1 of the 20 estimates, although positive, might be seen as educationally insignificant.
…The strong positive results were similar across the 50 years of data; in articles, dissertations, and gray literature; across different types of research designs, assessments, outcome measures, and methods of calculating effects; across different types of samples and locales, student poverty status, race-ethnicity, at-risk status, and grade; across subjects and programs; after the intervention ceased; with researchers or teachers delivering the intervention; with experimental or usual comparison programs; and when other analytic methods, a broader sample, or other control variables were used.
Indeed, in 2015 I pointed to Bridge International as an important, large, and growing set of schools that use Direct Instruction to create low-cost, high quality private schools in the developing world. The Bridge schools, which have been backed by Mark Zuckerberg and Bill Gates, have been controversial which is one reason the Kenyan results are important.
One source of controversy is that Bridge teachers have less formal education and training than public school teachers. But Brdige teachers need less formal education because they are following a script and are closely monitored. DI isn’t designed for heroes, it’s designed for ordinary mortals motivated by ordinary incentives.
School heads are trained to observe teachers twice daily, recording information on adherence to the detailed teaching plans and interaction with pupils. School heads are given their own detailed scripts for teacher observation, including guidance for preparing for the observation, what teacher behaviors to watch for while observing, and how to provide feedback. School heads are instructed to additionally conduct a 15 minute follow up on the same day to check whether teachers incorporated the feedback and enter their scores through a digital system. The presence of the scripts thus transforms and simplifies the task of classroom observation and provision of feedback to teachers. Bridge also standardizes a range of other processes from school construction to financial management.
Teachers are observed twice daily! The model is thus education as a factory with extensive quality control–which is why teachers don’t like DI–but standardization, scale, and factory production make civilization possible. How many bespoke products do you buy? The idea that education should be bespoke gets things entirely backward because that means that you can’t apply what you learn about what works at scale–Heroes are Not Replicable–and thus you don’t get the benefits of refinement, evolution, and continuous improvement that the factory model provides. I quoted Ian Ayres in 2007:
“The education establishment is wedded to its pet theories regardless of what the evidence says.” As a result they have fought it tooth and nail so that “Direct Instruction, the oldest and most validated program, has captured only a little more than 1 percent of the grade-school market.”
Direct Instruction is evidence-based instruction that is formalized, codified, and implemented at scale. There is a big opportunity in the developing world to apply the lessons of Direct Instruction and accelerate achievement. Many schools in the developed world would also be improved by DI methods.
Addendum 1: The research brief to the paper, from which I have quoted, is a short but very good introduction to the results of the paper and also to Direct Instruction more generally.
Addendum 2: A surprising number of people over the years have thanked me for recommending DI co-founder Siegfried Engelmann’s Teach Your Child to Read in 100 Easy Lessons.
Difficult-To-Pronounce Names and Labor Market Outcomes
Here is a new paper from Qi Ge and Stephen Wu:
This paper tests for the existence of labor market discrimination based on a previously unstudied characteristic: name fluency. Using data on over 1,500 economics job market candidates from roughly 100 PhD programs during the 2016-2017 and 2017-2018 job market cycles, we find that having a name that takes longer to pronounce is associated with 1) a significantly lower likelihood of being placed into an academic job or obtaining a tenure track position; and 2) an initial placement at an institution with lower research productivity, as measured by the research rankings in the Research Papers in Economics (RePEc) database. We obtain similar results using two alternative ways of measuring pronunciation difficulty, a computer generated algorithm based on commonality of letter and phoneme combinations and a subjective measure based on individual ratings, and they hold after the inclusion of many control variables including fixed effects for PhD institution and home country.
Might the hard-to-pronounce names nonetheless be proxying for lesser job networks in some manner? In any case an interesting result. Via the excellent Kevin Lewis.
Sunday assorted links
2. When do ideas get easier to find? Hard to excerpt, but important piece.
3. The economics of stadium names.
4. Pollution from car tire wear.
5. The Swedish history of not feeding other people’s children.
6. The 1993 ferry sinking off the coast of Jeremie, Haiti had a high death toll — some sources say over one thousand (does anyone know the proper final toll?). Yet the incident doesn’t seem to have its own Wikipedia page.
Testing Freedom
I did a podcast with Brink Lindsey of the Niskanen Center. Here’s one bit on the FDA’s long-history of banning home tests:
Brink Lindsey: …it’s on the rapid testing that we had inexplicable delays. Rapid tests, home tests were ubiquitous in Europe and Asia months before they were in the United States. What was going on?
Alex Tabarrok: So I think it’s not actually inexplicable because the FDA has a long, long history of just hating people testing themselves. So the FDA was against pregnancy tests, they didn’t like that, they said women they need to consult with a doctor, only the physician can do the test because literally women could become hysterical if they were pregnant or if they weren’t pregnant, this was a safety issue. There was no question that the test itself was safe or worked. Instead what the FDA said, “We can regulate this because the user using it, this could create safety issues because they could commit suicide or they could do something crazy.” So they totally expanded the meaning of safety from is the test safe to can somebody be trusted to use a pregnancy test?
Then we had exactly the same thing with AIDS testing. So we delayed personal at-home tests for AIDS for literally 25 years. 25 years these tests were unavailable because the FDA again said, “Well, they’re dangerous.” And why are they dangerous? “Well, we don’t know what people will do with this knowledge about their own bodies.” Now, of course, you can get an HIV test from Amazon and the world hasn’t collapsed. They did the same thing with genetic tests from companies like 23andMe. So I said, “Our bodies ourselves, our DNA ourselves.” That people have a right to know about the functioning of their own bodies. This to me is a very clear violation of the Constitutions on multiple respects. It just stuns me, it just stuns me that anybody could think that you don’t have a right to know, we’re going to prevent you from learning something about the operation of your own body.
Again, the issue here was never does the test work. In fact, the labs which produce these tests, those labs are regulated outside of the FDA. So whether the test actually works, whether yes, it identifies this gene, all issues of that nature, what is the sensitivity and the specificity, are the tests produced in a proper laboratory, I don’t have a lot of problem with that because that’s all something which the consumers themselves would want. What I do have a problem with is then the FDA saying, “No, you can’t have access to this test because we don’t know what you’re going to do about it, what you’re going to think about it.” And that to me is outrageous.
Here’s the full transcript and video.
Let’s eliminate the Covid test entry requirement for the U.S.
That is the topic of my latest Bloomberg column, you ought to be able to guess most of my arguments. Here is the very end:
I am not arguing for passivity in the face of danger. It is distressing that US policymakers do not seem interested in spending big for pandemic preparedness. America needs a new Operation Warp Speed for pan-coronavirus vaccines and nasal spray vaccines. It should be gathering more data on Covid and improving its system of clinical trials for anti-Covid remedies, among other measures.
I am simply saying that removing the Covid test for entry to the US would bring an end to one of the more egregious instances of “hygiene theater.” And it would send a signal that America is welcoming the world once again.
Recommended. And note that the most responsible European countries do not impose such tests.
What is the best interview question of all time?
That is the topic of my latest Bloomberg column, also picked by the WaPo. Excerpts:
“What are the open tabs in your browser right now?”
…First, the question measures what a person does with his or her spare time as well as work time. If you leave a browser tab open, it probably has some importance to you and you expect to return to the page. It is one metric of what you are interested in and what your work flow looks like.
It’s not just cheap talk. Some job candidates might say they are interested in C++ as a programming language, but if you actually have an open page to the Reddit and Subreddits on that topic, that is a demonstrated preference…
The question also tests for enthusiasm. If the person doesn’t seem excited about any of those open browser tabs, that may be a sign that they are blasé about other things as well. But if you get a heated pitch about why a particular website is the best guide to “Lord of the Rings” lore, you may have found a true nerd with a love of detail. That will be a plus for many jobs and avocations, though not all.
There is much more at the link, and to consider some other competing questions, do see my new book with Daniel Gross Talent: How to Identify Energizers, Creatives, and Winners Around the World, publication date is today!
And do note that this particular question comes from Daniel.
Monday assorted links
1. Surgeon quality really matters.
2. Further observations on the Russian Army.
3. The Trump tariffs hurt Hollywood in China.
4. Heckman and Zhou vs. test scores.
5. Who went to BLM protests? Some of you will enjoy this point: “Finally, we provide novel evidence of overlap: attending a Black Lives Matter protest increases the likelihood of attending a protest calling for fewer public health restrictions.”
New evidence on schooling and pandemic learning
We estimate the impact of district-level schooling mode (in-person versus hybrid or virtual learning) in the 2020-21 school year on students’ pass rates on standardized tests in Grades 3–8 across 11 states. Pass rates declined from 2019 to 2021: an average decline of 12.8 percentage points in math and 6.8 in English language arts (ELA). Focusing on within-state, within commuting zone variation in schooling mode, we estimate districts with full in-person learning had significantly smaller declines in pass rates (13.4 p.p. in math, 8.3 p.p. in ELA). The value to in-person learning was larger for districts with larger populations of Black students.
That is from a new paper by Rebecca Jack, Claie Halloran, James Okun, and Emily Oster.
France analysis of the day
Macron had promised to reduce state spending — then a record at more than 56 per cent of gross domestic product — by about 5 percentage points. Instead, under pressure from protests and the pandemic, state spending rose to a staggering 60 per cent of GDP. France’s government spending is 15 points above the average for developed economies.
Moreover, that gap is explained less by heavy spending on education, health or housing than on welfare programmes, which at 18 per cent of GDP is nearly double the average for developed economies. France is stuck in a welfare trap, spending generously on income transfers but pushed by voters to spend even more, given discontent with the rising cost of living and with inequality.
Here is more from Ruchir Sharma at the FT. And this:
Total billionaire wealth doubled under Macron to 17 per cent of GDP, and nearly 80 per cent of French billionaires’ wealth is inherited — among the highest in the world.
The benefits of educational migration
That is the topic of my Bloomberg column, and I offer up a very concrete proposal:
The educational migration idea also has potential for the U.S., though with additional hurdles. American universities typically offer some tuition aid to foreign students, but they could pledge to do more. Imagine if every school in America offered 10 additional zero-tuition slots a year to students from very poor countries. The strain on the facilities of most schools would be minimal, yet with about 5,000 institutions of higher education in America, that could amount to tens of thousands of new slots for educational migrants.
Given the great and justified interest in helping emigrants from Ukraine, the U.S. and other countries might also consider special programs for Ukrainian students. Millions are leaving Ukraine, and while the charitable response has been impressive, over the longer term these individuals will need to find good jobs. Education is one major step toward this end.
And some caveats:
It remains to be seen how readily educational migration can be scaled. Not all students from poor countries have the linguistic and cultural preparation to study in the West. They may require mentoring, and they may have difficulties navigating the university application process. Universities, and the charities working with them, may have to work harder to create admissions tests that are relevant, challenging and secure. Still, they may get better at those tasks the more they try to make educational migration work.
For the original pointer I thank Richard Nerland.
Shruti Rajagopalan podcast with Lant Pritchett
There is plenty on India, RCTs, economic development, and education. Here is one bit from Pritchett:
Everybody is getting a crappy education. One of the few times I’ve gotten a spontaneous standing ovation was, I was giving a talk about Indian education to a group, mainly of IAS officers—and who were elites of the education system, who have emerged as elites from the system. I was talking about the deficits in the Indian education system. I just said, “Look, I know everybody in this room is intrinsically smarter than I am by a lot, because imagine where you would be had anyone given a shit about what you actually learned.”…
It was that the curriculum is so out of touch and the teaching is so out of touch with good teaching that by not learning the fundamentals early, it’s not the case that the elite are getting a great education. Indonesia is another place I’ve worked and lived and have a lot of love for. When the OECD did adult literacy tests, fact of the matter is that adult literacy of tertiary graduates in Jakarta—this is just a sample of the most elite city, the most elite—were lower than high school dropouts in the OECD.
Again, I think there’s this illusion that there’s this very steep gradient in a low-performing system and that the elite are coming out with super good educations. I agree that the elite coming out of the Indian system are super impressive, amazing people because no way could I have survived the education system. I’m not claiming the Indian elite aren’t unbelievably world-competitive with any elite everywhere. There’s a reason why the Indian elite come out and are now CEOs of major American corporations, but it isn’t because the education system has been this wonderfully value-added process.
It’s been an unbelievably brutal selection process, which select on a bunch of overcoming features like grit and determination and drive that then might be good signals of who could be an effective CEO. If you can survive the Indian education system, of course you can run Google.
And:
RAJAGOPALAN: How has your Utah-Idaho background, lots of exposure to Mormonism—how has that affected or shaped your perspectives on economic development?
Interesting throughout.