Results for “Tests” 628 found
The 2020 Nobel Prize in Economics goes to Paul Milgrom and Robert Wilson for auction theory and the improvement of auction designs. The Nobel Committee has a popular introduction and good scientific overview of auction theory. Billions of dollars of spectrum and other natural resources have been allocated using auctions designed by Milgrom and Wilson and their co-authors.
The money won’t mean much to these winners, who have made plenty of money advising firms about how to bid in the auctions that they designed. Milgrom’s firm Auctionomics advertises its service and Milgrom notes:
Milgrom has advised bidders in radio spectrum auctions, power auctions, and bankruptcy auctions. One advisee, Comcast and its consortium, SpectrumCo, followed the advice of a Milgrom’s team in FCC Auction 66 to achieve the most exceptional performance in US spectrum auction history. SpectrumCo saved nearly $1.2 billion on its spectrum license purchases compared to the prices paid by other large bidders – such as T-Mobile and Verizon – for comparable spectrum acquired at the same time in the same auction. SpectrumCo’s tactics included a $750 million jump bid – the largest in the history of US spectrum auctions and a move that prompted the FCC to change the auction rules.
You can figure that Milgrom got a percentage of those savings! Milgrom also advised Yahoo and Google, among other tech firms, on their advertising auctions.
My post Mechanism Design for Grandma written for the Hurwicz, Maskin and Myerson Nobel, has some background on auctions.
Auction theory and auction practice arose together–this is not a case of theory being rediscovered decades later by practitioners but of the demands by practitioners leading to new theory and new theory leading to new institutions. The Nobel committee notes:
In the early 1990s, an explosion of the demand for mobile communication made the U.S. federal government decide to use an auction for allocating radio-spectrum licenses among telecommunication firms. Previously, the U.S. Federal Communications Commission (FCC) had only been allowed to rely either on administrative procedures—commonly referred to as “beauty contests”—or on lotteries. These methods had notably failed in a number of complex settings, at the expense of both taxpayers and end-users…The obvious alternative is to adopt an auction to as-sign licenses. In fact, as early as in the 1950s, the 1991 Laureate Ronald H. Coase argued that the basic principle should be to allocate objects, such as broadcasting licenses, to the firms who will make the most efficient use of them, and the best way to identify these firms is to assign the objects through a competitive price mechanism (Coase, 1959).
…Following the FCC policy shift, multi-object auctions turned from an esoteric topic at the fringe of microeconomic theory to a hot research topic almost overnight.
…For the 1994 FCC auction, the final version of the newly designed auction was the Simultaneous Multiple Round Auction (SMRA)…[which] raised some $20 billion for the U.S. federal government, twice the forecasted amount. This outcome attracted considerable media attention and led other governments to set up their own auctions. The U.K. 3G spectrum auction that concluded in 2000 raised about $34 billion for the British government (Binmore and Klemperer, 2002). The SMRA auction format became the dominant design for spectrum sales worldwide, and versions of it have been used in Canada, Finland, Germany, India, Norway, Poland, Spain, Sweden, theU.K., and the U.S. These auctions have generated hundreds of billions of dollars for governments worldwide.
Perhaps the most impressive culmination of this work was the 2017 incentive auctions which “simultaneously” bought licenses from over-the air broadcast television stations and resold them to modern cellular phone bidders while respecting constraints so that over-the-air frequencies could be repackaged in ways such that they would not interfere with one another. The auction bought licenses for $10 billion, sold them for $20 billion, generating $10 billion in profit and generating an even larger increase in consumer surplus.
The first is a reverse auction that determines a price at which the remaining over-the-air broadcasters voluntarily relinquish their existing spectrum-usage rights. The second is a forward auction of the freed-up spectrum. In 2017, the reverse auction removed 14 channels from broadcast use, at a cost of $10.1 billion. The forward auction sold 70 MHz of wireless internet licenses for $19.8 billion, and created 14 MHz of surplus spectrum. The two stages of the incentive auction thus generated just below $10 billion to U.S. taxpayers, freed up considerable spectrum for future use, and presumably raised the expected surpluses of sellers as well as buyers.
These auctions also brought home that economics is now tied to computer science. The complexity of the allocation process was so high that new algorithms had to be devised. In particular, repackaging of the frequencies involved solving hundreds of thousands of graph-coloring problems, an NP-hard problem. Computer scientist Kevin Leyton-Brown was brought in to design and optimize the necessary algorithms. At the same time, Milgrom and Segal had to prove that their auction could be characterized in such a way that it could be solved in reasonable time by known algorithms.
Computer scientist Tim Roughgarden has an excellent video lecture on how implementing the incentive auction required a combination of cutting-edge economics and computer science. More generally, mechanism design in the real world, including auction design, Uber’s supply and demand mechanism, blockchains like bitcoin and many other examples, requires both economists and computer scientists to devise institutions and algorithms that incentivize socially beneficial behavior and that can also be solved in real time for real populations.
1. Were the experts too slow to embrace travel restrictions? (NYT) And the Covid culture that is German (short video).
2. Does personality drive moral judgement?: Polite deontologists and curious consequentialists.
3. My rewrite of this thread: doctors hate highly beneficial but somewhat inaccurate testing methods that lower their status and good feelings about themselves.
4. Further results on “dry tinder” in the Nordics: “My results show that a large share of the excess mortality in Sweden in April 2020 may be partially explained by a vulnerable, elderly population due to very mild flu seasons in 18/19 and 19/20 as well as very few deaths during the 2019 summer compared to earlier years and compared to other Nordic countries.”
A herd immunity data point: Borough Park in NYC has one of the highest antibody rates seen in the developed world: 43.9%, based on a huge testing program covering almost 1/3 of local pop. This week positivity rates of Covid-19 tests coming back hit 17%.
7. The nasal spray, which will be entering clinical trials.
We examine the impact of criminalizing sex work, exploiting an event in which local officials unexpectedly criminalized sex work in one district in East Java, Indonesia, but not in neighboring districts. We collect data from female sex workers and their clients before and after the change. We find that criminalization increases sexually transmitted infections among female sex workers by 58 percent, measured by biological tests. This is driven by decreased condom access and use. We also find evidence that criminalization decreases earnings among women who left sex work due to criminalization, and decreases their ability to meet their children’s school expenses while increasing the likelihood that children begin working to supplement household income. While criminalization has the potential to improve population STI outcomes if the market shrinks permanently, we show that five years post-criminalization the market has rebounded and the probability of STI transmission within the general population is likely to have increased.
That is from a new NBER working paper by Lisa Cameron, Jennifer Seager, and Manisha Shah.
Tata group has received approval from the Drug Controller General of India (DCGI) for the commercial launch of the country’s first CRISPR (Clustered Regularly Interspaced Short Palindromic Repeats) coronavirus test ‘Feluda’, the Council of Scientific and Industrial Research (CSIR) said on Saturday. This test uses an indigenously developed, cutting-edge CRISPR technology for detection of the genomic sequence of SARS-CoV-2 virus, CSIR said in a statement.
The Tata CRISPR test achieves accuracy levels of traditional RT-PCR tests with quicker turnaround time, less expensive equipment and better ease of use.
Here is the full story, via Alex HR.
In 2013 I wrote, Our DNA, Our Selves, arguing against the FDA’s crackdown on genetic readouts from firms like 23andMe. The FDA, however, proved succesful in its crackdown and that is why rapid at-home antigen tests are not available today and why tens of thousands of people are dying from COVID unnecessarily. Regulations have unintended consequences.
Consider, I swab the inside of my cheek and send the sample to a firm. The idea that the FDA can rule on what the firm can and cannot tell me about my own genes is absurd–it’s no different than the FDA trying to regulate what my doctor can tell me after a physical examination or what my optometrist can tell me after an eye examination (Please read the first line. “G T A C C A…”).
The idea that the FDA can regulate and control what individuals may learn about their own bodies is deeply offensive and, in my view, plainly unconstitutional.
Let me be clear, I am not offended by all regulation of genetic tests. Indeed, genetic tests are already regulated. To be precise, the labs that perform genetic tests are regulated by the Clinical Laboratory Improvement Amendments (CLIA) as overseen by the CMS (here is an excellent primer). The CLIA requires all labs, including the labs used by 23andMe, to be inspected for quality control, record keeping and the qualifications of their personnel. The goal is to ensure that the tests are accurate, reliable, timely, confidential and not risky to patients. I am not offended when the goal of regulation is to help consumers buy the product that they have contracted to buy.
What the FDA wants to do is categorically different. The FDA wants to regulate genetic tests as a high-risk medical device that cannot be sold until and unless the FDA permits it be sold.
Moreover, the FDA wants to judge not the analytic validity of the tests, whether the tests accurately read the genetic code as the firms promise (already regulated under the CLIA) but the clinical validity, whether particular identified alleles are causal for conditions or disease. The latter requirement is the death-knell for the products because of the expense and time it takes to prove specific genes are causal for diseases. Moreover, it means that firms like 23andMe will not be able to tell consumers about their own DNA but instead will only be allowed to offer a peek at the sections of code that the FDA has deemed it ok for consumers to see.
Ten years later we now need rapid antigen tests but the issue, as Michael Mina points out in an excellent interview with Malcolm Gladwell, is that we have medicalized all tests and readouts. Instead of thinking about the individual as having a right to know about their own body, we treated every test or readout as if the only user were a physician. Thus, instead of thinking about the value of these tests for individuals and for public health, the FDA failed to approve rapid antigen tests because it regarded them as inferior to PCR tests, for a physician diagnosing disease.
Here’s Mina (roughly transcribed and lightly edited)
The only pathway that we have to evaluate tests like this are medical diagnostic pathways, pathways designed specifically to ensure that a physician like a detective is getting all the information they need to diagnose a sick person… We have so devalued and defunded public health…that we don’t have a regulatory pathway to approve a test whose primary objective is stopping an epidemic versus diagnosing a sick person. And that has held everything up. All the companies that could be producing these rapid tests in the millions and millions, they have been sitting on these tests trying to hone them so they can pass FDA standards as a medical diagnostic.
It’s not just slowing down their approval it’s actually bottle necking the companies into creating tests that are not going to be as scalable as they are having to use more expensive reagents and packing the tests with instruments so they can pass FDA review when in reality they are just these little pieces of papers. If we can do the cheap version they can be made very fast but the just won’t get through the FDA.
Gladwell: I find your explanation unconvincing. How dumb is the FDA?…If you make the exact argument you made to me…the FDA is not going to see your logic?
It’s not that they are not smart it’s that this is a regulatory body, they just don’t have a pathway. You can’t apply for approval for a public health test tool…In our country the medical establishment is extremely strong, you can’t go to get a cholesterol test without getting a prescription from your doctor. Why can’t we know that? It’s all through this very heavy medical lens and changing that, getting that big ship to turn is turning out to be a very, very difficult task but leading to potentially tens or hundreds or thousands of deaths that don’t need to be happening.
MPR News: The meeting was slated as a Minneapolis City Council study session on police reform.
But for much of the two-hour meeting, council members told police Chief Medaria Arradondo that their constituents are seeing and hearing street racing which sometimes results in crashes, brazen daylight carjackings, robberies, assaults and shootings. And they asked Arradondo what the department is doing about it.
…Just months after leading an effort that would have defunded the police department, City Council members at Tuesday’s work session pushed chief Medaria Arradondo to tell them how the department is responding to the violence…More people have been killed in the city in the first nine months of 2020 than were slain in all of last year. Property crimes, like burglaries and auto thefts, are also up. Incidents of arson have increased 55 percent over the total at this point in 2019.
Bear in mind this is coming after just a few months of reduced policing, due in part to extra demands and difficulty and probably in part due to police pulling back either out of fear or reluctance (blue flu) as also happened in Baltimore after the Freddie Gray killing and consequent protests and riots.
A few true believers still remain:
Cunningham also criticized some of his colleagues for seeming to waver on the promises they made earlier this year to transform the city’s public safety system.
“What I am sort of flabbergasted by right now is colleagues, who a very short time ago were calling for abolition, are now suggesting we should be putting more resources and funding into MPD,” Cunningham said.
I’m a supporter of unbundling the police and improving policing but the idea that we can defund the police and crime will just melt away is a fantasy. As with bail reform the defunders risk a backlash. Let’s start by decriminalizing more victimless crimes, as we have done in many states with marijuana laws. Let’s work on creating bureaus of road safety. But one of the reasons we do these things is so that we can increase the number of police on the street. The United States is underpoliced and the consequences of underpolicing, as well as overpolicing, fall on minority communities. As I have argued before, we need better policing so that we can all be comfortable with more policing. Getting there, however, will take time.
It’s taken far too long and it’s still not FDA approved for at-home use or for asymptomatic individuals but the new $5,15-minute, easy to use, Abbott test and the Trump administration’s promise to purchase 150 million of them is a big deal. Abbott has been building capacity for months according to their lead scientist interviewed in the Atlantic by Alex Madrigal and in a few weeks will be producing 50 million tests a month:
Madrigal: Fifty million tests a month is a huge number. That’s more than twice the number of tests the U.S. completes in a month. How did you ramp up production so massively?
Hackett: This was the challenge of this program. We needed some sort of reliable testing that could be affordable and that doesn’t require instrumentation. You need scale. The more frequently you could test people, frankly, even tests with lower sensitivity would be very effective at identifying people quickly and slowing the spread. As we were developing the test, there were people working in parallel looking at supply chain and logistics. Abbott took a lot of risk—hundreds of millions of dollars were spent building two new manufacturing facilities focused solely on those tests. We hoped we could come to a solution that would be where we needed it from an overall accuracy perspective, but if you weren’t building capability simultaneously, there was no way it could be the answer.
The US has performed about 80 million tests since the pandemic began, so an additional 50 million tests a month is a big increase in capacity. As noted, the test is not approved for at-home use but it’s a CLIA-waived test which means that a doctor’s office, a CVS or Walmart clinic, even a school nurse could qualify for a waiver and perform the tests. The test is not approved for asymptomatic individuals but I suspect that won’t mean much in practice, it can be prescribed off-label although the fact that a prescription is required is limiting. I hope the necessity for a prescription will be lifted as we get more experience with these tests. False positives (~1.5%) are low and by taking the strain off the PCR system we can improve triage and afford to do more double checks. False positives will be more of an issue as we wipe out the virus but that will take time.
I hope these tests will open up air travel within a month or two. I also hope to see more of these types of tests approved. Derek Lowe has more technical details.
It won’t be all smooth sailing, Abbott may not be able to produce as much or as quickly as they say they can and quality in the field may fall. The government may distribute the tests poorly. The virus could pickup in the fall, as in 1918. I expect more problems and challenges but we now have a chance to get ahead of the virus which is very welcome news.
Addendum: This type of public-private partnership with private firms building capacity in advance of approval for tests and vaccines on the foundation of government push and pull funding is exactly the structure that the Accelerating Health Technologies team has been recommending both to the US government and to governments around the world.
Most theories and hypotheses in psychology are verbal in nature, yet their evaluation overwhelmingly relies on inferential statistical procedures. The validity of the move from qualitative to quantitative analysis depends on the verbal and statistical expressions of a hypothesis being closely aligned—that is,that the two must refer to roughly the same set of hypothetical observations. Here I argue that most inferential statistical tests in psychology fail to meet this basic condition. I demonstrate how foundational assumptions of the “random effects” model used pervasively in psychology impose far stronger constraints on the generalizability of results than most researchers appreciate. Ignoring these constraints dramatically inflates false positive rates and routinely leads researchers to draw sweeping verbal generalizations that lack any meaningful connection to the statistical quantities they are putatively based on. I argue that failure to consider generalizability from a statistical perspective lies at the root of many of psychology’s ongoing problems (e.g.,the replication crisis), and conclude with a discussion of several potential avenues for improvement.
That is from a recent paper by Tal Yarkoni.
If you think the FDA has been slow at approving new coronavirus tests just look at their process for approving sunscreen products.
According to EWG, the Environmental Working Group, the FDA has been too slow to test old ingredients for safety and too slow to allow new ingredients on the market thus leaving us with sunscreen products which are neither as safe nor as effective as they should be. In particular, Europe has better sunscreen protection than the United States. Here’s EWG:
Americans have fewer choices and notably poorer protection than Europeans do from ultraviolet A rays in their sunscreen options. Although most U.S. sunscreens prevent sunburn effectively when used correctly, they aren’t as good as European sunscreens at preventing the more subtle skin damage produced by lower-energy UVA radiation. UVA rays have less energy and don’t burn the skin, but they can cause the skin to age, suppress the immune system and contribute to the development of melanoma.
…Between 2003 and 2010, sunscreen makers applied for FDA permission to use eight sun-filtering chemicals developed by European companies. Four of these – Tinosorb S, Tinosorb M, Mexoryl SX and Mexoryl XL – appear to be more effective than avobenzone, the most common UVA filter permitted by the FDA. The FDA’s failure to respond to these applications prompted Congress to pass the Sunscreen Innovation Act of 2014 (FDA 2014). This act requires the FDA to review new applications for sunscreen active ingredients within 300 days, but it doesn’t relax the standards companies must meet to prove new ingredients are both safe and effective.
In 2015, the FDA responded that the companies involved had not submitted enough information to prove their chemicals were, in fact, safe and effective for use (FDA 2015). The agency asked for more data, including complete study results, measurements of ingredient levels in people’s blood, and long-term studies on systemic toxicity and potential endocrine system disruption. The FDA has also proposed that all sunscreen ingredients, including those already in use, need to have adequate safety testing data.
Some information the FDA wants, such as complete copies of studies, might be easy for sunscreen makers to produce. But in other cases, the companies could take years to satisfy FDA requests. In the meantime, Americans are being shortchanged.
I first wrote about this issue in 2013 and seven years later, despite Congress passing a law in 2014, the FDA still has not acted.
My rule is very simple. I don’t think the FDA is better than the EMA so if any drug or device is approved in Europe it ought to be available for purchase in the United States with a label saying “Approved by the EMA. Not approved by the FDA.” (By the way, we do have reciprocity type agreements with Canada and New Zealand for food so this would not be unprecedented.)
Hat tip: John Thacker.
Addendum: You should actually get more sun to avoid vitamin D deficiency which is bad for a variety of reasons including, in my estimation, greater susceptibility to COVID.
Supply chains were hit hard early in the pandemic. Disinfectant couldn’t be produced because of a lack of bottles, tests couldn’t be processed because nasal swabs or PPE wasn’t available, the decline of passenger air traffic hit commercial delivery and so forth. I worry about forthcoming stresses on the vaccine supply chain. Billions of doses of vaccine will be demanded in the next year and a lot will depend on complicated supply lines including cold storage, air traffic, styrofoam, vials, bags, needles and many other inputs. Companies and the awesome team at CEPI (give them all a Nobel prize) are planning for vials and needles and other inputs but there are many non-obvious inputs higher up in the supply chain that also need shoring up.
Writing in Bloomberg, Scott Duke Kominers and I look at some of the odder inputs to vaccines like horseshoe crab blood, shark livers and the vaccinia capping enyzme, VCE. We are actually not too worried about horseshoe crab blood and shark livers as these are used in other industries. Shark livers, for example, are used to produce a lot of cosmetics so we should be able to divert supply as needed. VCE, however, is rarer.
DNA and mRNA vaccine technologies have shown promising results, and two of the leading vaccine contenders, from Pfizer Inc. and Moderna Inc., use mRNA technology. But mRNA has never been used to produce a commercial vaccine for humans, let alone at scale. And scaling these technologies may not be easy. In particular, mRNA degrades rapidly. To prevent this, it must be “capped” by a very rare substance called vaccinia capping enzyme.
Just over 10 pounds of this VCE is enough to produce a hundred million doses of an mRNA vaccine — but the current manufacturing processes for VCE require so much bioreactor capacity that making 10 pounds would cost about $1.4 billion. More important, global bioreactor capacity cannot support production at that level while also producing other vaccines and cancer-fighting drugs.
If we work hard now, we may be able to find more efficient means of producing VCE. Expanding bioreactor production and repurposing bioreactors from existing large-scale industrial applications will also help to lessen the pressure on the supply chains for multiple types of vaccines.
In addition to supply chains per se we also face the problem that companies are not raising prices enough. Ironically, this means that we need more public investment.
Of course, we might think that private companies would have incentives to coordinate supply chains themselves — and to some extent, they are doing so. But many have pledged to keep their vaccine prices close to costs, both out of altruism and because they may fear public backlash (or legal action) if they’re perceived as “price gouging” in the middle of a pandemic. And if companies don’t stand to profit much from Covid-19 vaccines, then they don’t have much incentive to invest in increasing capacity. In short: If prices can’t rise, then the only way to encourage companies to invest more in production is to reduce their costs — and that means we need public investment.
More generally, it’s not too late to be building more vaccine capacity and to repurpose bioreactor capacity from non-GMP sources, perhaps including veterinary and food sources. There are lots of vaccines in development. The science is promising. We need to take action now so that we can deliver on that promise.
Read the whole thing.
4. Thread on the basics of herd immunity claims. And the NYT covers herd immunity. A very good piece in fact. Semi-herd immunity says I, or “imperfect immunity” to use the terminology of the article. And you will note the extreme epistemological conservatism emanating from the mainstream experts interviewed. Appropriate in some ways, not in others.
7. WSJ review of new Bruno Macaes book on America. The predictions of the book are holding up very well so far!
The FDA has just approved a new and important Covid-19 test:
“Wide-spread testing is critical for our control efforts. We simplified the test so that it only costs a couple of dollars for reagents, and we expect that labs will only charge about $10 per sample. If cheap alternatives like SalivaDirect can be implemented across the country, we may finally get a handle on this pandemic, even before a vaccine,” said Grubaugh.
One of the team’s goals was to eliminate the expensive saliva collection tubes that other companies use to preserve the virus for detection. In a separate study led by Wyllie and the team at the Yale School of Public Health, and recently published on medRxiv, they found that SARS-CoV-2 is stable in saliva for prolonged periods at warm temperatures, and that preservatives or specialized tubes are not necessary for collection of saliva.
Of course this part warmed my heart (doubly):
The related research was funded by the NBA, National Basketball Players Association, and a Fast Grant from the Emergent Ventures at the Mercatus Center, George Mason University.
The NBA had the wisdom to use its unique “bubble” to run multiple tests on players at once, to see how reliable the less-known tests would be. This WSJ article — “Experts say it could be key to increasing the nation’s testing capacity” — has the entire NBA back story. At an estimated $10 a pop, this could especially be a game-changer for poorer nations. Furthermore, it has the potential to make pooled testing much easier as well.
Here is an excerpt from the research pre-print:
The critical component of our approach is to use saliva instead of respiratory swabs, which enables non-invasive frequent sampling and reduces the need for trained healthcare professionals during collection. Furthermore, we simplified our diagnostic test by (1) not requiring nucleic acid preservatives at sample collection, (2) replacing nucleic acid extraction with a simple proteinase K and heat treatment step, and (3) testing specimens with a dualplex quantitative reverse transcription PCR (RT-qPCR) assay. We validated SalivaDirect with reagents and instruments from multiple vendors to minimize the risk for supply chain issues. Regardless of our tested combination of reagents and instruments from different vendors, we found that SalivaDirect is highly sensitive with a limit of detection of 6-12 SARS-CoV-2 copies/μL.
No need to worry and fuss about RNA extraction now. Here is the best simple explanation of the whole thing.
The researchers are not seeking to commercialize their advance, rather they are making it available for the general benefit of mankind. Here is Nathan Grubaugh on Twitter. Here is Anne Wyllie, also a Kiwi and a Kevin Garnett fan. A further implication of course is that the NBA bubble is not “just sports,” but also has boosted innovation by enabling data collection.
All good news of course, and Fast at that. And this:
“This could be one the first major game changers in fighting the pandemic,” tweeted Andy Slavitt, a former acting administrator of the Centers for Medicare and Medicaid Services in the Obama administration, who expects testing capacity to be expanded significantly. “Rarely am I this enthusiastic… They are turning testing from a bespoke suit to a low-cost commodity.”
And here is coverage from Zach Lowe. I am very pleased with the course of Fast Grants more generally, and you will be hearing more about it in the future.