Last night I finished Philip Tetlock’s Expert Political Judgment:
…no matter how unequivocal the evidence that experts cannot outpredict chimps or extrapolation algorithms, we should expect business to unfold as usual: pundits will continue to warn us on talk shows and op-ed pages of what will happen unless we dutifully follow their policy prescriptions. We — the consumers of expert pronouncements — are in thrall to experts for the same reasons that our ancestors submitted to shamans and oracles: our uncontrollable need to believe in a controllable world and our flawed understanding of the laws of chance. We lack the willpower and good sense to resist the snake oil products on offer. Who wants to believe that, on the big questions, we could do as well tossing a coin as by consulting accredited experts?
Daniel Drezner has two excellent posts on the book, here and here. Here is Louis Menand’s glowing review from The New Yorker. Here is Tetlock’s home page. Here is a sample book chapter.
And yes Tetlock has data, drawing upon twenty years of observation of 82,361 forecasts. Tetlock also finds that "foxes" forecast better than "hedgehogs" and that only the forecasts of foxes have positive value.
This is one of the (few) must-read social science books of 2005.
My caveat: Assume that the experts are usually wrong in their novel predictions. The consensus views of a science still might be worth listening to. Economists cannot forecast business cycles very well, but you should listen when they tell you that a deflationary shock is bad news. Each new forecast or new theory is an example of individual hubris and in expected value terms it is stupid. But the body of experts as a whole, over time, absorbs what is correct. A large number of predictions creates a Hayekian discovery process with increasing returns to scale. Social knowledge still comes out ahead, and in part because of the self-deceiving vanities put forward every day. You can find that point in Jonathan Swift’s Gulliver’s Travels.
Comments are open, most of all if you have read the book or other work by Tetlock.
















I’ve always thought that experts had some value at helping you to see the universe of possible futures, although not at telling you which possible future would occur. In this respect, they help to remedy two human behavioral/psychological limitations: (1) people tend to think in self-reinforcing patterns and to have difficulty challenging (or even articulating) their own assumptions and (2) people find it much easier to reason about concrete, semi-plausible stories rather than vague abstractions or unknown unknowns.
For example, many businesses suffer from myopia, focusing on one happy imagined future. If an expert with lots of inflated credentials can convince a business manager to consider the possibility of even one alternative future, that expert will have created positive value.
An example of part (2) would be the use of expert forecasts to train emergency-response teams — if you are running a corporate information security department, or a financial risk management office, or a local fire department, you may use expert-generated scenarios in your training and planning exercises. It is 100% certain that the real emergency will not follow what you planned for, but, you still need something concrete for your planning exercise.
Experts say you can’t trust experts. Studies show that most studies are wrong.
How about experts USING extrapolation algorithms? Do the experts worsen the result of the extrapolation?
The Wisdom of Crowds of Experts?! Seems counterintuitive.
Most of the things that people are interested in hearing forecasts about are inherently hard to predict. That’s why we are interested in them. Being able to predict when the sun comes up tomorrow is a highly useful skill, but it won’t get you on TV to argue with other experts about it. In contrast, consistently predicting who is going to beat the point spread in NFL games is practically impossible because the point spreads are established in self-correcting markets, but because it’s so hard to do, there is much demand for the opinions of people who can go on TV and act like they know what they are talking about.
What’s amusing is how little interest there is in being able to model the past correctly. For example, eEconomist Steven D. Levitt’s abortion-cut-crime didn’t predict the past accurately, as an hour of checking Google showed, but it still helped make him rich and famous. Now we know his theory was based on simple incompetence on his part, but it was pretty obvious it failed to predict the past when it was unveiled in 1999.
Levitt’s counterattack is on his website and the jury is still out on
his thesis. We’ll see the counter counter attack, etc, for a while.
As for Tetlock, a minor quibble on his posted chapter. From Soviet and
American archives we now know that Kennedy backed down, that the Soviet
demand for the US to withdraw US missiles from Turkey in exchange for
Soviet withdrawel of Soviet missiles from Cuba was met. Kennedy pushed
back the Soviets in American mythology, but not in the real world.
Khrushchev and Kennedy both lost power shortly after this crisis. They
made too many people nervous.
I’ve not had a chance to look at Tetlock’s book, but I have read Klein’s “Sources of Power” (which was about decision making). My opinion is that while experts make far better decisions than a non-expert, many experts have been co-opted by people with money. Like when the administration hired James Guckert/Gannon, Armstrong Williams, Dave Smith, and Karen Ryan (among others) to advertise for them. The book “Trust Us, We’re Experts” is also about “scientists” for sale and the pseudoscience that gets bandied about in the media. Remember the brokerages that had to pay large fines for pushing stocks that they were being bribed to push?
“By definition, an index fund should earn (before fees) precisely the market-cap weighted average of the before-fees performance of all of the actively managed funds in the same basket of securities”
No. An index fund will carry the basket of securities that make up the S&P500, or Russell 2000 index, or whatever index the fund is based on. They are NOT averages of other funds. They are based on a single list that changes semi-annually (in the case of some of the Russell indices), or less frequently (in the case of the Dow Jones Industrial Average). When the word “core” appears as part of the name of the fund, it will be predominantly the index with a few stocks missing. Index funds usually have lower management fees since there is no need to manage them, nor do any form of analysis. And it is the management/12b-1 fees that can make a lot of difference in a fund’s performance: which is why they tend to outperform managed funds. Very few indices are “based on fund managers” and those are indices with “growth” or “value” in their names, as G&V are subjective judgements of the fund managers (we think X is under priced, so that makes X a “value” stock).
http://www.russell.com/US/Indexes/US/methodology.asp
Large funds sometimes close themselves to new investors to keep their performance up. If they take in too much money, there aren’t usually enough investments to be able to keep their performance up. It isn’t the smaller funds that underperform, sometimes it is the large ones, as they grow too big for effective management, and have too much money to be able to find good invesments for it.
Small cap funds were popular for some time, and it looks like folks are trying to pitch Large cap funds as the next “big thing.” I used to work for a company that ran websites for mutual fund companies, so I’d see the performance numbers all the time. The remark that an index would outperform 2/3 of funds is quite accurate, although the funds it would outperform might differ each year. What surprised me was that some funds would underperform the index every year, year after year, and would still have investors.
google排å
wow power leveling
wow power leveling
wow powerleveling
wow powerleveling
wow power level
wow power level
hongkong hotel
hongkong hotel
beijing tour
beijing tour
翻译公å¸
翻译公å¸
上海翻译公å¸
上海翻译公å¸
北京翻译公å¸
北京翻译公å¸
é—¨ç¦
wow gold
wow gold
powerleveling
powerleveling
wow powerleveling
wow powerleveling
wow power leveling
wow power leveling
power leveling
power leveling
wow power level
wow power level
窃å¬å™¨
ç¦å½©3D
æ¬å®¶å…¬å¸
香港å…åˆå½©
Ddo plat
Ddo plat
FFXI Gil
FFXI Gil
GW Gold
GW Gold
GW Power Leveling
GW Power Leveling
RS Gold
RS Gold
RS Power Leveling
RS Power Leveling
Lotro Gold
Lotro Gold
Lotro Power leveling
Lotro Power leveling
china tour
china tour
猎头
猎头
è´§æž¶
è´§æž¶
è´§æž¶
google排å
google排å
翻译公å¸
翻译公å¸
上海翻译公å¸
上海翻译公å¸
北京翻译公å¸
北京翻译公å¸
仓库
仓库
仓库出租
仓库出租
物æµå›åŒº
物æµå›åŒº
监控
监控
æ¿€å…‰æ‰“æ ‡æœº
软件工程硕士
工程地毯
工程地毯
集团电è¯
集团电è¯
æ¿€å…‰æ‰“æ ‡æœº
æ¿€å…‰æ‰“æ ‡æœº
打包机
打包机
拓展è®ç»ƒ
拓展
拓展培è®
香港å…åˆå½©
æ¬å®¶å…¬å¸
æ¬å®¶å…¬å¸
窃å¬å™¨
houyuping 07年7月11日
google排å
google排å
wow gold
wow gold
powerleveling
powerleveling
wow powerleveling
wow powerleveling
wow power leveling
wow power leveling
power leveling
power leveling
wow power level
wow power level
Ddo plat
Ddo plat
FFXI Gil
FFXI Gil
GW Gold
GW Gold
GW Power Leveling
GW Power Leveling
RS Gold
RS Gold
RS Power Leveling
RS Power Leveling
Lotro Gold
Lotro Gold
Lotro Power leveling
Lotro Power leveling
翻译公å¸
翻译公å¸
上海翻译公å¸
上海翻译公å¸
北京翻译公å¸
北京翻译公å¸
监控
è´§æž¶
è´§æž¶
è´§æž¶
涂层测厚仪
涂层测厚仪
翻译公å¸
仓库
仓库
仓库出租
仓库出租
物æµå›åŒº
物æµå›åŒº
红外测温仪
红外测温仪
超声波测厚仪
超声波测厚仪
超声波探伤仪
超声波探伤仪
频闪仪
频闪仪
涂层测厚仪
涂层测厚仪
电ç«èŠ±æ£€æµ‹ä»ª
电ç«èŠ±æ£€æµ‹ä»ª
google排å
é—¨ç¦
é—¨ç¦
é—¨ç¦ç³»ç»Ÿ
é—¨ç¦ç³»ç»Ÿ
æ¬å®¶
æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
光盘制作
光盘å°åˆ·
光盘å°åˆ·
æ¬å®¶å…¬å¸
æ¿€å…‰æ‰“æ ‡æœº
æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
hongkong hotel
hongkong hotel
beijing tour
beijing tour
集团电è¯
集团电è¯
wow power leveling
wow power leveling
wow powerleveling
wow powerleveling
wow power level
wow power level
china tour
china tour
é’æ˜¥ç—˜
é’æ˜¥ç—˜
摆闸
痤疮
痤疮
色斑
色斑
é»„è¤æ–‘
é»„è¤æ–‘
é’æ˜¥ç—˜
é’æ˜¥ç—˜
å£è…”医生
å£è…”医生
å£è…”
å£è…”
å£è…”医院
å£è…”医院
å£è…”ç§‘
å£è…”ç§‘
ä¸‰æ˜Ÿé›†å›¢ç”µè¯æœº
呼å«ä¸å¿ƒ
电è¯äº¤æ¢æœº
äº¤æ¢æœº
呼å«ä¸å¿ƒ
测厚仪
测温仪
åœè½¦åœº
é“é—¸
liying 07年7月18日
google排å
google排å
wow gold
wow gold
wow gold
wow gold
powerleveling
powerleveling
wow power leveling
wow power leveling
wow powerleveling
wow powerleveling
world of warcraft powerleveling
world of warcraft powerleveling
world of warcraft power leveling
world of warcraft power leveling
hongkong hotel
hongkong hotel
beijing tour
beijing tour
翻译公å¸
翻译公å¸
上海翻译公å¸
上海翻译公å¸
é—¨ç¦
北京翻译公å¸
北京翻译公å¸
google排å
超声波探伤仪
超声波探伤仪
物æµå›åŒº
物æµå›åŒº
æ¬å®¶å…¬å¸
æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
æ¬å®¶
æ¬å®¶å…¬å¸
æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
beijing
beijing
china tour
china tour
great wall
beijing travel
beijing travel
china tour
china tour
网站设计
多媒体
è´§æž¶
è´§æž¶
è´§æž¶
光盘刻录
光盘刻录
光盘制作
光盘制作
光盘å°åˆ·
光盘å°åˆ·
摆闸
痤疮
痤疮
色斑
色斑
é»„è¤æ–‘
é»„è¤æ–‘
é’æ˜¥ç—˜
é’æ˜¥ç—˜
å£è…”医生
å£è…”医生
å£è…”
å£è…”
å£è…”医院
å£è…”医院
å£è…”ç§‘
å£è…”ç§‘
ä¸‰æ˜Ÿé›†å›¢ç”µè¯æœº
呼å«ä¸å¿ƒ
电è¯äº¤æ¢æœº
äº¤æ¢æœº
呼å«ä¸å¿ƒ
测厚仪
测温仪
åœè½¦åœº
é“é—¸
wanyamin 07年7月19日
wow gold
wow gold
powerleveling
powerleveling
wow power leveling
wow power leveling
wow powerleveling
wow powerleveling
world of warcraft powerleveling
world of warcraft powerleveling
world of warcraft power leveling
world of warcraft power leveling
cheap wow powerleveling
cheap wow powerleveling
cheap wow power leveling
cheap wow power leveling
beijing tour
beijing tour
beijing
beijing
china tour
china tour
great wall
beijing travel
beijing travel
网站设计
网站设计
多媒体
光盘制作
光盘å°åˆ·
光盘å°åˆ·
超声波探伤仪
超声波探伤仪
频闪仪
频闪仪
涂层测厚仪
涂层测厚仪
电ç«èŠ±æ£€æµ‹ä»ª
电ç«èŠ±æ£€æµ‹ä»ª
æ¬å®¶å…¬å¸
æ¬å®¶å…¬å¸
北京æ¬å®¶å…¬å¸
google排å
wow gold
翻译公å¸
翻译公å¸
上海翻译公å¸
上海翻译公å¸
北京翻译公å¸
北京翻译公å¸
è´§æž¶
è´§æž¶
è´§æž¶
猎头
猎头
软件测试工程师
软件测试工程师
软件测试
软件测试
软件测试培è®
软件测试培è®
仓库
仓库
仓库出租
仓库出租
物æµå›åŒº
物æµå›åŒº
痤疮
痤疮
色斑
色斑
é»„è¤æ–‘
é»„è¤æ–‘
é’æ˜¥ç—˜
é’æ˜¥ç—˜
ä¸‰æ˜Ÿé›†å›¢ç”µè¯æœº
呼å«ä¸å¿ƒ
电è¯äº¤æ¢æœº
äº¤æ¢æœº
呼å«ä¸å¿ƒ
测厚仪
测温仪
cheap Silkroad gold
cheap Silkroad gold
Silkroad gold
Silkroad gold
Silkroad Online gold
Silkroad Online gold
sro gold
sro gold
Archlord gold
Archlord gold
cheap Archlord gold
cheap Archlord gold
Archlord Online gold
Archlord Online gold
buy cheap Archlord gold
buy cheap Archlord gold
Dofus kamas
Dofus kamas
cheap Dofus kamas
cheap Dofus kamas
Dofus gold
Dofus gold
Dofus money
Dofus money
Rappelz Rupees
Rappelz Rupees
Rappelz gold
Rappelz gold
cheap Rappelz Rupees
cheap Rappelz Rupees
Comments on this entry are closed.