brendan_oconnor_ai brendan_oconnor_ai-2009 brendan_oconnor_ai-2009-144 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: It is rather surprising that systematic studies of human abilities were not undertaken until the second half of the last century… An accurate method was available for measuring the circumference of the earth 2,000 years before the first systematic measures of human ability were developed. –Jum Nunnally, Psychometric Theory (1967) (Social science textbooks from the 60′s and 70′s are rad.)
sentIndex sentText sentNum sentScore
1 It is rather surprising that systematic studies of human abilities were not undertaken until the second half of the last century… An accurate method was available for measuring the circumference of the earth 2,000 years before the first systematic measures of human ability were developed. [sent-1, score-4.368]
2 –Jum Nunnally, Psychometric Theory (1967) (Social science textbooks from the 60′s and 70′s are rad. [sent-2, score-0.342]
wordName wordTfidf (topN-words)
[('systematic', 0.48), ('abilities', 0.263), ('earth', 0.263), ('accurate', 0.24), ('textbooks', 0.24), ('human', 0.226), ('ability', 0.211), ('surprising', 0.211), ('measures', 0.211), ('measuring', 0.211), ('method', 0.211), ('half', 0.192), ('century', 0.192), ('studies', 0.184), ('available', 0.172), ('second', 0.141), ('years', 0.135), ('theory', 0.119), ('rather', 0.117), ('last', 0.107), ('science', 0.102), ('social', 0.094), ('first', 0.087)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 144 brendan oconnor ai-2009-06-14-Psychometrics quote
Introduction: It is rather surprising that systematic studies of human abilities were not undertaken until the second half of the last century… An accurate method was available for measuring the circumference of the earth 2,000 years before the first systematic measures of human ability were developed. –Jum Nunnally, Psychometric Theory (1967) (Social science textbooks from the 60′s and 70′s are rad.)
2 0.094984822 187 brendan oconnor ai-2012-09-21-CMU ARK Twitter Part-of-Speech Tagger – v0.3 released
Introduction: We’re pleased to announce a new release of the CMU ARK Twitter Part-of-Speech Tagger, version 0.3. The new version is much faster (40x) and more accurate (89.2 -> 92.8) than before. We also have released new POS-annotated data, including a dataset of one tweet for each of 547 days. We have made available large-scale word clusters from unlabeled Twitter data (217k words, 56m tweets, 847m tokens). Tools, data, and a new technical report describing the release are available at: www.ark.cs.cmu.edu/TweetNLP . 0100100 a 1111100101110 111100000011 , Brendan
3 0.083756231 176 brendan oconnor ai-2011-10-05-Be careful with dictionary-based text analysis
Introduction: OK, everyone loves to run dictionary methods for sentiment and other text analysis — counting words from a predefined lexicon in a big corpus, in order to explore or test hypotheses about the corpus. In particular, this is often done for sentiment analysis: count positive and negative words (according to a sentiment polarity lexicon, which was derived from human raters or previous researchers’ intuitions), and then proclaim the output yields sentiment levels of the documents. More and more papers come out every day that do this. I’ve done this myself. It’s interesting and fun, but it’s easy to get a bunch of meaningless numbers if you don’t carefully validate what’s going on. There are certainly good studies in this area that do further validation and analysis, but it’s hard to trust a study that just presents a graph with a few overly strong speculative claims as to its meaning. This happens more than it ought to. I was happy to see a similarly critical view in a nice workin
Introduction: I was planning to write some WordNet lookup code tonight. But instead I’ve learned of too many intersecting things. First, there are a zillion things to do this weekend ( hooray flavorpill ): Picasso and American Art exhibit continuing at SFMOMA . I saw it very briefly last weekend but want some more. And Doug claims there’s an interesting photography exhibit there too. Reading from We Don’t Need Another Wave: Dispatches from the Next Generation of Feminists , a fascinating looking book I’ve seen many times in the bookstores around here. By that I mean at least Modern Times (the neat Mission bookstore) and the Anarchist Collective Bookstore (out on the Haight). And the reading is at Modern Times, just down the street from my house! Amazing. Tomorrow at 7:30. Since anarchists were just mentioned, fortuitously there also appears: the Bay Area Anarchist Bookfair this Saturday and Sunday! Speakers and books down by Golden Gate Park, oh my. Can’t say I’m a ra
5 0.067036018 31 brendan oconnor ai-2006-03-18-Mark Turner: Toward the Founding of Cognitive Social Science
Introduction: Where is social science? Where should it go? How should it get there? My answer, in a nutshell, is that social science is headed for an alliance with cognitive science. Mark Turner, 2001, Chronicle of Higher Education
6 0.060831368 118 brendan oconnor ai-2008-10-12-The Universal Declaration of Human Rights Animated
7 0.059398077 1 brendan oconnor ai-2004-11-20-gintis: theoretical unity in the social sciences
8 0.058063082 84 brendan oconnor ai-2007-11-26-How did Freud become a respected humanist?!
9 0.05484879 2 brendan oconnor ai-2004-11-24-addiction & 2 problems of economics
10 0.054489851 162 brendan oconnor ai-2010-11-09-Greenspan on the Daily Show
11 0.053103887 179 brendan oconnor ai-2012-02-02-Histograms — matplotlib vs. R
12 0.050946623 10 brendan oconnor ai-2005-06-26-monkey economics (and brothels)
13 0.050454207 130 brendan oconnor ai-2008-12-18-Information cost and genocide
14 0.048701055 32 brendan oconnor ai-2006-03-26-new kind of science, for real
15 0.043997481 81 brendan oconnor ai-2007-11-13-Authoritarian great power capitalism
16 0.043851417 172 brendan oconnor ai-2011-06-26-Good linguistic semantics textbook?
17 0.043103948 142 brendan oconnor ai-2009-05-27-Where tweets get sent from
18 0.040056035 39 brendan oconnor ai-2006-06-03-Rock, Paper, Scissors
19 0.038959607 63 brendan oconnor ai-2007-06-10-Freak-Freakonomics (Ariel Rubinstein is the shit!)
20 0.037611965 82 brendan oconnor ai-2007-11-14-Pop cog neuro is so sigh
topicId topicWeight
[(0, -0.104), (1, 0.098), (2, -0.074), (3, 0.02), (4, 0.01), (5, -0.06), (6, 0.003), (7, -0.033), (8, -0.068), (9, 0.096), (10, 0.045), (11, 0.009), (12, -0.04), (13, 0.042), (14, 0.041), (15, 0.046), (16, -0.041), (17, -0.02), (18, -0.165), (19, -0.007), (20, 0.003), (21, 0.034), (22, -0.107), (23, -0.081), (24, -0.015), (25, 0.01), (26, -0.014), (27, -0.112), (28, -0.042), (29, 0.043), (30, -0.044), (31, -0.061), (32, -0.026), (33, -0.176), (34, -0.099), (35, -0.011), (36, 0.067), (37, 0.04), (38, -0.089), (39, 0.163), (40, 0.009), (41, 0.094), (42, 0.181), (43, -0.002), (44, -0.062), (45, -0.053), (46, -0.011), (47, 0.103), (48, -0.038), (49, -0.026)]
simIndex simValue blogId blogTitle
same-blog 1 0.99154067 144 brendan oconnor ai-2009-06-14-Psychometrics quote
Introduction: It is rather surprising that systematic studies of human abilities were not undertaken until the second half of the last century… An accurate method was available for measuring the circumference of the earth 2,000 years before the first systematic measures of human ability were developed. –Jum Nunnally, Psychometric Theory (1967) (Social science textbooks from the 60′s and 70′s are rad.)
2 0.54484862 118 brendan oconnor ai-2008-10-12-The Universal Declaration of Human Rights Animated
Introduction: Link: The Universal Declaration of Human Rights Animated .
3 0.50850874 3 brendan oconnor ai-2004-12-02-go science
Introduction: Is social science even worth doing when things like this get funded with hundreds of millions of federal dollars? Many American youngsters participating in federally funded abstinence-only programs have been taught over the past three years that abortion can lead to sterility and suicide, that half the gay male teenagers in the United States have tested positive for the AIDS virus, and that touching a person’s genitals “can result in pregnancy,” a congressional staff analysis has found. … Among the misconceptions cited by Waxman’s investigators: • A 43-day-old fetus is a “thinking person.” • HIV, the virus that causes AIDS, can be spread via sweat and tears. • Condoms fail to prevent HIV transmission as often as 31 percent of the time in heterosexual intercourse. … When used properly and consistently, condoms fail to prevent pregnancy and sexually transmitted diseases (STDs) less than 3 percent of the time, federal researchers say, and it is not known how many gay teena
4 0.46642798 176 brendan oconnor ai-2011-10-05-Be careful with dictionary-based text analysis
Introduction: OK, everyone loves to run dictionary methods for sentiment and other text analysis — counting words from a predefined lexicon in a big corpus, in order to explore or test hypotheses about the corpus. In particular, this is often done for sentiment analysis: count positive and negative words (according to a sentiment polarity lexicon, which was derived from human raters or previous researchers’ intuitions), and then proclaim the output yields sentiment levels of the documents. More and more papers come out every day that do this. I’ve done this myself. It’s interesting and fun, but it’s easy to get a bunch of meaningless numbers if you don’t carefully validate what’s going on. There are certainly good studies in this area that do further validation and analysis, but it’s hard to trust a study that just presents a graph with a few overly strong speculative claims as to its meaning. This happens more than it ought to. I was happy to see a similarly critical view in a nice workin
5 0.38613191 1 brendan oconnor ai-2004-11-20-gintis: theoretical unity in the social sciences
Introduction: Herbert Gintis thinks it’s time to unify the behavioral sciences. Sociology, economics, political science, human biology, anthropology and others all study the same thing, but each is based on different incompatible models of individual human behavior. There seems to be evidence that new developments have the potential to offer a more unifying theory. Evolutionary biology should be the basis of understanding much of human behavior. Rational choice and game theoretic frameworks are finding greater acceptance beyond economics; in the meantime, other fields need to absorb sociology’s emphasis on socialization — that people do things or understand the world in a way taught by society. The human behavioral sciences are still rife with many smaller inconsistencies; for example, according to Gintis, only anthropolgists look at the influence of culture across groups, but only sociologists look at culture within groups. Gintis’ ultimate goal is to have a common baseline from which each disci
6 0.38596493 31 brendan oconnor ai-2006-03-18-Mark Turner: Toward the Founding of Cognitive Social Science
7 0.353719 15 brendan oconnor ai-2005-07-04-freakonomics blog
8 0.35130888 22 brendan oconnor ai-2005-07-31-war death statistics
10 0.34468848 2 brendan oconnor ai-2004-11-24-addiction & 2 problems of economics
11 0.3316403 130 brendan oconnor ai-2008-12-18-Information cost and genocide
12 0.30611721 84 brendan oconnor ai-2007-11-26-How did Freud become a respected humanist?!
13 0.30371091 162 brendan oconnor ai-2010-11-09-Greenspan on the Daily Show
14 0.2983487 32 brendan oconnor ai-2006-03-26-new kind of science, for real
15 0.29563248 94 brendan oconnor ai-2008-03-10-PHD Comics: Humanities vs. Social Sciences
16 0.28123909 131 brendan oconnor ai-2008-12-27-Facebook sentiment mining predicts presidential polls
17 0.27260977 104 brendan oconnor ai-2008-05-23-Sub-reddit for Systems Science and OR
18 0.2585569 75 brendan oconnor ai-2007-08-13-It’s all in a name: "Kingdom of Norway" vs. "Democratic People’s Republic of Korea"
19 0.2495624 26 brendan oconnor ai-2005-09-02-cognitive modelling is rational choice++
20 0.24724567 151 brendan oconnor ai-2009-08-12-Beautiful Data book chapter
topicId topicWeight
[(39, 0.568), (44, 0.054), (74, 0.199)]
simIndex simValue blogId blogTitle
same-blog 1 0.97917587 144 brendan oconnor ai-2009-06-14-Psychometrics quote
Introduction: It is rather surprising that systematic studies of human abilities were not undertaken until the second half of the last century… An accurate method was available for measuring the circumference of the earth 2,000 years before the first systematic measures of human ability were developed. –Jum Nunnally, Psychometric Theory (1967) (Social science textbooks from the 60′s and 70′s are rad.)
2 0.34095994 123 brendan oconnor ai-2008-11-12-Disease tracking with web queries and social messaging (Google, Twitter, Facebook…)
Introduction: This is a good idea: in a search engine’s query logs, look for outbreaks of queries like [[flu symptoms]] in a given region. I’ve heard (from Roddy ) that this trick also works well on Facebook statuses (e.g. “Feeling crappy this morning, think I just got the flu”). Google Uses Web Searches to Track Flu’s Spread – NYTimes.com Google Flu Trends – google.org For an example with a publicly available data feed, these queries works decently well on Twitter search: [[ flu -shot -google ]] (high recall) [[ "muscle aches" flu -shot ]] (high precision) The “muscle aches” query is too sparse and the general query is too noisy, but you could imagine some more tricks to clean it up, then train a classifier, etc. With a bit more work it looks like geolocation information can be had out of the Twitter search API .
3 0.33813891 63 brendan oconnor ai-2007-06-10-Freak-Freakonomics (Ariel Rubinstein is the shit!)
Introduction: I don’t care how lame anyone thinks this is, but economic theorist Ariel Rubinstein is the shit. He’s funny, self-deprecating, and brilliant. I was just re-reading his delightful, sarcastic review of Freakonomics . (Overly dramatized visual depiction below; hey, conflict sells.) The review consists of excerpts from his own upcoming super-worldwide-bestseller, “Freak-Freakonomics”. It is full of golden quotes such as: Chapter 2: Why do economists earn more than mathematicians? … The comparison between architects and prostitutes can be applied to mathematicians and economists: The former are more skilled, highly educated and intelligent. To elaborate: Levitt has never encountered a girl who dreams of being a prostitute and I have never met a child who dreams of being an economist. Like prostitutes, the skill required of economists is “not necessarily ‘specialized’” (106). And, finally, here is a new explanation for the salary gap between mathematicians and eco
4 0.33798358 26 brendan oconnor ai-2005-09-02-cognitive modelling is rational choice++
Introduction: Rational choice has been a huge imperialistic success, growing in popularity and being applied to more and more fields. Why is this? It’s not because the rational choice model of decision-making is particularly realistic. Rather, it’s because rational choice is a completely specified theory of human behavior , and therefore is great at generating hypotheses. Given any situation involving people, rational choice can be used to generate a hypothesis about what to expect. That is, you just ask, “What would a person do to maximize their own benefit?” Similar things have been said about evolutionary psychology: you can always predict behavior by asking “what would hunter-gatherers do?” Now, certainly both rational choice and evolutionary psychology don’t always generate correct hypotheses, but they’re incredibly useful because they at least give you a starting point. Witness the theory of bounded rationality: just like rational choice, except amended to consider computational l
5 0.33783475 105 brendan oconnor ai-2008-06-05-Clinton-Obama support visualization
Introduction: This interactive histogram is brilliant. The NYT data visualization folks never fail to impress. margins.swf (application/x-shockwave-flash Object)
6 0.33765432 203 brendan oconnor ai-2014-02-19-What the ACL-2014 review scores mean
7 0.33676475 77 brendan oconnor ai-2007-09-15-Dollar auction
8 0.3348881 19 brendan oconnor ai-2005-07-09-the psychology of design as explanation
9 0.32919925 152 brendan oconnor ai-2009-09-08-Another R flashmob today
10 0.28774035 138 brendan oconnor ai-2009-04-17-1 billion web page dataset from CMU
11 0.27920091 86 brendan oconnor ai-2007-12-20-Data-driven charity
13 0.26784799 84 brendan oconnor ai-2007-11-26-How did Freud become a respected humanist?!
14 0.26083323 6 brendan oconnor ai-2005-06-25-idea: Morals are heuristics for socially optimal behavior
15 0.25761935 130 brendan oconnor ai-2008-12-18-Information cost and genocide
16 0.25702843 80 brendan oconnor ai-2007-10-31-neo institutional economic fun!
17 0.25681642 188 brendan oconnor ai-2012-10-02-Powerset’s natural language search system
18 0.25298136 129 brendan oconnor ai-2008-12-03-Statistics vs. Machine Learning, fight!
19 0.25205076 179 brendan oconnor ai-2012-02-02-Histograms — matplotlib vs. R
20 0.24452347 125 brendan oconnor ai-2008-11-21-Netflix Prize