hunch_net hunch_net-2005 hunch_net-2005-110 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This is about the hard choices that graduate students must make. The cultural definition of success in academic research is to: Produce good research which many other people appreciate. Produce many students who go on to do the same. There are fundamental reasons why this is success in the local culture. Good research appreciated by others means access to jobs. Many students succesful in the same way implies that there are a number of people who think in a similar way and appreciate your work. In order to graduate, a phd student must live in an academic culture for a period of several years. It is common to adopt the culture’s definition of success during this time. It’s also common for many phd students discover they are not suited to an academic research lifestyle. This collision of values and abilities naturally results in depression. The most fundamental advice when this happens is: change something. Pick a new advisor. Pick a new research topic. Or leave th
sentIndex sentText sentNum sentScore
1 This is about the hard choices that graduate students must make. [sent-1, score-0.637]
2 The cultural definition of success in academic research is to: Produce good research which many other people appreciate. [sent-2, score-1.139]
3 Produce many students who go on to do the same. [sent-3, score-0.326]
4 There are fundamental reasons why this is success in the local culture. [sent-4, score-0.282]
5 Good research appreciated by others means access to jobs. [sent-5, score-0.264]
6 Many students succesful in the same way implies that there are a number of people who think in a similar way and appreciate your work. [sent-6, score-0.404]
7 In order to graduate, a phd student must live in an academic culture for a period of several years. [sent-7, score-1.256]
8 It is common to adopt the culture’s definition of success during this time. [sent-8, score-0.578]
9 It’s also common for many phd students discover they are not suited to an academic research lifestyle. [sent-9, score-1.394]
10 This collision of values and abilities naturally results in depression. [sent-10, score-0.321]
11 The most fundamental advice when this happens is: change something. [sent-11, score-0.18]
12 Or leave the program (and do something else with your life). [sent-14, score-0.343]
13 The first two are relatively easy, but “Do something else with your life” is a hard choice for a phd student to make because they are immersed in and adopt a value system that does not value that choice. [sent-15, score-1.49]
14 Remember here that the academic value system is not a universal value system. [sent-16, score-0.941]
15 For example, many people want to do something that is immediately constructive and find this at odds with academic research (which is almost defined by “not immediate”). [sent-17, score-0.944]
16 The world is big enough and diverse enough to support multiple value systems. [sent-18, score-0.476]
17 A number of my friends made this decision and went to google or investment banking places where they are deliriously happier (and more productive) than in their former lives. [sent-20, score-0.353]
wordName wordTfidf (topN-words)
[('academic', 0.341), ('phd', 0.294), ('students', 0.252), ('value', 0.217), ('culture', 0.214), ('adopt', 0.204), ('success', 0.177), ('life', 0.162), ('research', 0.162), ('graduate', 0.159), ('else', 0.145), ('pick', 0.145), ('student', 0.141), ('produce', 0.136), ('definition', 0.125), ('abilities', 0.123), ('collision', 0.123), ('productive', 0.123), ('suited', 0.123), ('something', 0.113), ('investment', 0.107), ('fundamental', 0.105), ('appreciated', 0.102), ('live', 0.098), ('cultural', 0.098), ('lives', 0.095), ('odds', 0.092), ('period', 0.092), ('enough', 0.092), ('friends', 0.089), ('universal', 0.087), ('constructive', 0.087), ('leave', 0.085), ('immediate', 0.083), ('went', 0.083), ('hard', 0.08), ('system', 0.079), ('succesful', 0.078), ('discover', 0.076), ('remember', 0.076), ('must', 0.076), ('immediately', 0.075), ('advice', 0.075), ('diverse', 0.075), ('values', 0.075), ('many', 0.074), ('places', 0.074), ('appreciate', 0.074), ('common', 0.072), ('choices', 0.07)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 110 hunch net-2005-09-10-“Failure” is an option
Introduction: This is about the hard choices that graduate students must make. The cultural definition of success in academic research is to: Produce good research which many other people appreciate. Produce many students who go on to do the same. There are fundamental reasons why this is success in the local culture. Good research appreciated by others means access to jobs. Many students succesful in the same way implies that there are a number of people who think in a similar way and appreciate your work. In order to graduate, a phd student must live in an academic culture for a period of several years. It is common to adopt the culture’s definition of success during this time. It’s also common for many phd students discover they are not suited to an academic research lifestyle. This collision of values and abilities naturally results in depression. The most fundamental advice when this happens is: change something. Pick a new advisor. Pick a new research topic. Or leave th
2 0.26350969 73 hunch net-2005-05-17-A Short Guide to PhD Graduate Study
Introduction: Graduate study is a mysterious and uncertain process. This easiest way to see this is by noting that a very old advisor/student mechanism is preferred. There is no known succesful mechanism for “mass producing” PhDs as is done (in some sense) for undergraduate and masters study. Here are a few hints that might be useful to prospective or current students based on my own experience. Masters or PhD (a) You want a PhD if you want to do research. (b) You want a masters if you want to make money. People wanting (b) will be manifestly unhappy with (a) because it typically means years of low pay. People wanting (a) should try to avoid (b) because it prolongs an already long process. Attitude . Many students struggle for awhile with the wrong attitude towards research. Most students come into graduate school with 16-19 years of schooling where the principle means of success is proving that you know something via assignments, tests, etc… Research does not work this way. Re
3 0.18836804 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
Introduction: How do you create an optimal environment for research? Here are some essential ingredients that I see. Stability . University-based research is relatively good at this. On any particular day, researchers face choices in what they will work on. A very common tradeoff is between: easy small difficult big For researchers without stability, the ‘easy small’ option wins. This is often “ok”—a series of incremental improvements on the state of the art can add up to something very beneficial. However, it misses one of the big potentials of research: finding entirely new and better ways of doing things. Stability comes in many forms. The prototypical example is tenure at a university—a tenured professor is almost imposssible to fire which means that the professor has the freedom to consider far horizon activities. An iron-clad guarantee of a paycheck is not necessary—industrial research labs have succeeded well with research positions of indefinite duration. Atnt rese
4 0.14931008 339 hunch net-2009-01-27-Key Scientific Challenges
Introduction: Yahoo released the Key Scientific Challenges program. There is a Machine Learning list I worked on and a Statistics list which Deepak worked on. I’m hoping this is taken quite seriously by graduate students. The primary value, is that it gave us a chance to sit down and publicly specify directions of research which would be valuable to make progress on. A good strategy for a beginning graduate student is to pick one of these directions, pursue it, and make substantial advances for a PhD. The directions are sufficiently general that I’m sure any serious advance has applications well beyond Yahoo. A secondary point, (which I’m sure is primary for many ) is that there is money for graduate students here. It’s unrestricted, so you can use it for any reasonable travel, supplies, etc…
5 0.12850007 48 hunch net-2005-03-29-Academic Mechanism Design
Introduction: From game theory, there is a notion of “mechanism design”: setting up the structure of the world so that participants have some incentive to do sane things (rather than obviously counterproductive things). Application of this principle to academic research may be fruitful. What is misdesigned about academic research? The JMLG guides give many hints. The common nature of bad reviewing also suggests the system isn’t working optimally. There are many ways to experimentally “cheat” in machine learning . Funding Prisoner’s Delimma. Good researchers often write grant proposals for funding rather than doing research. Since the pool of grant money is finite, this means that grant proposals are often rejected, implying that more must be written. This is essentially a “prisoner’s delimma”: anyone not writing grant proposals loses, but the entire process of doing research is slowed by distraction. If everyone wrote 1/2 as many grant proposals, roughly the same distribution
6 0.11697985 22 hunch net-2005-02-18-What it means to do research.
7 0.11672579 290 hunch net-2008-02-27-The Stats Handicap
8 0.1142187 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
9 0.11416535 449 hunch net-2011-11-26-Giving Thanks
10 0.11319859 121 hunch net-2005-10-12-The unrealized potential of the research lab
11 0.11128455 42 hunch net-2005-03-17-Going all the Way, Sometimes
12 0.1104573 378 hunch net-2009-11-15-The Other Online Learning
13 0.10765611 106 hunch net-2005-09-04-Science in the Government
14 0.10708859 445 hunch net-2011-09-28-Somebody’s Eating Your Lunch
15 0.099969596 344 hunch net-2009-02-22-Effective Research Funding
16 0.09931428 174 hunch net-2006-04-27-Conferences, Workshops, and Tutorials
17 0.096995674 225 hunch net-2007-01-02-Retrospective
18 0.095153965 454 hunch net-2012-01-30-ICML Posters and Scope
19 0.094848968 98 hunch net-2005-07-27-Not goal metrics
20 0.092773467 320 hunch net-2008-10-14-Who is Responsible for a Bad Review?
topicId topicWeight
[(0, 0.195), (1, -0.052), (2, -0.09), (3, 0.154), (4, -0.148), (5, -0.037), (6, 0.025), (7, 0.078), (8, -0.039), (9, 0.056), (10, 0.082), (11, 0.003), (12, 0.01), (13, -0.036), (14, 0.07), (15, 0.067), (16, -0.022), (17, 0.055), (18, 0.018), (19, 0.007), (20, 0.019), (21, 0.017), (22, 0.099), (23, -0.022), (24, 0.057), (25, 0.003), (26, 0.024), (27, -0.119), (28, 0.009), (29, -0.061), (30, -0.054), (31, 0.016), (32, -0.04), (33, 0.083), (34, -0.003), (35, -0.001), (36, 0.009), (37, -0.003), (38, 0.041), (39, 0.053), (40, -0.033), (41, 0.036), (42, 0.081), (43, -0.075), (44, -0.012), (45, 0.039), (46, -0.052), (47, -0.062), (48, -0.035), (49, 0.004)]
simIndex simValue blogId blogTitle
same-blog 1 0.96816158 110 hunch net-2005-09-10-“Failure” is an option
Introduction: This is about the hard choices that graduate students must make. The cultural definition of success in academic research is to: Produce good research which many other people appreciate. Produce many students who go on to do the same. There are fundamental reasons why this is success in the local culture. Good research appreciated by others means access to jobs. Many students succesful in the same way implies that there are a number of people who think in a similar way and appreciate your work. In order to graduate, a phd student must live in an academic culture for a period of several years. It is common to adopt the culture’s definition of success during this time. It’s also common for many phd students discover they are not suited to an academic research lifestyle. This collision of values and abilities naturally results in depression. The most fundamental advice when this happens is: change something. Pick a new advisor. Pick a new research topic. Or leave th
2 0.88758087 73 hunch net-2005-05-17-A Short Guide to PhD Graduate Study
Introduction: Graduate study is a mysterious and uncertain process. This easiest way to see this is by noting that a very old advisor/student mechanism is preferred. There is no known succesful mechanism for “mass producing” PhDs as is done (in some sense) for undergraduate and masters study. Here are a few hints that might be useful to prospective or current students based on my own experience. Masters or PhD (a) You want a PhD if you want to do research. (b) You want a masters if you want to make money. People wanting (b) will be manifestly unhappy with (a) because it typically means years of low pay. People wanting (a) should try to avoid (b) because it prolongs an already long process. Attitude . Many students struggle for awhile with the wrong attitude towards research. Most students come into graduate school with 16-19 years of schooling where the principle means of success is proving that you know something via assignments, tests, etc… Research does not work this way. Re
3 0.72158498 339 hunch net-2009-01-27-Key Scientific Challenges
Introduction: Yahoo released the Key Scientific Challenges program. There is a Machine Learning list I worked on and a Statistics list which Deepak worked on. I’m hoping this is taken quite seriously by graduate students. The primary value, is that it gave us a chance to sit down and publicly specify directions of research which would be valuable to make progress on. A good strategy for a beginning graduate student is to pick one of these directions, pursue it, and make substantial advances for a PhD. The directions are sufficiently general that I’m sure any serious advance has applications well beyond Yahoo. A secondary point, (which I’m sure is primary for many ) is that there is money for graduate students here. It’s unrestricted, so you can use it for any reasonable travel, supplies, etc…
4 0.71832317 449 hunch net-2011-11-26-Giving Thanks
Introduction: Thanksgiving is perhaps my favorite holiday, because pausing your life and giving thanks provides a needed moment of perspective. As a researcher, I am most thankful for my education, without which I could not function. I want to share this, because it provides some sense of how a researcher starts. My long term memory seems to function particularly well, which makes any education I get is particularly useful. I am naturally obsessive, which makes me chase down details until I fully understand things. Natural obsessiveness can go wrong, of course, but it’s a great ally when you absolutely must get things right. My childhood was all in one hometown, which was a conscious sacrifice on the part of my father, implying disruptions from moving around were eliminated. I’m not sure how important this was since travel has it’s own benefits, but it bears thought. I had several great teachers in grade school, and naturally gravitated towards teachers over classmates, as they seemed
5 0.71176463 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
Introduction: How do you create an optimal environment for research? Here are some essential ingredients that I see. Stability . University-based research is relatively good at this. On any particular day, researchers face choices in what they will work on. A very common tradeoff is between: easy small difficult big For researchers without stability, the ‘easy small’ option wins. This is often “ok”—a series of incremental improvements on the state of the art can add up to something very beneficial. However, it misses one of the big potentials of research: finding entirely new and better ways of doing things. Stability comes in many forms. The prototypical example is tenure at a university—a tenured professor is almost imposssible to fire which means that the professor has the freedom to consider far horizon activities. An iron-clad guarantee of a paycheck is not necessary—industrial research labs have succeeded well with research positions of indefinite duration. Atnt rese
6 0.66394579 48 hunch net-2005-03-29-Academic Mechanism Design
7 0.63663471 290 hunch net-2008-02-27-The Stats Handicap
8 0.63286364 344 hunch net-2009-02-22-Effective Research Funding
9 0.60909933 255 hunch net-2007-07-13-The View From China
10 0.59979731 121 hunch net-2005-10-12-The unrealized potential of the research lab
11 0.59598845 445 hunch net-2011-09-28-Somebody’s Eating Your Lunch
12 0.59452021 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
13 0.59289318 464 hunch net-2012-05-03-Microsoft Research, New York City
14 0.59057724 162 hunch net-2006-03-09-Use of Notation
15 0.58836204 241 hunch net-2007-04-28-The Coming Patent Apocalypse
16 0.58691972 22 hunch net-2005-02-18-What it means to do research.
17 0.58608484 76 hunch net-2005-05-29-Bad ideas
18 0.57945162 358 hunch net-2009-06-01-Multitask Poisoning
19 0.57935309 142 hunch net-2005-12-22-Yes , I am applying
20 0.57752848 195 hunch net-2006-07-12-Who is having visa problems reaching US conferences?
topicId topicWeight
[(27, 0.202), (38, 0.047), (55, 0.133), (68, 0.323), (94, 0.111), (95, 0.08)]
simIndex simValue blogId blogTitle
1 0.9130671 48 hunch net-2005-03-29-Academic Mechanism Design
Introduction: From game theory, there is a notion of “mechanism design”: setting up the structure of the world so that participants have some incentive to do sane things (rather than obviously counterproductive things). Application of this principle to academic research may be fruitful. What is misdesigned about academic research? The JMLG guides give many hints. The common nature of bad reviewing also suggests the system isn’t working optimally. There are many ways to experimentally “cheat” in machine learning . Funding Prisoner’s Delimma. Good researchers often write grant proposals for funding rather than doing research. Since the pool of grant money is finite, this means that grant proposals are often rejected, implying that more must be written. This is essentially a “prisoner’s delimma”: anyone not writing grant proposals loses, but the entire process of doing research is slowed by distraction. If everyone wrote 1/2 as many grant proposals, roughly the same distribution
same-blog 2 0.88917977 110 hunch net-2005-09-10-“Failure” is an option
Introduction: This is about the hard choices that graduate students must make. The cultural definition of success in academic research is to: Produce good research which many other people appreciate. Produce many students who go on to do the same. There are fundamental reasons why this is success in the local culture. Good research appreciated by others means access to jobs. Many students succesful in the same way implies that there are a number of people who think in a similar way and appreciate your work. In order to graduate, a phd student must live in an academic culture for a period of several years. It is common to adopt the culture’s definition of success during this time. It’s also common for many phd students discover they are not suited to an academic research lifestyle. This collision of values and abilities naturally results in depression. The most fundamental advice when this happens is: change something. Pick a new advisor. Pick a new research topic. Or leave th
3 0.87894934 428 hunch net-2011-03-27-Vowpal Wabbit, v5.1
Introduction: I just created version 5.1 of vowpal wabbit . This almost entirely a bugfix release, so it’s an easy upgrade from v5.0. In addition: There is now a mailing list , which I and several other developers are subscribed to. The main website has shifted to the wiki on github. This means that anyone with a github account can now edit it. I’m planning to give a tutorial tomorrow on it at eHarmony / the LA machine learning meetup at 10am. Drop by if you’re interested. The status of VW amongst other open source projects has changed. When VW first came out, it was relatively unique amongst existing projects in terms of features. At this point, many other projects have started to appreciate the value of the design choices here. This includes: Mahout , which now has an SGD implementation. Shogun , where Soeren is keen on incorporating features . LibLinear , where they won the KDD best paper award for out-of-core learning . This is expected—any open sourc
4 0.83460045 156 hunch net-2006-02-11-Yahoo’s Learning Problems.
Introduction: I just visited Yahoo Research which has several fundamental learning problems near to (or beyond) the set of problems we know how to solve well. Here are 3 of them. Ranking This is the canonical problem of all search engines. It is made extra difficult for several reasons. There is relatively little “good” supervised learning data and a great deal of data with some signal (such as click through rates). The learning must occur in a partially adversarial environment. Many people very actively attempt to place themselves at the top of rankings. It is not even quite clear whether the problem should be posed as ‘ranking’ or as ‘regression’ which is then used to produce a ranking. Collaborative filtering Yahoo has a large number of recommendation systems for music, movies, etc… In these sorts of systems, users specify how they liked a set of things, and then the system can (hopefully) find some more examples of things they might like by reasoning across multiple
5 0.78534728 65 hunch net-2005-05-02-Reviewing techniques for conferences
Introduction: The many reviews following the many paper deadlines are just about over. AAAI and ICML in particular were experimenting with several reviewing techniques. Double Blind: AAAI and ICML were both double blind this year. It seemed (overall) beneficial, but two problems arose. For theoretical papers, with a lot to say, authors often leave out the proofs. This is very hard to cope with under a double blind review because (1) you can not trust the authors got the proof right but (2) a blanket “reject” hits many probably-good papers. Perhaps authors should more strongly favor proof-complete papers sent to double blind conferences. On the author side, double blind reviewing is actually somewhat disruptive to research. In particular, it discourages the author from talking about the subject, which is one of the mechanisms of research. This is not a great drawback, but it is one not previously appreciated. Author feedback: AAAI and ICML did author feedback this year. It seem
6 0.7541815 345 hunch net-2009-03-08-Prediction Science
7 0.65130699 464 hunch net-2012-05-03-Microsoft Research, New York City
8 0.65030241 225 hunch net-2007-01-02-Retrospective
9 0.64697987 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
10 0.63821352 411 hunch net-2010-09-21-Regretting the dead
11 0.63414347 105 hunch net-2005-08-23-(Dis)similarities between academia and open source programmers
12 0.62869859 449 hunch net-2011-11-26-Giving Thanks
13 0.62193382 343 hunch net-2009-02-18-Decision by Vetocracy
14 0.6219328 379 hunch net-2009-11-23-ICML 2009 Workshops (and Tutorials)
15 0.62082887 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
16 0.61998844 382 hunch net-2009-12-09-Future Publication Models @ NIPS
17 0.61791563 366 hunch net-2009-08-03-Carbon in Computer Science Research
18 0.61659956 423 hunch net-2011-02-02-User preferences for search engines
19 0.61599702 207 hunch net-2006-09-12-Incentive Compatible Reviewing
20 0.61408126 315 hunch net-2008-09-03-Bidding Problems