hunch_net hunch_net-2005 hunch_net-2005-22 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: I want to try to describe what doing research means, especially from the point of view of an undergraduate. The shift from a class-taking mentality to a research mentality is very significant and not easy. Problem Posing Posing the right problem is often as important as solving them. Many people can get by in research by solving problems others have posed, but that’s not sufficient for really inspiring research. For learning in particular, there is a strong feeling that we just haven’t figured out which questions are the right ones to ask. You can see this, because the answers we have do not seem convincing. Gambling your life When you do research, you think very hard about new ways of solving problems, new problems, and new solutions. Many conversations are of the form “I wonder what would happen if…” These processes can be short (days or weeks) or years-long endeavours. The worst part is that you’ll only know if you were succesful at the end of the process (and some
sentIndex sentText sentNum sentScore
1 The shift from a class-taking mentality to a research mentality is very significant and not easy. [sent-2, score-0.616]
2 Problem Posing Posing the right problem is often as important as solving them. [sent-3, score-0.471]
3 Many people can get by in research by solving problems others have posed, but that’s not sufficient for really inspiring research. [sent-4, score-0.735]
4 For learning in particular, there is a strong feeling that we just haven’t figured out which questions are the right ones to ask. [sent-5, score-0.254]
5 Gambling your life When you do research, you think very hard about new ways of solving problems, new problems, and new solutions. [sent-7, score-0.306]
6 The worst part is that you’ll only know if you were succesful at the end of the process (and sometimes not even then because it can take a long time for good research to be recognized). [sent-9, score-0.463]
7 Concentration This is not so different from solving problems in class, except that you may need to concentrate on a problem for much longer to solve it. [sent-11, score-0.42]
8 This often means shutting yourself off from the world (no TV, no interruptions, no web browsing, etc…) and really thinking. [sent-12, score-0.279]
9 Lack of feedback While doing research there is often a lack of feedback or contradicting feedback. [sent-13, score-0.718]
10 A desire to understand things from different viewpoints, to understand that niggling detail which isn’t right, and to understand the global picture of the way things are. [sent-16, score-0.915]
11 This often means saying ‘no’ when you want to say ‘yes’. [sent-22, score-0.279]
12 Conversations from a year ago often contain the key to solving today’s problem. [sent-24, score-0.388]
13 A good suite of problem-solving methods and a global understanding of how things fit together are often essential. [sent-25, score-0.509]
14 Ephemeral Contact The set of people who you know and work with may only be talked with for a few brief but intense hours a year at a conference. [sent-26, score-0.35]
15 They must be recognized (which is hard for conservative people) and seized (which is hard for people without enough confidence to gamble). [sent-28, score-0.467]
16 Not all of these traits are necessary to do good research—some of them can be compensated for and others can be learned. [sent-29, score-0.283]
17 For example, teaching reduces the extreme variance of gambling on research output. [sent-31, score-0.437]
18 Tenure provides people a stable base from which they can take greater gambles (… and often results in people doing nothing). [sent-32, score-0.559]
19 Conferences are partly succesful because they provide much more feedback than journals (which are generally slower). [sent-33, score-0.397]
20 Many people are quite succesful simply solving problems that others pose. [sent-35, score-0.728]
wordName wordTfidf (topN-words)
[('mentality', 0.214), ('solving', 0.212), ('posing', 0.19), ('research', 0.188), ('succesful', 0.181), ('recognized', 0.176), ('often', 0.176), ('gambling', 0.166), ('conversations', 0.147), ('feedback', 0.13), ('understand', 0.128), ('problems', 0.125), ('things', 0.124), ('global', 0.121), ('others', 0.107), ('people', 0.103), ('means', 0.103), ('weblogs', 0.095), ('interruptions', 0.095), ('questioning', 0.095), ('risky', 0.095), ('take', 0.094), ('hard', 0.094), ('lack', 0.094), ('admit', 0.088), ('brief', 0.088), ('compensated', 0.088), ('figured', 0.088), ('gamble', 0.088), ('posed', 0.088), ('prioritization', 0.088), ('suite', 0.088), ('traits', 0.088), ('provide', 0.086), ('right', 0.083), ('stable', 0.083), ('concentrate', 0.083), ('desire', 0.083), ('feeling', 0.083), ('intense', 0.083), ('prioritize', 0.083), ('reduces', 0.083), ('systematically', 0.083), ('pose', 0.079), ('picture', 0.079), ('concentration', 0.079), ('viewpoints', 0.076), ('talked', 0.076), ('tenure', 0.076), ('wonder', 0.076)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 22 hunch net-2005-02-18-What it means to do research.
Introduction: I want to try to describe what doing research means, especially from the point of view of an undergraduate. The shift from a class-taking mentality to a research mentality is very significant and not easy. Problem Posing Posing the right problem is often as important as solving them. Many people can get by in research by solving problems others have posed, but that’s not sufficient for really inspiring research. For learning in particular, there is a strong feeling that we just haven’t figured out which questions are the right ones to ask. You can see this, because the answers we have do not seem convincing. Gambling your life When you do research, you think very hard about new ways of solving problems, new problems, and new solutions. Many conversations are of the form “I wonder what would happen if…” These processes can be short (days or weeks) or years-long endeavours. The worst part is that you’ll only know if you were succesful at the end of the process (and some
2 0.20718105 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
Introduction: How do you create an optimal environment for research? Here are some essential ingredients that I see. Stability . University-based research is relatively good at this. On any particular day, researchers face choices in what they will work on. A very common tradeoff is between: easy small difficult big For researchers without stability, the ‘easy small’ option wins. This is often “ok”—a series of incremental improvements on the state of the art can add up to something very beneficial. However, it misses one of the big potentials of research: finding entirely new and better ways of doing things. Stability comes in many forms. The prototypical example is tenure at a university—a tenured professor is almost imposssible to fire which means that the professor has the freedom to consider far horizon activities. An iron-clad guarantee of a paycheck is not necessary—industrial research labs have succeeded well with research positions of indefinite duration. Atnt rese
3 0.15326475 44 hunch net-2005-03-21-Research Styles in Machine Learning
Introduction: Machine Learning is a field with an impressively diverse set of reseearch styles. Understanding this may be important in appreciating what you see at a conference. Engineering . How can I solve this problem? People in the engineering research style try to solve hard problems directly by any means available and then describe how they did it. This is typical of problem-specific conferences and communities. Scientific . What are the principles for solving learning problems? People in this research style test techniques on many different problems. This is fairly common at ICML and NIPS. Mathematical . How can the learning problem be mathematically understood? People in this research style prove theorems with implications for learning but often do not implement (or test algorithms). COLT is a typical conference for this style. Many people manage to cross these styles, and that is often beneficial. Whenver we list a set of alternative, it becomes natural to think “wh
4 0.14966488 370 hunch net-2009-09-18-Necessary and Sufficient Research
Introduction: Researchers are typically confronted with big problems that they have no idea how to solve. In trying to come up with a solution, a natural approach is to decompose the big problem into a set of subproblems whose solution yields a solution to the larger problem. This approach can go wrong in several ways. Decomposition failure . The solution to the decomposition does not in fact yield a solution to the overall problem. Artificial hardness . The subproblems created are sufficient if solved to solve the overall problem, but they are harder than necessary. As you can see, computational complexity forms a relatively new (in research-history) razor by which to judge an approach sufficient but not necessary. In my experience, the artificial hardness problem is very common. Many researchers abdicate the responsibility of choosing a problem to work on to other people. This process starts very naturally as a graduate student, when an incoming student might have relatively l
5 0.14338394 454 hunch net-2012-01-30-ICML Posters and Scope
Introduction: Normally, I don’t indulge in posters for ICML , but this year is naturally an exception for me. If you want one, there are a small number left here , if you sign up before February. It also seems worthwhile to give some sense of the scope and reviewing criteria for ICML for authors considering submitting papers. At ICML, the (very large) program committee does the reviewing which informs final decisions by area chairs on most papers. Program chairs setup the process, deal with exceptions or disagreements, and provide advice for the reviewing process. Providing advice is tricky (and easily misleading) because a conference is a community, and in the end the aggregate interests of the community determine the conference. Nevertheless, as a program chair this year it seems worthwhile to state the overall philosophy I have and what I plan to encourage (and occasionally discourage). At the highest level, I believe ICML exists to further research into machine learning, which I gene
6 0.13780873 358 hunch net-2009-06-01-Multitask Poisoning
7 0.13768415 96 hunch net-2005-07-21-Six Months
8 0.13697627 347 hunch net-2009-03-26-Machine Learning is too easy
9 0.13118468 36 hunch net-2005-03-05-Funding Research
10 0.12921028 344 hunch net-2009-02-22-Effective Research Funding
11 0.12780988 14 hunch net-2005-02-07-The State of the Reduction
12 0.12773673 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
13 0.12527503 343 hunch net-2009-02-18-Decision by Vetocracy
14 0.12250744 42 hunch net-2005-03-17-Going all the Way, Sometimes
15 0.11990325 116 hunch net-2005-09-30-Research in conferences
16 0.11829712 2 hunch net-2005-01-24-Holy grails of machine learning?
17 0.11827317 40 hunch net-2005-03-13-Avoiding Bad Reviewing
18 0.11798044 177 hunch net-2006-05-05-An ICML reject
19 0.1178461 95 hunch net-2005-07-14-What Learning Theory might do
20 0.11774687 395 hunch net-2010-04-26-Compassionate Reviewing
topicId topicWeight
[(0, 0.301), (1, -0.043), (2, -0.034), (3, 0.174), (4, -0.116), (5, -0.058), (6, 0.102), (7, 0.062), (8, 0.053), (9, 0.074), (10, 0.021), (11, -0.013), (12, 0.033), (13, 0.022), (14, 0.055), (15, -0.002), (16, 0.073), (17, -0.008), (18, -0.053), (19, -0.007), (20, -0.009), (21, 0.03), (22, -0.006), (23, -0.036), (24, 0.029), (25, -0.047), (26, -0.037), (27, -0.01), (28, -0.148), (29, 0.004), (30, -0.027), (31, -0.023), (32, -0.077), (33, -0.031), (34, -0.048), (35, 0.047), (36, 0.079), (37, -0.049), (38, -0.061), (39, 0.083), (40, 0.077), (41, 0.03), (42, -0.036), (43, -0.03), (44, 0.055), (45, 0.042), (46, -0.064), (47, 0.049), (48, 0.044), (49, 0.065)]
simIndex simValue blogId blogTitle
same-blog 1 0.98543638 22 hunch net-2005-02-18-What it means to do research.
Introduction: I want to try to describe what doing research means, especially from the point of view of an undergraduate. The shift from a class-taking mentality to a research mentality is very significant and not easy. Problem Posing Posing the right problem is often as important as solving them. Many people can get by in research by solving problems others have posed, but that’s not sufficient for really inspiring research. For learning in particular, there is a strong feeling that we just haven’t figured out which questions are the right ones to ask. You can see this, because the answers we have do not seem convincing. Gambling your life When you do research, you think very hard about new ways of solving problems, new problems, and new solutions. Many conversations are of the form “I wonder what would happen if…” These processes can be short (days or weeks) or years-long endeavours. The worst part is that you’ll only know if you were succesful at the end of the process (and some
2 0.82791239 76 hunch net-2005-05-29-Bad ideas
Introduction: I found these two essays on bad ideas interesting. Neither of these is written from the viewpoint of research, but they are both highly relevant. Why smart people have bad ideas by Paul Graham Why smart people defend bad ideas by Scott Berkun (which appeared on slashdot ) In my experience, bad ideas are common and over confidence in ideas is common. This overconfidence can take either the form of excessive condemnation or excessive praise. Some of this is necessary to the process of research. For example, some overconfidence in the value of your own research is expected and probably necessary to motivate your own investigation. Since research is a rather risky business, much of it does not pan out. Learning to accept when something does not pan out is a critical skill which is sometimes never acquired. Excessive condemnation can be a real ill when it’s encountered. This has two effects: When the penalty for being wrong is too large, it means people have a
3 0.79532129 358 hunch net-2009-06-01-Multitask Poisoning
Introduction: There are many ways that interesting research gets done. For example it’s common at a conference for someone to discuss a problem with a partial solution, and for someone else to know how to solve a piece of it, resulting in a paper. In some sense, these are the easiest results we can achieve, so we should ask: Can all research be this easy? The answer is certainly no for fields where research inherently requires experimentation to discover how the real world works. However, mathematics, including parts of physics, computer science, statistics, etc… which are effectively mathematics don’t require experimentation. In effect, a paper can be simply a pure expression of thinking. Can all mathematical-style research be this easy? What’s going on here is research-by-communication. Someone knows something, someone knows something else, and as soon as someone knows both things, a problem is solved. The interesting thing about research-by-communication is that it is becoming radic
4 0.78108311 147 hunch net-2006-01-08-Debugging Your Brain
Introduction: One part of doing research is debugging your understanding of reality. This is hard work: How do you even discover where you misunderstand? If you discover a misunderstanding, how do you go about removing it? The process of debugging computer programs is quite analogous to debugging reality misunderstandings. This is natural—a bug in a computer program is a misunderstanding between you and the computer about what you said. Many of the familiar techniques from debugging have exact parallels. Details When programming, there are often signs that some bug exists like: “the graph my program output is shifted a little bit” = maybe you have an indexing error. In debugging yourself, we often have some impression that something is “not right”. These impressions should be addressed directly and immediately. (Some people have the habit of suppressing worries in favor of excess certainty. That’s not healthy for research.) Corner Cases A “corner case” is an input to a program wh
5 0.77421224 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
Introduction: How do you create an optimal environment for research? Here are some essential ingredients that I see. Stability . University-based research is relatively good at this. On any particular day, researchers face choices in what they will work on. A very common tradeoff is between: easy small difficult big For researchers without stability, the ‘easy small’ option wins. This is often “ok”—a series of incremental improvements on the state of the art can add up to something very beneficial. However, it misses one of the big potentials of research: finding entirely new and better ways of doing things. Stability comes in many forms. The prototypical example is tenure at a university—a tenured professor is almost imposssible to fire which means that the professor has the freedom to consider far horizon activities. An iron-clad guarantee of a paycheck is not necessary—industrial research labs have succeeded well with research positions of indefinite duration. Atnt rese
6 0.76161629 73 hunch net-2005-05-17-A Short Guide to PhD Graduate Study
7 0.75690144 44 hunch net-2005-03-21-Research Styles in Machine Learning
8 0.75165409 370 hunch net-2009-09-18-Necessary and Sufficient Research
9 0.74624795 42 hunch net-2005-03-17-Going all the Way, Sometimes
10 0.72689593 231 hunch net-2007-02-10-Best Practices for Collaboration
11 0.69815731 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
12 0.69025755 257 hunch net-2007-07-28-Asking questions
13 0.68782651 187 hunch net-2006-06-25-Presentation of Proofs is Hard.
14 0.68248773 249 hunch net-2007-06-21-Presentation Preparation
15 0.6818226 162 hunch net-2006-03-09-Use of Notation
16 0.67684656 110 hunch net-2005-09-10-“Failure” is an option
17 0.67651606 202 hunch net-2006-08-10-Precision is not accuracy
18 0.67410064 307 hunch net-2008-07-04-More Presentation Preparation
19 0.66927296 91 hunch net-2005-07-10-Thinking the Unthought
20 0.65329677 142 hunch net-2005-12-22-Yes , I am applying
topicId topicWeight
[(10, 0.014), (27, 0.207), (38, 0.018), (42, 0.268), (53, 0.105), (55, 0.143), (56, 0.012), (64, 0.019), (94, 0.089), (95, 0.056)]
simIndex simValue blogId blogTitle
1 0.94661349 255 hunch net-2007-07-13-The View From China
Introduction: I’m visiting Beijing for the Pao-Lu Hsu Statistics Conference on Machine Learning. I had several discussions about the state of Chinese research. Given the large population and economy, you might expect substantial research—more than has been observed at international conferences. The fundamental problem seems to be the Cultural Revolution which lobotimized higher education, and the research associated with it. There has been a process of slow recovery since then, which has begun to be felt in the research world via increased participation in international conferences and (now) conferences in China. The amount of effort going into construction in Beijing is very impressive—people are literally building a skyscraper at night outside the window of the hotel I’m staying at (and this is not unusual). If a small fraction of this effort is later focused onto supporting research, the effect could be very substantial. General growth in China’s research portfolio should be expecte
2 0.94013816 242 hunch net-2007-04-30-COLT 2007
Introduction: Registration for COLT 2007 is now open. The conference will take place on 13-15 June, 2007, in San Diego, California, as part of the 2007 Federated Computing Research Conference (FCRC), which includes STOC, Complexity, and EC. The website for COLT: http://www.learningtheory.org/colt2007/index.html The early registration deadline is May 11, and the cutoff date for discounted hotel rates is May 9. Before registering, take note that the fees are substantially lower for members of ACM and/or SIGACT than for nonmembers. If you’ve been contemplating joining either of these two societies (annual dues: $99 for ACM, $18 for SIGACT), now would be a good time!
3 0.93140668 485 hunch net-2013-06-29-The Benefits of Double-Blind Review
Introduction: This post is a (near) transcript of a talk that I gave at the ICML 2013 Workshop on Peer Review and Publishing Models . Although there’s a PDF available on my website , I’ve chosen to post a slightly modified version here as well in order to better facilitate discussion. Disclaimers and Context I want to start with a couple of disclaimers and some context. First, I want to point out that although I’ve read a lot about double-blind review, this isn’t my research area and the research discussed in this post is not my own. As a result, I probably can’t answer super detailed questions about these studies. I also want to note that I’m not opposed to open peer review — I was a free and open source software developer for over ten years and I care a great deal about openness and transparency. Rather, my motivation in writing this post is simply to create awareness of and to initiate discussion about the benefits of double-blind review. Lastly, and most importantly, I think it’s e
4 0.88508785 282 hunch net-2008-01-06-Research Political Issues
Introduction: I’ve avoided discussing politics here, although not for lack of interest. The problem with discussing politics is that it’s customary for people to say much based upon little information. Nevertheless, politics can have a substantial impact on science (and we might hope for the vice-versa). It’s primary election time in the United States, so the topic is timely, although the issues are not. There are several policy decisions which substantially effect development of science and technology in the US. Education The US has great contrasts in education. The top universities are very good places, yet the grade school education system produces mediocre results. For me, the contrast between a public education and Caltech was bracing. For many others attending Caltech, it clearly was not. Upgrading the k-12 education system in the US is a long-standing chronic problem which I know relatively little about. My own experience is that a basic attitude of “no child unrealized” i
same-blog 5 0.86262596 22 hunch net-2005-02-18-What it means to do research.
Introduction: I want to try to describe what doing research means, especially from the point of view of an undergraduate. The shift from a class-taking mentality to a research mentality is very significant and not easy. Problem Posing Posing the right problem is often as important as solving them. Many people can get by in research by solving problems others have posed, but that’s not sufficient for really inspiring research. For learning in particular, there is a strong feeling that we just haven’t figured out which questions are the right ones to ask. You can see this, because the answers we have do not seem convincing. Gambling your life When you do research, you think very hard about new ways of solving problems, new problems, and new solutions. Many conversations are of the form “I wonder what would happen if…” These processes can be short (days or weeks) or years-long endeavours. The worst part is that you’ll only know if you were succesful at the end of the process (and some
6 0.85097826 89 hunch net-2005-07-04-The Health of COLT
7 0.78206515 216 hunch net-2006-11-02-2006 NIPS workshops
8 0.73516446 40 hunch net-2005-03-13-Avoiding Bad Reviewing
9 0.73306304 452 hunch net-2012-01-04-Why ICML? and the summer conferences
10 0.71931261 333 hunch net-2008-12-27-Adversarial Academia
11 0.7189126 437 hunch net-2011-07-10-ICML 2011 and the future
12 0.71822989 416 hunch net-2010-10-29-To Vidoelecture or not
13 0.71638197 146 hunch net-2006-01-06-MLTV
14 0.71112186 141 hunch net-2005-12-17-Workshops as Franchise Conferences
15 0.70923984 116 hunch net-2005-09-30-Research in conferences
16 0.70899659 225 hunch net-2007-01-02-Retrospective
17 0.70684171 207 hunch net-2006-09-12-Incentive Compatible Reviewing
18 0.7058292 297 hunch net-2008-04-22-Taking the next step
19 0.7050854 343 hunch net-2009-02-18-Decision by Vetocracy
20 0.70400864 406 hunch net-2010-08-22-KDD 2010