hunch_net hunch_net-2005 hunch_net-2005-96 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This is the 6 month point in the “run a research blog” experiment, so it seems like a good point to take stock and assess. One fundamental question is: “Is it worth it?” The idea of running a research blog will never become widely popular and useful unless it actually aids research. On the negative side, composing ideas for a post and maintaining a blog takes a significant amount of time. On the positive side, the process might yield better research because there is an opportunity for better, faster feedback implying better, faster thinking. My answer at the moment is a provisional “yes”. Running the blog has been incidentally helpful in several ways: It is sometimes educational. example More often, the process of composing thoughts well enough to post simply aids thinking. This has resulted in a couple solutions to problems of interest (and perhaps more over time). If you really want to solve a problem, letting the world know is helpful. This isn’t necessarily
sentIndex sentText sentNum sentScore
1 This is the 6 month point in the “run a research blog” experiment, so it seems like a good point to take stock and assess. [sent-1, score-0.545]
2 One fundamental question is: “Is it worth it? [sent-2, score-0.087]
3 ” The idea of running a research blog will never become widely popular and useful unless it actually aids research. [sent-3, score-1.402]
4 On the negative side, composing ideas for a post and maintaining a blog takes a significant amount of time. [sent-4, score-1.286]
5 On the positive side, the process might yield better research because there is an opportunity for better, faster feedback implying better, faster thinking. [sent-5, score-1.13]
6 My answer at the moment is a provisional “yes”. [sent-6, score-0.103]
7 Running the blog has been incidentally helpful in several ways: It is sometimes educational. [sent-7, score-0.617]
8 example More often, the process of composing thoughts well enough to post simply aids thinking. [sent-8, score-0.932]
9 This has resulted in a couple solutions to problems of interest (and perhaps more over time). [sent-9, score-0.333]
10 If you really want to solve a problem, letting the world know is helpful. [sent-10, score-0.375]
11 This isn’t necessarily because the world will help you solve it, but it’s helpful nevertheless. [sent-11, score-0.471]
12 In addition, posts by others have helped frame thinking about “What are important problems people care about? [sent-12, score-0.515]
wordName wordTfidf (topN-words)
[('blog', 0.357), ('composing', 0.33), ('aids', 0.275), ('faster', 0.179), ('side', 0.176), ('invaluable', 0.165), ('running', 0.164), ('resulted', 0.153), ('letting', 0.137), ('frame', 0.137), ('maintaining', 0.137), ('helpful', 0.137), ('popular', 0.132), ('incidentally', 0.123), ('world', 0.123), ('better', 0.123), ('post', 0.122), ('stock', 0.12), ('month', 0.12), ('solve', 0.115), ('unless', 0.111), ('thoughts', 0.109), ('posts', 0.109), ('research', 0.109), ('moment', 0.103), ('widely', 0.101), ('helped', 0.101), ('point', 0.098), ('opportunity', 0.098), ('care', 0.096), ('necessarily', 0.096), ('process', 0.096), ('positive', 0.095), ('negative', 0.095), ('couple', 0.095), ('experiment', 0.093), ('yield', 0.089), ('yes', 0.088), ('takes', 0.087), ('worth', 0.087), ('implying', 0.087), ('addition', 0.086), ('ideas', 0.085), ('solutions', 0.085), ('never', 0.081), ('feedback', 0.075), ('amount', 0.073), ('end', 0.072), ('actually', 0.072), ('thinking', 0.072)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 96 hunch net-2005-07-21-Six Months
Introduction: This is the 6 month point in the “run a research blog” experiment, so it seems like a good point to take stock and assess. One fundamental question is: “Is it worth it?” The idea of running a research blog will never become widely popular and useful unless it actually aids research. On the negative side, composing ideas for a post and maintaining a blog takes a significant amount of time. On the positive side, the process might yield better research because there is an opportunity for better, faster feedback implying better, faster thinking. My answer at the moment is a provisional “yes”. Running the blog has been incidentally helpful in several ways: It is sometimes educational. example More often, the process of composing thoughts well enough to post simply aids thinking. This has resulted in a couple solutions to problems of interest (and perhaps more over time). If you really want to solve a problem, letting the world know is helpful. This isn’t necessarily
2 0.25384584 225 hunch net-2007-01-02-Retrospective
Introduction: It’s been almost two years since this blog began. In that time, I’ve learned enough to shift my expectations in several ways. Initially, the idea was for a general purpose ML blog where different people could contribute posts. What has actually happened is most posts come from me, with a few guest posts that I greatly value. There are a few reasons I see for this. Overload . A couple years ago, I had not fully appreciated just how busy life gets for a researcher. Making a post is not simply a matter of getting to it, but rather of prioritizing between {writing a grant, finishing an overdue review, writing a paper, teaching a class, writing a program, etc…}. This is a substantial transition away from what life as a graduate student is like. At some point the question is not “when will I get to it?” but rather “will I get to it?” and the answer starts to become “no” most of the time. Feedback failure . This blog currently receives about 3K unique visitors per day from
3 0.22986601 151 hunch net-2006-01-25-1 year
Introduction: At the one year (+5 days) anniversary, the natural question is: “Was it helpful for research?” Answer: Yes, and so it shall continue. Some evidence is provided by noticing that I am about a factor of 2 more overloaded with paper ideas than I’ve ever previously been. It is always hard to estimate counterfactual worlds, but I expect that this is also a factor of 2 more than “What if I had not started the blog?” As for “Why?”, there seem to be two primary effects. A blog is a mechanism for connecting with people who either think like you or are interested in the same problems. This allows for concentration of thinking which is very helpful in solving problems. The process of stating things you don’t understand publicly is very helpful in understanding them. Sometimes you are simply forced to express them in a way which aids understanding. Sometimes someone else says something which helps. And sometimes you discover that someone else has already solved the problem. The
4 0.21216147 92 hunch net-2005-07-11-AAAI blog
Introduction: The AAAI conference is running a student blog which looks like a fun experiment.
5 0.19758616 383 hunch net-2009-12-09-Inherent Uncertainty
Introduction: I’d like to point out Inherent Uncertainty , which I’ve added to the ML blog post scanner on the right. My understanding from Jake is that the intention is to have a multiauthor blog which is more specialized towards learning theory/game theory than this one. Nevertheless, several of the posts seem to be of wider interest.
6 0.18540861 214 hunch net-2006-10-13-David Pennock starts Oddhead
7 0.14849755 486 hunch net-2013-07-10-Thoughts on Artificial Intelligence
8 0.14383337 59 hunch net-2005-04-22-New Blog: [Lowerbounds,Upperbounds]
9 0.14091074 166 hunch net-2006-03-24-NLPers
10 0.14081539 25 hunch net-2005-02-20-At One Month
11 0.13768415 22 hunch net-2005-02-18-What it means to do research.
12 0.13449712 350 hunch net-2009-04-23-Jonathan Chang at Slycoder
13 0.12808228 480 hunch net-2013-03-22-I’m a bandit
14 0.11479516 193 hunch net-2006-07-09-The Stock Prediction Machine Learning Problem
15 0.11214549 132 hunch net-2005-11-26-The Design of an Optimal Research Environment
16 0.10550789 402 hunch net-2010-07-02-MetaOptimize
17 0.10307193 137 hunch net-2005-12-09-Machine Learning Thoughts
18 0.10281168 116 hunch net-2005-09-30-Research in conferences
19 0.10258242 296 hunch net-2008-04-21-The Science 2.0 article
20 0.1010951 467 hunch net-2012-06-15-Normal Deviate and the UCSC Machine Learning Summer School
topicId topicWeight
[(0, 0.207), (1, -0.042), (2, -0.088), (3, 0.15), (4, -0.162), (5, -0.039), (6, 0.069), (7, -0.368), (8, 0.184), (9, -0.002), (10, -0.04), (11, 0.016), (12, 0.048), (13, -0.037), (14, -0.062), (15, 0.019), (16, 0.02), (17, -0.074), (18, -0.025), (19, -0.041), (20, -0.061), (21, 0.073), (22, 0.016), (23, -0.011), (24, 0.01), (25, 0.045), (26, 0.011), (27, 0.02), (28, -0.024), (29, -0.016), (30, -0.007), (31, -0.02), (32, -0.084), (33, 0.029), (34, 0.026), (35, -0.0), (36, 0.039), (37, 0.038), (38, -0.086), (39, 0.004), (40, 0.017), (41, -0.004), (42, -0.023), (43, -0.003), (44, 0.04), (45, 0.106), (46, -0.032), (47, -0.03), (48, -0.097), (49, -0.0)]
simIndex simValue blogId blogTitle
same-blog 1 0.96976221 96 hunch net-2005-07-21-Six Months
Introduction: This is the 6 month point in the “run a research blog” experiment, so it seems like a good point to take stock and assess. One fundamental question is: “Is it worth it?” The idea of running a research blog will never become widely popular and useful unless it actually aids research. On the negative side, composing ideas for a post and maintaining a blog takes a significant amount of time. On the positive side, the process might yield better research because there is an opportunity for better, faster feedback implying better, faster thinking. My answer at the moment is a provisional “yes”. Running the blog has been incidentally helpful in several ways: It is sometimes educational. example More often, the process of composing thoughts well enough to post simply aids thinking. This has resulted in a couple solutions to problems of interest (and perhaps more over time). If you really want to solve a problem, letting the world know is helpful. This isn’t necessarily
2 0.86105144 225 hunch net-2007-01-02-Retrospective
Introduction: It’s been almost two years since this blog began. In that time, I’ve learned enough to shift my expectations in several ways. Initially, the idea was for a general purpose ML blog where different people could contribute posts. What has actually happened is most posts come from me, with a few guest posts that I greatly value. There are a few reasons I see for this. Overload . A couple years ago, I had not fully appreciated just how busy life gets for a researcher. Making a post is not simply a matter of getting to it, but rather of prioritizing between {writing a grant, finishing an overdue review, writing a paper, teaching a class, writing a program, etc…}. This is a substantial transition away from what life as a graduate student is like. At some point the question is not “when will I get to it?” but rather “will I get to it?” and the answer starts to become “no” most of the time. Feedback failure . This blog currently receives about 3K unique visitors per day from
3 0.8121202 151 hunch net-2006-01-25-1 year
Introduction: At the one year (+5 days) anniversary, the natural question is: “Was it helpful for research?” Answer: Yes, and so it shall continue. Some evidence is provided by noticing that I am about a factor of 2 more overloaded with paper ideas than I’ve ever previously been. It is always hard to estimate counterfactual worlds, but I expect that this is also a factor of 2 more than “What if I had not started the blog?” As for “Why?”, there seem to be two primary effects. A blog is a mechanism for connecting with people who either think like you or are interested in the same problems. This allows for concentration of thinking which is very helpful in solving problems. The process of stating things you don’t understand publicly is very helpful in understanding them. Sometimes you are simply forced to express them in a way which aids understanding. Sometimes someone else says something which helps. And sometimes you discover that someone else has already solved the problem. The
4 0.80967307 383 hunch net-2009-12-09-Inherent Uncertainty
Introduction: I’d like to point out Inherent Uncertainty , which I’ve added to the ML blog post scanner on the right. My understanding from Jake is that the intention is to have a multiauthor blog which is more specialized towards learning theory/game theory than this one. Nevertheless, several of the posts seem to be of wider interest.
5 0.70256406 350 hunch net-2009-04-23-Jonathan Chang at Slycoder
Introduction: Jonathan Chang has a research blog on aspects of machine learning.
6 0.67124093 486 hunch net-2013-07-10-Thoughts on Artificial Intelligence
7 0.65582675 214 hunch net-2006-10-13-David Pennock starts Oddhead
8 0.65470922 480 hunch net-2013-03-22-I’m a bandit
9 0.61750579 166 hunch net-2006-03-24-NLPers
10 0.61673164 182 hunch net-2006-06-05-Server Shift, Site Tweaks, Suggestions?
11 0.59999949 92 hunch net-2005-07-11-AAAI blog
12 0.59848613 296 hunch net-2008-04-21-The Science 2.0 article
13 0.58601063 25 hunch net-2005-02-20-At One Month
14 0.55518013 402 hunch net-2010-07-02-MetaOptimize
15 0.51872963 467 hunch net-2012-06-15-Normal Deviate and the UCSC Machine Learning Summer School
16 0.50628316 59 hunch net-2005-04-22-New Blog: [Lowerbounds,Upperbounds]
17 0.48748282 137 hunch net-2005-12-09-Machine Learning Thoughts
18 0.45038292 22 hunch net-2005-02-18-What it means to do research.
19 0.43769699 358 hunch net-2009-06-01-Multitask Poisoning
20 0.42418587 142 hunch net-2005-12-22-Yes , I am applying
topicId topicWeight
[(3, 0.043), (24, 0.221), (27, 0.236), (53, 0.083), (55, 0.166), (94, 0.146)]
simIndex simValue blogId blogTitle
same-blog 1 0.92761958 96 hunch net-2005-07-21-Six Months
Introduction: This is the 6 month point in the “run a research blog” experiment, so it seems like a good point to take stock and assess. One fundamental question is: “Is it worth it?” The idea of running a research blog will never become widely popular and useful unless it actually aids research. On the negative side, composing ideas for a post and maintaining a blog takes a significant amount of time. On the positive side, the process might yield better research because there is an opportunity for better, faster feedback implying better, faster thinking. My answer at the moment is a provisional “yes”. Running the blog has been incidentally helpful in several ways: It is sometimes educational. example More often, the process of composing thoughts well enough to post simply aids thinking. This has resulted in a couple solutions to problems of interest (and perhaps more over time). If you really want to solve a problem, letting the world know is helpful. This isn’t necessarily
2 0.84651846 95 hunch net-2005-07-14-What Learning Theory might do
Introduction: I wanted to expand on this post and some of the previous problems/research directions about where learning theory might make large strides. Why theory? The essential reason for theory is “intuition extension”. A very good applied learning person can master some particular application domain yielding the best computer algorithms for solving that problem. A very good theory can take the intuitions discovered by this and other applied learning people and extend them to new domains in a relatively automatic fashion. To do this, we take these basic intuitions and try to find a mathematical model that: Explains the basic intuitions. Makes new testable predictions about how to learn. Succeeds in so learning. This is “intuition extension”: taking what we have learned somewhere else and applying it in new domains. It is fundamentally useful to everyone because it increases the level of automation in solving problems. Where next for learning theory? I like the a
3 0.83346218 4 hunch net-2005-01-26-Summer Schools
Introduction: There are several summer schools related to machine learning. We are running a two week machine learning summer school in Chicago, USA May 16-27. IPAM is running a more focused three week summer school on Intelligent Extraction of Information from Graphs and High Dimensional Data in Los Angeles, USA July 11-29. A broad one-week school on analysis of patterns will be held in Erice, Italy, Oct. 28-Nov 6.
4 0.80535835 40 hunch net-2005-03-13-Avoiding Bad Reviewing
Introduction: If we accept that bad reviewing often occurs and want to fix it, the question is “how”? Reviewing is done by paper writers just like yourself, so a good proxy for this question is asking “How can I be a better reviewer?” Here are a few things I’ve learned by trial (and error), as a paper writer, and as a reviewer. The secret ingredient is careful thought. There is no good substitution for a deep and careful understanding. Avoid reviewing papers that you feel competitive about. You almost certainly will be asked to review papers that feel competitive if you work on subjects of common interest. But, the feeling of competition can easily lead to bad judgement. If you feel biased for some other reason, then you should avoid reviewing. For example… Feeling angry or threatened by a paper is a form of bias. See above. Double blind yourself (avoid looking at the name even in a single-blind situation). The significant effect of a name you recognize is making you pay close a
5 0.79731035 116 hunch net-2005-09-30-Research in conferences
Introduction: Conferences exist as part of the process of doing research. They provide many roles including “announcing research”, “meeting people”, and “point of reference”. Not all conferences are alike so a basic question is: “to what extent do individual conferences attempt to aid research?” This question is very difficult to answer in any satisfying way. What we can do is compare details of the process across multiple conferences. Comments The average quality of comments across conferences can vary dramatically. At one extreme, the tradition in CS theory conferences is to provide essentially zero feedback. At the other extreme, some conferences have a strong tradition of providing detailed constructive feedback. Detailed feedback can give authors significant guidance about how to improve research. This is the most subjective entry. Blind Virtually all conferences offer single blind review where authors do not know reviewers. Some also provide double blind review where rev
6 0.79400378 437 hunch net-2011-07-10-ICML 2011 and the future
7 0.79160732 286 hunch net-2008-01-25-Turing’s Club for Machine Learning
8 0.78955293 379 hunch net-2009-11-23-ICML 2009 Workshops (and Tutorials)
9 0.78814876 423 hunch net-2011-02-02-User preferences for search engines
10 0.78535211 484 hunch net-2013-06-16-Representative Reviewing
11 0.78509909 221 hunch net-2006-12-04-Structural Problems in NIPS Decision Making
12 0.78410745 461 hunch net-2012-04-09-ICML author feedback is open
13 0.78249079 419 hunch net-2010-12-04-Vowpal Wabbit, version 5.0, and the second heresy
14 0.78106773 452 hunch net-2012-01-04-Why ICML? and the summer conferences
15 0.77949035 320 hunch net-2008-10-14-Who is Responsible for a Bad Review?
16 0.77921146 297 hunch net-2008-04-22-Taking the next step
17 0.77754033 44 hunch net-2005-03-21-Research Styles in Machine Learning
18 0.77707183 207 hunch net-2006-09-12-Incentive Compatible Reviewing
19 0.77657795 463 hunch net-2012-05-02-ICML: Behind the Scenes
20 0.77574754 22 hunch net-2005-02-18-What it means to do research.