hunch_net hunch_net-2005 hunch_net-2005-64 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: A big part of doing research is imagining how things could be different, and then trying to figure out how to get there. A big part of science fiction is imagining how things could be different, and then working through the implications. Because of the similarity here, reading science fiction can sometimes be helpful in understanding and doing research. (And, hey, it’s fun.) Here’s some list of science fiction books I enjoyed which seem particularly relevant to computer science and (sometimes) learning systems: Vernor Vinge, “True Names”, “A Fire Upon the Deep” Marc Stiegler, “David’s Sling”, “Earthweb” Charles Stross, “Singularity Sky” Greg Egan, “Diaspora” Joe Haldeman, “Forever Peace” (There are surely many others.) Incidentally, the nature of science fiction itself has changed. Decades ago, science fiction projected great increases in the power humans control (example: E.E. Smith Lensman series). That didn’t really happen in the last 50 years. Inste
sentIndex sentText sentNum sentScore
1 A big part of doing research is imagining how things could be different, and then trying to figure out how to get there. [sent-1, score-0.614]
2 A big part of science fiction is imagining how things could be different, and then working through the implications. [sent-2, score-1.553]
3 Because of the similarity here, reading science fiction can sometimes be helpful in understanding and doing research. [sent-3, score-1.247]
4 ) Incidentally, the nature of science fiction itself has changed. [sent-6, score-1.085]
5 Decades ago, science fiction projected great increases in the power humans control (example: E. [sent-7, score-1.496]
6 Instead, we gradually refined the degree to which we can control various kinds of power. [sent-11, score-0.469]
7 This can be understood as a shift from physics-based progress to engineering or computer science based progress. [sent-13, score-0.813]
wordName wordTfidf (topN-words)
[('fiction', 0.635), ('science', 0.387), ('imagining', 0.228), ('control', 0.142), ('progress', 0.115), ('joe', 0.114), ('diaspora', 0.114), ('forever', 0.114), ('marc', 0.114), ('projected', 0.114), ('smith', 0.114), ('books', 0.106), ('greg', 0.106), ('computer', 0.101), ('charles', 0.1), ('singularity', 0.1), ('decades', 0.095), ('fire', 0.095), ('gradually', 0.095), ('refined', 0.095), ('part', 0.094), ('reflect', 0.091), ('similarity', 0.091), ('names', 0.088), ('increases', 0.085), ('incidentally', 0.085), ('big', 0.084), ('figure', 0.083), ('series', 0.077), ('engineering', 0.075), ('changed', 0.075), ('shift', 0.072), ('didn', 0.072), ('sometimes', 0.072), ('surely', 0.071), ('degree', 0.069), ('humans', 0.069), ('kinds', 0.068), ('could', 0.065), ('enjoyed', 0.064), ('power', 0.064), ('nature', 0.063), ('understood', 0.063), ('reading', 0.062), ('ago', 0.061), ('david', 0.061), ('upon', 0.06), ('things', 0.06), ('happen', 0.059), ('different', 0.059)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 64 hunch net-2005-04-28-Science Fiction and Research
Introduction: A big part of doing research is imagining how things could be different, and then trying to figure out how to get there. A big part of science fiction is imagining how things could be different, and then working through the implications. Because of the similarity here, reading science fiction can sometimes be helpful in understanding and doing research. (And, hey, it’s fun.) Here’s some list of science fiction books I enjoyed which seem particularly relevant to computer science and (sometimes) learning systems: Vernor Vinge, “True Names”, “A Fire Upon the Deep” Marc Stiegler, “David’s Sling”, “Earthweb” Charles Stross, “Singularity Sky” Greg Egan, “Diaspora” Joe Haldeman, “Forever Peace” (There are surely many others.) Incidentally, the nature of science fiction itself has changed. Decades ago, science fiction projected great increases in the power humans control (example: E.E. Smith Lensman series). That didn’t really happen in the last 50 years. Inste
2 0.12644678 228 hunch net-2007-01-15-The Machine Learning Department
Introduction: Carnegie Mellon School of Computer Science has the first academic Machine Learning department . This department already existed as the Center for Automated Learning and Discovery , but recently changed it’s name. The reason for changing the name is obvious: very few people think of themselves as “Automated Learner and Discoverers”, but there are number of people who think of themselves as “Machine Learners”. Machine learning is both more succinct and recognizable—good properties for a name. A more interesting question is “Should there be a Machine Learning Department?”. Tom Mitchell has a relevant whitepaper claiming that machine learning is answering a different question than other fields or departments. The fundamental debate here is “Is machine learning different from statistics?” At a cultural level, there is no real debate: they are different. Machine learning is characterized by several very active large peer reviewed conferences, operating in a computer
3 0.10635213 282 hunch net-2008-01-06-Research Political Issues
Introduction: I’ve avoided discussing politics here, although not for lack of interest. The problem with discussing politics is that it’s customary for people to say much based upon little information. Nevertheless, politics can have a substantial impact on science (and we might hope for the vice-versa). It’s primary election time in the United States, so the topic is timely, although the issues are not. There are several policy decisions which substantially effect development of science and technology in the US. Education The US has great contrasts in education. The top universities are very good places, yet the grade school education system produces mediocre results. For me, the contrast between a public education and Caltech was bracing. For many others attending Caltech, it clearly was not. Upgrading the k-12 education system in the US is a long-standing chronic problem which I know relatively little about. My own experience is that a basic attitude of “no child unrealized” i
4 0.10191292 449 hunch net-2011-11-26-Giving Thanks
Introduction: Thanksgiving is perhaps my favorite holiday, because pausing your life and giving thanks provides a needed moment of perspective. As a researcher, I am most thankful for my education, without which I could not function. I want to share this, because it provides some sense of how a researcher starts. My long term memory seems to function particularly well, which makes any education I get is particularly useful. I am naturally obsessive, which makes me chase down details until I fully understand things. Natural obsessiveness can go wrong, of course, but it’s a great ally when you absolutely must get things right. My childhood was all in one hometown, which was a conscious sacrifice on the part of my father, implying disruptions from moving around were eliminated. I’m not sure how important this was since travel has it’s own benefits, but it bears thought. I had several great teachers in grade school, and naturally gravitated towards teachers over classmates, as they seemed
5 0.089465827 340 hunch net-2009-01-28-Nielsen’s talk
Introduction: I wanted to point to Michael Nielsen’s talk about blogging science, which I found interesting.
6 0.087652594 366 hunch net-2009-08-03-Carbon in Computer Science Research
7 0.084184438 106 hunch net-2005-09-04-Science in the Government
8 0.083430693 112 hunch net-2005-09-14-The Predictionist Viewpoint
9 0.082564637 296 hunch net-2008-04-21-The Science 2.0 article
10 0.082154371 295 hunch net-2008-04-12-It Doesn’t Stop
11 0.079131074 17 hunch net-2005-02-10-Conferences, Dates, Locations
12 0.071720771 134 hunch net-2005-12-01-The Webscience Future
13 0.068697706 414 hunch net-2010-10-17-Partha Niyogi has died
14 0.067920491 10 hunch net-2005-02-02-Kolmogorov Complexity and Googling
15 0.065498598 329 hunch net-2008-11-28-A Bumper Crop of Machine Learning Graduates
16 0.060593344 68 hunch net-2005-05-10-Learning Reductions are Reductionist
17 0.054398909 47 hunch net-2005-03-28-Open Problems for Colt
18 0.052873902 355 hunch net-2009-05-19-CI Fellows
19 0.051952615 396 hunch net-2010-04-28-CI Fellows program renewed
20 0.051700268 445 hunch net-2011-09-28-Somebody’s Eating Your Lunch
topicId topicWeight
[(0, 0.1), (1, -0.024), (2, -0.062), (3, 0.071), (4, -0.038), (5, -0.042), (6, 0.016), (7, 0.043), (8, 0.014), (9, -0.001), (10, 0.055), (11, -0.014), (12, -0.05), (13, -0.054), (14, -0.037), (15, -0.053), (16, 0.054), (17, 0.049), (18, 0.03), (19, 0.029), (20, 0.02), (21, 0.004), (22, -0.06), (23, 0.06), (24, -0.043), (25, -0.074), (26, 0.074), (27, 0.046), (28, 0.039), (29, 0.106), (30, -0.033), (31, 0.096), (32, -0.014), (33, -0.013), (34, 0.076), (35, 0.016), (36, -0.076), (37, 0.048), (38, -0.044), (39, 0.067), (40, 0.028), (41, 0.058), (42, -0.043), (43, 0.053), (44, 0.027), (45, 0.043), (46, 0.006), (47, -0.012), (48, 0.08), (49, -0.056)]
simIndex simValue blogId blogTitle
same-blog 1 0.98813391 64 hunch net-2005-04-28-Science Fiction and Research
Introduction: A big part of doing research is imagining how things could be different, and then trying to figure out how to get there. A big part of science fiction is imagining how things could be different, and then working through the implications. Because of the similarity here, reading science fiction can sometimes be helpful in understanding and doing research. (And, hey, it’s fun.) Here’s some list of science fiction books I enjoyed which seem particularly relevant to computer science and (sometimes) learning systems: Vernor Vinge, “True Names”, “A Fire Upon the Deep” Marc Stiegler, “David’s Sling”, “Earthweb” Charles Stross, “Singularity Sky” Greg Egan, “Diaspora” Joe Haldeman, “Forever Peace” (There are surely many others.) Incidentally, the nature of science fiction itself has changed. Decades ago, science fiction projected great increases in the power humans control (example: E.E. Smith Lensman series). That didn’t really happen in the last 50 years. Inste
2 0.65442008 112 hunch net-2005-09-14-The Predictionist Viewpoint
Introduction: Virtually every discipline of significant human endeavor has a way explaining itself as fundamental and important. In all the cases I know of, they are both right (they are vital) and wrong (they are not solely vital). Politics. This is the one that everyone is familiar with at the moment. “What could be more important than the process of making decisions?” Science and Technology. This is the one that we-the-academics are familiar with. “The loss of modern science and technology would be catastrophic.” Military. “Without the military, a nation will be invaded and destroyed.” (insert your favorite here) Within science and technology, the same thing happens again. Mathematics. “What could be more important than a precise language for establishing truths?” Physics. “Nothing is more fundamental than the laws which govern the universe. Understanding them is the key to understanding everything else.” Biology. “Without life, we wouldn’t be here, so clearly the s
3 0.63899028 282 hunch net-2008-01-06-Research Political Issues
Introduction: I’ve avoided discussing politics here, although not for lack of interest. The problem with discussing politics is that it’s customary for people to say much based upon little information. Nevertheless, politics can have a substantial impact on science (and we might hope for the vice-versa). It’s primary election time in the United States, so the topic is timely, although the issues are not. There are several policy decisions which substantially effect development of science and technology in the US. Education The US has great contrasts in education. The top universities are very good places, yet the grade school education system produces mediocre results. For me, the contrast between a public education and Caltech was bracing. For many others attending Caltech, it clearly was not. Upgrading the k-12 education system in the US is a long-standing chronic problem which I know relatively little about. My own experience is that a basic attitude of “no child unrealized” i
4 0.6098361 106 hunch net-2005-09-04-Science in the Government
Introduction: I found the article on “ Political Science ” at the New York Times interesting. Essentially the article is about allegations that the US government has been systematically distorting scientific views. With a petition by some 7000+ scientists alleging such behavior this is clearly a significant concern. One thing not mentioned explicitly in this discussion is that there are fundamental cultural differences between academic research and the rest of the world. In academic research, careful, clear thought is valued. This value is achieved by both formal and informal mechanisms. One example of a formal mechanism is peer review. In contrast, in the land of politics, the basic value is agreement. It is only with some amount of agreement that a new law can be passed or other actions can be taken. Since Science (with a capitol ‘S’) has accomplished many things, it can be a significant tool in persuading people. This makes it compelling for a politician to use science as a mec
5 0.59507859 340 hunch net-2009-01-28-Nielsen’s talk
Introduction: I wanted to point to Michael Nielsen’s talk about blogging science, which I found interesting.
6 0.58376282 228 hunch net-2007-01-15-The Machine Learning Department
7 0.5648061 414 hunch net-2010-10-17-Partha Niyogi has died
8 0.55255932 366 hunch net-2009-08-03-Carbon in Computer Science Research
9 0.54750127 10 hunch net-2005-02-02-Kolmogorov Complexity and Googling
10 0.51309866 296 hunch net-2008-04-21-The Science 2.0 article
11 0.44574296 386 hunch net-2010-01-13-Sam Roweis died
12 0.44453356 329 hunch net-2008-11-28-A Bumper Crop of Machine Learning Graduates
13 0.42663959 295 hunch net-2008-04-12-It Doesn’t Stop
14 0.42592531 355 hunch net-2009-05-19-CI Fellows
15 0.42091247 108 hunch net-2005-09-06-A link
16 0.39934489 314 hunch net-2008-08-24-Mass Customized Medicine in the Future?
17 0.39838874 146 hunch net-2006-01-06-MLTV
18 0.39548159 50 hunch net-2005-04-01-Basic computer science research takes a hit
19 0.3895703 69 hunch net-2005-05-11-Visa Casualties
20 0.38917142 68 hunch net-2005-05-10-Learning Reductions are Reductionist
topicId topicWeight
[(3, 0.02), (27, 0.153), (53, 0.087), (55, 0.039), (94, 0.09), (99, 0.479)]
simIndex simValue blogId blogTitle
same-blog 1 0.87562537 64 hunch net-2005-04-28-Science Fiction and Research
Introduction: A big part of doing research is imagining how things could be different, and then trying to figure out how to get there. A big part of science fiction is imagining how things could be different, and then working through the implications. Because of the similarity here, reading science fiction can sometimes be helpful in understanding and doing research. (And, hey, it’s fun.) Here’s some list of science fiction books I enjoyed which seem particularly relevant to computer science and (sometimes) learning systems: Vernor Vinge, “True Names”, “A Fire Upon the Deep” Marc Stiegler, “David’s Sling”, “Earthweb” Charles Stross, “Singularity Sky” Greg Egan, “Diaspora” Joe Haldeman, “Forever Peace” (There are surely many others.) Incidentally, the nature of science fiction itself has changed. Decades ago, science fiction projected great increases in the power humans control (example: E.E. Smith Lensman series). That didn’t really happen in the last 50 years. Inste
2 0.70439339 451 hunch net-2011-12-13-Vowpal Wabbit version 6.1 & the NIPS tutorial
Introduction: I just made version 6.1 of Vowpal Wabbit . Relative to 6.0 , there are few new features, but many refinements. The cluster parallel learning code better supports multiple simultaneous runs, and other forms of parallelism have been mostly removed. This incidentally significantly simplifies the learning core. The online learning algorithms are more general, with support for l 1 (via a truncated gradient variant) and l 2 regularization, and a generalized form of variable metric learning. There is a solid persistent server mode which can train online, as well as serve answers to many simultaneous queries, either in text or binary. This should be a very good release if you are just getting started, as we’ve made it compile more automatically out of the box, have several new examples and updated documentation. As per tradition , we’re planning to do a tutorial at NIPS during the break at the parallel learning workshop at 2pm Spanish time Friday. I’ll cover the
3 0.37520522 286 hunch net-2008-01-25-Turing’s Club for Machine Learning
Introduction: Many people in Machine Learning don’t fully understand the impact of computation, as demonstrated by a lack of big-O analysis of new learning algorithms. This is important—some current active research programs are fundamentally flawed w.r.t. computation, and other research programs are directly motivated by it. When considering a learning algorithm, I think about the following questions: How does the learning algorithm scale with the number of examples m ? Any algorithm using all of the data is at least O(m) , but in many cases this is O(m 2 ) (naive nearest neighbor for self-prediction) or unknown (k-means or many other optimization algorithms). The unknown case is very common, and it can mean (for example) that the algorithm isn’t convergent or simply that the amount of computation isn’t controlled. The above question can also be asked for test cases. In some applications, test-time performance is of great importance. How does the algorithm scale with the number of
4 0.37140268 366 hunch net-2009-08-03-Carbon in Computer Science Research
Introduction: Al Gore ‘s film and gradually more assertive and thorough science has managed to mostly shift the debate on climate change from “Is it happening?” to “What should be done?” In that context, it’s worthwhile to think a bit about what can be done within computer science research. There are two things we can think about: Doing Research At a cartoon level, computer science research consists of some combination of commuting to&from; work, writing programs, running them on computers, writing papers, and presenting them at conferences. A typical computer has a power usage on the order of 100 Watts, which works out to 2.4 kiloWatt-hours/day. Looking up David MacKay ‘s reference on power usage per person , it becomes clear that this is a relatively minor part of the lifestyle, although it could become substantial if many more computers are required. Much larger costs are associated with commuting (which is in common with many people) and attending conferences. Since local commuti
5 0.3708863 435 hunch net-2011-05-16-Research Directions for Machine Learning and Algorithms
Introduction: Muthu invited me to the workshop on algorithms in the field , with the goal of providing a sense of where near-term research should go. When the time came though, I bargained for a post instead, which provides a chance for many other people to comment. There are several things I didn’t fully understand when I went to Yahoo! about 5 years ago. I’d like to repeat them as people in academia may not yet understand them intuitively. Almost all the big impact algorithms operate in pseudo-linear or better time. Think about caching, hashing, sorting, filtering, etc… and you have a sense of what some of the most heavily used algorithms are. This matters quite a bit to Machine Learning research, because people often work with superlinear time algorithms and languages. Two very common examples of this are graphical models, where inference is often a superlinear operation—think about the n 2 dependence on the number of states in a Hidden Markov Model and Kernelized Support Vecto
6 0.36961383 347 hunch net-2009-03-26-Machine Learning is too easy
7 0.36694735 253 hunch net-2007-07-06-Idempotent-capable Predictors
8 0.36634281 201 hunch net-2006-08-07-The Call of the Deep
9 0.36615291 158 hunch net-2006-02-24-A Fundamentalist Organization of Machine Learning
10 0.36552161 359 hunch net-2009-06-03-Functionally defined Nonlinear Dynamic Models
11 0.36522657 337 hunch net-2009-01-21-Nearly all natural problems require nonlinearity
12 0.36475888 237 hunch net-2007-04-02-Contextual Scaling
13 0.36462373 358 hunch net-2009-06-01-Multitask Poisoning
14 0.36442968 96 hunch net-2005-07-21-Six Months
15 0.36442265 351 hunch net-2009-05-02-Wielding a New Abstraction
16 0.3641876 258 hunch net-2007-08-12-Exponentiated Gradient
17 0.36382568 152 hunch net-2006-01-30-Should the Input Representation be a Vector?
18 0.36333829 95 hunch net-2005-07-14-What Learning Theory might do
19 0.3619408 78 hunch net-2005-06-06-Exact Online Learning for Classification
20 0.36182928 370 hunch net-2009-09-18-Necessary and Sufficient Research