hunch_net hunch_net-2010 hunch_net-2010-386 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: and I can’t help but remember him. I first met Sam as an undergraduate at Caltech where he was TA for Hopfield ‘s class, and again when I visited Gatsby , when he invited me to visit Toronto , and at too many conferences to recount. His personality was a combination of enthusiastic and thoughtful, with a great ability to phrase a problem so it’s solution must be understood. With respect to my own work, Sam was the one who advised me to make my first tutorial , leading to others, and to other things, all of which I’m grateful to him for. In fact, my every interaction with Sam was positive, and that was his way. His death is being called a suicide which is so incompatible with my understanding of Sam that it strains my credibility. But we know that his many responsibilities were great, and it is well understood that basically all sane researchers have legions of inner doubts. Having been depressed now and then myself, it’s helpful to understand at least intellectually
sentIndex sentText sentNum sentScore
1 I first met Sam as an undergraduate at Caltech where he was TA for Hopfield ‘s class, and again when I visited Gatsby , when he invited me to visit Toronto , and at too many conferences to recount. [sent-2, score-0.321]
2 His personality was a combination of enthusiastic and thoughtful, with a great ability to phrase a problem so it’s solution must be understood. [sent-3, score-0.296]
3 With respect to my own work, Sam was the one who advised me to make my first tutorial , leading to others, and to other things, all of which I’m grateful to him for. [sent-4, score-0.076]
4 In fact, my every interaction with Sam was positive, and that was his way. [sent-5, score-0.153]
5 His death is being called a suicide which is so incompatible with my understanding of Sam that it strains my credibility. [sent-6, score-0.102]
6 But we know that his many responsibilities were great, and it is well understood that basically all sane researchers have legions of inner doubts. [sent-7, score-0.275]
7 Having been depressed now and then myself, it’s helpful to understand at least intellectually that the true darkness of the now is overestimated, and that you have more friends than you think. [sent-8, score-0.392]
8 My last interaction with Sam, last week, was discussing a new research direction that interested him, optimizing the cost of acquiring feature information in the learning algorithm. [sent-10, score-0.468]
9 This problem is endemic to real-world applications, and has been studied to some extent elsewhere, but I expect that in our unwritten future history, we’ll discover that further study of this problem is more helpful than almost anyone realizes. [sent-11, score-0.329]
10 The reply that I owed him feels heavy, and an incompleteness is hanging. [sent-12, score-0.199]
11 For his wife and children it is surely so incomparably greater that I lack words. [sent-13, score-0.281]
wordName wordTfidf (topN-words)
[('sam', 0.645), ('memorial', 0.221), ('interaction', 0.153), ('fortnow', 0.11), ('inner', 0.11), ('overestimated', 0.11), ('depressed', 0.11), ('kevin', 0.11), ('intellectually', 0.11), ('toronto', 0.11), ('wife', 0.11), ('enthusiastic', 0.102), ('personality', 0.102), ('feels', 0.102), ('children', 0.102), ('incompatible', 0.102), ('reply', 0.097), ('heavy', 0.097), ('yisong', 0.097), ('yue', 0.097), ('thoughtful', 0.092), ('fund', 0.092), ('sane', 0.092), ('acquiring', 0.092), ('mine', 0.092), ('fernando', 0.092), ('phrase', 0.092), ('helpful', 0.092), ('lance', 0.088), ('endemic', 0.088), ('caltech', 0.088), ('ll', 0.087), ('undergraduate', 0.085), ('history', 0.083), ('others', 0.083), ('friends', 0.08), ('studied', 0.08), ('visit', 0.08), ('miss', 0.078), ('week', 0.078), ('met', 0.078), ('elsewhere', 0.078), ('visited', 0.078), ('leading', 0.076), ('discussing', 0.075), ('last', 0.074), ('basically', 0.073), ('discover', 0.069), ('remember', 0.069), ('surely', 0.069)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 386 hunch net-2010-01-13-Sam Roweis died
Introduction: and I can’t help but remember him. I first met Sam as an undergraduate at Caltech where he was TA for Hopfield ‘s class, and again when I visited Gatsby , when he invited me to visit Toronto , and at too many conferences to recount. His personality was a combination of enthusiastic and thoughtful, with a great ability to phrase a problem so it’s solution must be understood. With respect to my own work, Sam was the one who advised me to make my first tutorial , leading to others, and to other things, all of which I’m grateful to him for. In fact, my every interaction with Sam was positive, and that was his way. His death is being called a suicide which is so incompatible with my understanding of Sam that it strains my credibility. But we know that his many responsibilities were great, and it is well understood that basically all sane researchers have legions of inner doubts. Having been depressed now and then myself, it’s helpful to understand at least intellectually
2 0.20637819 491 hunch net-2013-11-21-Ben Taskar is gone
Introduction: I was not as personally close to Ben as Sam , but the level of tragedy is similar and I can’t help but be greatly saddened by the loss. Various news stories have coverage, but the synopsis is that he had a heart attack on Sunday and is survived by his wife Anat and daughter Aviv. There is discussion of creating a memorial fund for them, which I hope comes to fruition, and plan to contribute to. I will remember Ben as someone who thought carefully and comprehensively about new ways to do things, then fought hard and successfully for what he believed in. It is an ideal we strive for, that Ben accomplished. Edit: donations go here , and more information is here .
3 0.09511286 376 hunch net-2009-11-06-Yisong Yue on Self-improving Systems
Introduction: I’d like to point out Yisong Yue ‘s post on Self-improving systems , which is a nicely readable description of the necessity and potential of interactive learning to deal with the information overload problem that is endemic to the modern internet.
4 0.089746594 293 hunch net-2008-03-23-Interactive Machine Learning
Introduction: A new direction of research seems to be arising in machine learning: Interactive Machine Learning. This isn’t a familiar term, although it does include some familiar subjects. What is Interactive Machine Learning? The fundamental requirement is (a) learning algorithms which interact with the world and (b) learn. For our purposes, let’s define learning as efficiently competing with a large set of possible predictors. Examples include: Online learning against an adversary ( Avrim’s Notes ). The interaction is almost trivial: the learning algorithm makes a prediction and then receives feedback. The learning is choosing based upon the advice of many experts. Active Learning . In active learning, the interaction is choosing which examples to label, and the learning is choosing from amongst a large set of hypotheses. Contextual Bandits . The interaction is choosing one of several actions and learning only the value of the chosen action (weaker than active learning
5 0.081756912 192 hunch net-2006-07-08-Some recent papers
Introduction: It was a fine time for learning in Pittsburgh. John and Sam mentioned some of my favorites. Here’s a few more worth checking out: Online Multitask Learning Ofer Dekel, Phil Long, Yoram Singer This is on my reading list. Definitely an area I’m interested in. Maximum Entropy Distribution Estimation with Generalized Regularization Miroslav DudÃÂk, Robert E. Schapire Learning near-optimal policies with Bellman-residual minimization based fitted policy iteration and a single sample path András Antos, Csaba Szepesvári, Rémi Munos Again, on the list to read. I saw Csaba and Remi talk about this and related work at an ICML Workshop on Kernel Reinforcement Learning. The big question in my head is how this compares/contrasts with existing work in reductions to reinforcement learning. Are there advantages/disadvantages? Higher Order Learning On Graphs> by Sameer Agarwal, Kristin Branson, and Serge Belongie, looks to be interesteding. They seem to poo-poo “tensorization
6 0.074343696 39 hunch net-2005-03-10-Breaking Abstractions
7 0.072633967 264 hunch net-2007-09-30-NIPS workshops are out.
8 0.066802733 449 hunch net-2011-11-26-Giving Thanks
9 0.059729755 370 hunch net-2009-09-18-Necessary and Sufficient Research
10 0.058598325 22 hunch net-2005-02-18-What it means to do research.
11 0.057717264 384 hunch net-2009-12-24-Top graduates this season
12 0.051638987 420 hunch net-2010-12-26-NIPS 2010
13 0.049472146 358 hunch net-2009-06-01-Multitask Poisoning
14 0.048376989 158 hunch net-2006-02-24-A Fundamentalist Organization of Machine Learning
15 0.048181918 151 hunch net-2006-01-25-1 year
16 0.047209825 414 hunch net-2010-10-17-Partha Niyogi has died
17 0.046719942 282 hunch net-2008-01-06-Research Political Issues
18 0.046594165 435 hunch net-2011-05-16-Research Directions for Machine Learning and Algorithms
19 0.04565876 203 hunch net-2006-08-18-Report of MLSS 2006 Taipei
20 0.04544767 116 hunch net-2005-09-30-Research in conferences
topicId topicWeight
[(0, 0.113), (1, -0.017), (2, -0.057), (3, 0.039), (4, -0.029), (5, -0.003), (6, 0.019), (7, -0.001), (8, 0.001), (9, 0.011), (10, 0.007), (11, -0.041), (12, 0.004), (13, 0.033), (14, -0.024), (15, -0.018), (16, -0.018), (17, 0.01), (18, 0.054), (19, 0.068), (20, 0.031), (21, 0.008), (22, -0.03), (23, -0.034), (24, -0.012), (25, 0.009), (26, 0.03), (27, 0.056), (28, -0.039), (29, 0.07), (30, -0.0), (31, -0.06), (32, -0.024), (33, -0.049), (34, 0.018), (35, 0.025), (36, -0.028), (37, -0.014), (38, -0.031), (39, 0.186), (40, 0.073), (41, 0.006), (42, -0.012), (43, 0.078), (44, -0.05), (45, 0.005), (46, -0.08), (47, 0.007), (48, 0.019), (49, 0.036)]
simIndex simValue blogId blogTitle
same-blog 1 0.96131593 386 hunch net-2010-01-13-Sam Roweis died
Introduction: and I can’t help but remember him. I first met Sam as an undergraduate at Caltech where he was TA for Hopfield ‘s class, and again when I visited Gatsby , when he invited me to visit Toronto , and at too many conferences to recount. His personality was a combination of enthusiastic and thoughtful, with a great ability to phrase a problem so it’s solution must be understood. With respect to my own work, Sam was the one who advised me to make my first tutorial , leading to others, and to other things, all of which I’m grateful to him for. In fact, my every interaction with Sam was positive, and that was his way. His death is being called a suicide which is so incompatible with my understanding of Sam that it strains my credibility. But we know that his many responsibilities were great, and it is well understood that basically all sane researchers have legions of inner doubts. Having been depressed now and then myself, it’s helpful to understand at least intellectually
2 0.73174441 491 hunch net-2013-11-21-Ben Taskar is gone
Introduction: I was not as personally close to Ben as Sam , but the level of tragedy is similar and I can’t help but be greatly saddened by the loss. Various news stories have coverage, but the synopsis is that he had a heart attack on Sunday and is survived by his wife Anat and daughter Aviv. There is discussion of creating a memorial fund for them, which I hope comes to fruition, and plan to contribute to. I will remember Ben as someone who thought carefully and comprehensively about new ways to do things, then fought hard and successfully for what he believed in. It is an ideal we strive for, that Ben accomplished. Edit: donations go here , and more information is here .
3 0.66431642 376 hunch net-2009-11-06-Yisong Yue on Self-improving Systems
Introduction: I’d like to point out Yisong Yue ‘s post on Self-improving systems , which is a nicely readable description of the necessity and potential of interactive learning to deal with the information overload problem that is endemic to the modern internet.
4 0.56374913 384 hunch net-2009-12-24-Top graduates this season
Introduction: I would like to point out 3 graduates this season as having my confidence they are capable of doing great things. Daniel Hsu has diverse papers with diverse coauthors on {active learning, mulitlabeling, temporal learning, …} each covering new algorithms and methods of analysis. He is also a capable programmer, having helped me with some nitty-gritty details of cluster parallel Vowpal Wabbit this summer. He has an excellent tendency to just get things done. Nicolas Lambert doesn’t nominally work in machine learning, but I’ve found his work in elicitation relevant nevertheless. In essence, elicitable properties are closely related to learnable properties, and the elicitation complexity is related to a notion of learning complexity. See the Surrogate regret bounds paper for some related discussion. Few people successfully work at such a general level that it crosses fields, but he’s one of them. Yisong Yue is deeply focused on interactive learning, which he has a
5 0.50329089 370 hunch net-2009-09-18-Necessary and Sufficient Research
Introduction: Researchers are typically confronted with big problems that they have no idea how to solve. In trying to come up with a solution, a natural approach is to decompose the big problem into a set of subproblems whose solution yields a solution to the larger problem. This approach can go wrong in several ways. Decomposition failure . The solution to the decomposition does not in fact yield a solution to the overall problem. Artificial hardness . The subproblems created are sufficient if solved to solve the overall problem, but they are harder than necessary. As you can see, computational complexity forms a relatively new (in research-history) razor by which to judge an approach sufficient but not necessary. In my experience, the artificial hardness problem is very common. Many researchers abdicate the responsibility of choosing a problem to work on to other people. This process starts very naturally as a graduate student, when an incoming student might have relatively l
6 0.49817142 222 hunch net-2006-12-05-Recruitment Conferences
7 0.48450375 256 hunch net-2007-07-20-Motivation should be the Responsibility of the Reviewer
8 0.48309198 366 hunch net-2009-08-03-Carbon in Computer Science Research
9 0.46251622 22 hunch net-2005-02-18-What it means to do research.
10 0.45920721 293 hunch net-2008-03-23-Interactive Machine Learning
11 0.45865405 212 hunch net-2006-10-04-Health of Conferences Wiki
12 0.4557716 64 hunch net-2005-04-28-Science Fiction and Research
13 0.44854859 358 hunch net-2009-06-01-Multitask Poisoning
14 0.43896082 68 hunch net-2005-05-10-Learning Reductions are Reductionist
15 0.4363344 307 hunch net-2008-07-04-More Presentation Preparation
16 0.43162736 91 hunch net-2005-07-10-Thinking the Unthought
17 0.42901245 410 hunch net-2010-09-17-New York Area Machine Learning Events
18 0.42668334 193 hunch net-2006-07-09-The Stock Prediction Machine Learning Problem
19 0.42554843 329 hunch net-2008-11-28-A Bumper Crop of Machine Learning Graduates
20 0.42460731 106 hunch net-2005-09-04-Science in the Government
topicId topicWeight
[(10, 0.01), (13, 0.496), (27, 0.155), (38, 0.023), (53, 0.086), (54, 0.034), (55, 0.035), (94, 0.027), (95, 0.028)]
simIndex simValue blogId blogTitle
1 0.97877848 214 hunch net-2006-10-13-David Pennock starts Oddhead
Introduction: his blog on information markets and other research topics .
2 0.91251785 137 hunch net-2005-12-09-Machine Learning Thoughts
Introduction: I added a link to Olivier Bousquet’s machine learning thoughts blog. Several of the posts may be of interest.
3 0.90393019 117 hunch net-2005-10-03-Not ICML
Introduction: Alex Smola showed me this ICML 2006 webpage. This is NOT the ICML we know, but rather some people at “Enformatika”. Investigation shows that they registered with an anonymous yahoo email account from dotregistrar.com the “Home of the $6.79 wholesale domain!” and their nameservers are by Turkticaret , a Turkish internet company. It appears the website has since been altered to “ ICNL ” (the above link uses the google cache). They say that imitation is the sincerest form of flattery, so the organizers of the real ICML 2006 must feel quite flattered.
4 0.88347799 212 hunch net-2006-10-04-Health of Conferences Wiki
Introduction: Aaron Hertzmann points out the health of conferences wiki , which has a great deal of information about how many different conferences function.
same-blog 5 0.85730731 386 hunch net-2010-01-13-Sam Roweis died
Introduction: and I can’t help but remember him. I first met Sam as an undergraduate at Caltech where he was TA for Hopfield ‘s class, and again when I visited Gatsby , when he invited me to visit Toronto , and at too many conferences to recount. His personality was a combination of enthusiastic and thoughtful, with a great ability to phrase a problem so it’s solution must be understood. With respect to my own work, Sam was the one who advised me to make my first tutorial , leading to others, and to other things, all of which I’m grateful to him for. In fact, my every interaction with Sam was positive, and that was his way. His death is being called a suicide which is so incompatible with my understanding of Sam that it strains my credibility. But we know that his many responsibilities were great, and it is well understood that basically all sane researchers have legions of inner doubts. Having been depressed now and then myself, it’s helpful to understand at least intellectually
6 0.5493409 492 hunch net-2013-12-01-NIPS tutorials and Vowpal Wabbit 7.4
7 0.51325709 312 hunch net-2008-08-04-Electoralmarkets.com
8 0.50545555 406 hunch net-2010-08-22-KDD 2010
9 0.47230035 51 hunch net-2005-04-01-The Producer-Consumer Model of Research
10 0.34495384 217 hunch net-2006-11-06-Data Linkage Problems
11 0.34323907 478 hunch net-2013-01-07-NYU Large Scale Machine Learning Class
12 0.34185782 201 hunch net-2006-08-07-The Call of the Deep
13 0.34021083 149 hunch net-2006-01-18-Is Multitask Learning Black-Boxable?
14 0.33895099 227 hunch net-2007-01-10-A Deep Belief Net Learning Problem
15 0.33877537 12 hunch net-2005-02-03-Learning Theory, by assumption
16 0.33832437 370 hunch net-2009-09-18-Necessary and Sufficient Research
17 0.33728719 131 hunch net-2005-11-16-The Everything Ensemble Edge
18 0.33680186 347 hunch net-2009-03-26-Machine Learning is too easy
19 0.33641437 345 hunch net-2009-03-08-Prediction Science
20 0.33572999 158 hunch net-2006-02-24-A Fundamentalist Organization of Machine Learning