nips nips2008 nips2008-138 nips2008-138-reference knowledge-graph by maker-knowledge-mining

138 nips-2008-Modeling human function learning with Gaussian processes


Source: pdf

Author: Thomas L. Griffiths, Chris Lucas, Joseph Williams, Michael L. Kalish

Abstract: Accounts of how people learn functional relationships between continuous variables have tended to focus on two possibilities: that people are estimating explicit functions, or that they are performing associative learning supported by similarity. We provide a rational analysis of function learning, drawing on work on regression in machine learning and statistics. Using the equivalence of Bayesian linear regression and Gaussian processes, we show that learning explicit rules and using similarity can be seen as two views of one solution to this problem. We use this insight to define a Gaussian process model of human function learning that combines the strengths of both approaches. 1


reference text

[1] J. D. Carroll. Functional learning: The learning of continuous functional mappings relating stimulus and response continua. Education Testing Service, Princeton, NJ, 1963.

[2] B. Brehmer. Hypotheses about relations between scaled variables in the learning of probabilistic inference tasks. Organizational Behavior and Human Decision Processes, 11:1–27, 1974.

[3] K. Koh and D. E. Meyer. Function learning: Induction of continuous stimulus-response relations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17:811–836, 1991.

[4] E. L. DeLosh, J. R. Busemeyer, and M. A. McDaniel. Extrapolation: The sine qua non of abstraction in function learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23:968–986, 1997.

[5] J. R. Busemeyer, E. Byun, E. L. DeLosh, and M. A. McDaniel. Learning functional relations based on experience with input-output pairs by humans and artificial neural networks. In K. Lamberts and D. Shanks, editors, Concepts and Categories, pages 405–437. MIT Press, Cambridge, 1997.

[6] M. A. McDaniel and J. R. Busemeyer. The conceptual basis of function learning and extrapolation: Comparison of rule-based and associative-based models. Psychonomic Bulletin and Review, 12:24–42, 2005.

[7] M. Kalish, S. Lewandowsky, and J. Kruschke. Population of linear experts: Knowledge partitioning and function learning. Psychological Review, 111:1072–1099, 2004.

[8] J. R. Anderson. The adaptive character of thought. Erlbaum, Hillsdale, NJ, 1990.

[9] J. M. Bernardo and A. F. M. Smith. Bayesian theory. Wiley, New York, 1994.

[10] C. K. I. Williams. Prediction with Gaussian processes: From linear regression to linear prediction and beyond. In M. I. Jordan, editor, Learning in Graphical Models, pages 599–621. MIT Press, Cambridge, MA, 1998.

[11] R. M. Neal. Priors for infinite networks. Technical Report CRG-TR-94-1, Department of Computer Science, University of Toronto, 1994.

[12] D.J.C. MacKay. Probable networks and plausible predictions - a review of practical bayesian methods for supervised neural networks. Network: Computation in Neural Systems, 6:469–505, 1995.

[13] W.R. Gilks, S. Richardson, and D. J. Spiegelhalter, editors. Markov Chain Monte Carlo in Practice. Chapman and Hall, Suffolk, UK, 1996. 8