nips nips2003 nips2003-51 nips2003-51-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Liam Paninski
Abstract: We discuss an idea for collecting data in a relatively efficient manner. Our point of view is Bayesian and information-theoretic: on any given trial, we want to adaptively choose the input in such a way that the mutual information between the (unknown) state of the system and the (stochastic) output is maximal, given any prior information (including data collected on any previous trials). We prove a theorem that quantifies the effectiveness of this strategy and give a few illustrative examples comparing the performance of this adaptive technique to that of the more usual nonadaptive experimental design. For example, we are able to explicitly calculate the asymptotic relative efficiency of the “staircase method” widely employed in psychophysics research, and to demonstrate the dependence of this efficiency on the form of the “psychometric function” underlying the output responses. 1
[1] J. Berger, J. Bernardo, and M. Mendoza. Bayesian Statistics 4, chapter On priors that maximize expected information, pages 35–60. Oxford University Press, 1989.
[2] E. Chichilnisky. A simple white noise analysis of neuronal light responses. Network: Computation in Neural Systems, 12:199–213, 2001.
[3] B. Clarke and A. Barron. Information-theoretic asymptotics of Bayes methods. IEEE Transactions on Information Theory, 36:453 – 471, 1990.
[4] B. Clarke and A. Barron. Jeffreys’ prior is asymptotically least favorable under entropy risk. Journal of Statistical Planning Inference, 41:37–60, 1994.
[5] P. Deignan, P. Meckl, M. Franchek, J. Abraham, and S. Jaliwala. Using mutual information to pre-process input data for a virtual sensor. In ACC, number ASME0043 in American Control Conference, 2000.
[6] L. Kontsevich and C. Tyler. Bayesian adaptive estimation of psychometric slope and threshold. Vision Research, 39:2729–2737, 1999.
[7] M. Mascaro and D. Bradley. Optimized neuronal tuning algorithm for multichannel recording. Unpublished abstract at http://www.compscipreprints.com/, 2002.
[8] L. Paninski. Convergence properties of some spike-triggered analysis techniques. Network: Computation in Neural Systems, 14:437–464, 2003.
[9] D. Pelli. The ideal psychometric procedure. Investigative Ophthalmology and Visual Science (Supplement), 28:366, 1987.
[10] H. R. Scholl. Shannon optimal priors on iid statistical experiments converge weakly to jeffreys’ prior. Available at citeseer.nj.nec.com/104699.html, 1998.
[11] M. Talagrand. Concentration of measure and isoperimetric inequalities in product spaces. Publ. Math. IHES, 81:73–205, 1995.
[12] A. van der Vaart. Asymptotic statistics. Cambridge University Press, Cambridge, 1998.
[13] A. Watson and A. Fitzhugh. The method of constant stimuli is inefficient. Perception and Psychophysics, 47:87–91, 1990.
[14] A. Watson and D. Pelli. QUEST: a Bayesian adaptive psychophysical method. Perception and Psychophysics, 33:113–120, 1983.