nips nips2002 nips2002-121 nips2002-121-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Glenn M. Fung, Olvi L. Mangasarian, Jude W. Shavlik
Abstract: Prior knowledge in the form of multiple polyhedral sets, each belonging to one of two categories, is introduced into a reformulation of a linear support vector machine classifier. The resulting formulation leads to a linear program that can be solved efficiently. Real world examples, from DNA sequencing and breast cancer prognosis, demonstrate the effectiveness of the proposed method. Numerical results show improvement in test set accuracy after the incorporation of prior knowledge into ordinary, data-based linear support vector machine classifiers. One experiment also shows that a linear classifier, based solely on prior knowledge, far outperforms the direct application of prior knowledge rules to classify data. Keywords: use and refinement of prior knowledge, support vector machines, linear programming 1
[1] P. Auer. On learning from multi-instance examples: Empirical evaluation of a theoretical approach. pages 21- 29, 1987.
[2] P. S. Bradley and O. L. Mangasarian. Feature selection via concave minimization and support vector machines. In J. Shavlik, editor, Machine Learning Proceedings of the Fifteenth International Conference{ICML '98), pages 82-90, San
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18] Francisco, California, 1998. Morgan Kaufmann. ftp:/ /ftp.cs.wisc.edu/mathprog/ tech-reports / 98-03. ps. V. Cherkassky and F. Mulier. Learning from Data - Concepts, Theory and Methods. John Wiley & Sons, New York, 1998. S. Cost and S. Salzberg. A weighted nearest neighbor algorithm for learning with symbolic features. Machine Learning, 10:57-58, 1993. T. G. Dietterich, R. H. Lathrop, and T. Lozano-Perez. Solving the multipleinstance problem with axis-parallel rectangles. Artificial Intelligence, 89:31-71, 1998. G. Fung, O. L. Mangasarian, and J. Shavlik. Knowledge-based support vector machine classifiers. Technical Report 01-09, Data Mining Institute, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, November 2001. ftp:/ /ftp.cs.wisc.edu/pub/dmi/tech-reports/01-09.ps. F. Girosi and N. Chan. Prior knowledge and the creation of