TY - GEN
T1 - Learning using privileged information in prototype based models
AU - Fouad, Shereen
AU - Tino, Peter
AU - Raychaudhury, Somak
AU - Schneider, Petra
PY - 2012
Y1 - 2012
N2 - In some pattern analysis problems, there exists expert knowledge, in addition to the original data involved in the classification process. Most of existing approaches ignore such auxiliary (privileged) knowledge. Recently a new learning paradigm - Learning Using Hidden Information - was introduced in the SVM+ framework. This approach is formulated for binary classification and, as typical for many kernel based methods, can scale unfavorably with the number of training examples. In this contribution we present a more direct novel methodology, based on a prototype metric learning model, for incorporation of valuable privileged knowledge. This is done by changing the global metric in the input space, based on distance relations revealed by the privileged information. Our method achieves competitive performance against the SVM+ formulations. We also present a successful application of our method to a large scale multi-class real world problem of galaxy morphology classification.
AB - In some pattern analysis problems, there exists expert knowledge, in addition to the original data involved in the classification process. Most of existing approaches ignore such auxiliary (privileged) knowledge. Recently a new learning paradigm - Learning Using Hidden Information - was introduced in the SVM+ framework. This approach is formulated for binary classification and, as typical for many kernel based methods, can scale unfavorably with the number of training examples. In this contribution we present a more direct novel methodology, based on a prototype metric learning model, for incorporation of valuable privileged knowledge. This is done by changing the global metric in the input space, based on distance relations revealed by the privileged information. Our method achieves competitive performance against the SVM+ formulations. We also present a successful application of our method to a large scale multi-class real world problem of galaxy morphology classification.
KW - Generalized Matrix Learning Vector Quantization (GMLVQ)
KW - Information Theoretic Metric Learning (ITML)
KW - Learning Using Hidden Information (LUHI)
UR - http://www.scopus.com/inward/record.url?scp=84867664602&partnerID=8YFLogxK
UR - https://link.springer.com/chapter/10.1007%2F978-3-642-33266-1_40
U2 - 10.1007/978-3-642-33266-1_40
DO - 10.1007/978-3-642-33266-1_40
M3 - Conference publication
AN - SCOPUS:84867664602
SN - 9783642332654
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 322
EP - 329
BT - Artificial Neural Networks and Machine Learning, ICANN 2012 - 22nd International Conference on Artificial Neural Networks, Proceedings
PB - Springer
T2 - 22nd International Conference on Artificial Neural Networks, ICANN 2012
Y2 - 11 September 2012 through 14 September 2012
ER -