The Community for Technology Leaders
Neural Networks, IEEE - INNS - ENNS International Joint Conference on (2000)
Como, Italy
July 24, 2000 to July 27, 2000
ISSN: 1098-7576
ISBN: 0-7695-0619-4
pp: 1009
Joumana Ghosn , Universit? de Montr?al
Yoshua Bengio , Universit? de Montr?al
ABSTRACT
Biasing the hypothesis space of a learner has been shown to improve generalization performances. Methods for achieving this goal have been proposed, that range from deriving and introducing a bias into a learner to automatically learning the bias. In the latter case, most methods learn the bias by simultaneously training several related tasks derived from the same domain and imposing constraints on their parameters. We extend some of the ideas presented in this field and describe a new model that parameterizes the parameters of each task as a function of an affine manifold defined in parameter space and a point lying on the manifold. An analysis of variance on a class of learning tasks is performed that shows some significantly improved performances when using the model.
INDEX TERMS
CITATION

Y. Bengio and J. Ghosn, "Bias Learning, Knowledge Sharing," Neural Networks, IEEE - INNS - ENNS International Joint Conference on(IJCNN), Como, Italy, 2000, pp. 1009.
doi:10.1109/IJCNN.2000.857806
83 ms
(Ver 3.3 (11022016))