|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
40th Annual Symposium on Foundations of Computer Science
An Algorithmic Theory of Learning: Robust Concepts and Random Projection
New York, New York
October 17-October 18
ISBN: 0-7695-0409-4
| ASCII Text | x | ||
| Rosa I. Arriaga, Santosh Vempala, "An Algorithmic Theory of Learning: Robust Concepts and Random Projection," Foundations of Computer Science, IEEE Annual Symposium on, pp. 616, 40th Annual Symposium on Foundations of Computer Science, 1999. | |||
| BibTex | x | ||
| @article{ 10.1109/SFFCS.1999.814637, author = {Rosa I. Arriaga and Santosh Vempala}, title = {An Algorithmic Theory of Learning: Robust Concepts and Random Projection}, journal ={Foundations of Computer Science, IEEE Annual Symposium on}, volume = {0}, year = {1999}, issn = {0272-5428}, pages = {616}, doi = {http://doi.ieeecomputersociety.org/10.1109/SFFCS.1999.814637}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Foundations of Computer Science, IEEE Annual Symposium on TI - An Algorithmic Theory of Learning: Robust Concepts and Random Projection SN - 0272-5428 SP EP A1 - Rosa I. Arriaga, A1 - Santosh Vempala, PY - 1999 KW - Learning KW - randomness KW - algorithms VL - 0 JA - Foundations of Computer Science, IEEE Annual Symposium on ER - | |||
We study the phenomenon of cognitive learning from an algorithmic standpoint. How does the brain effectively learn concepts from a small number of examples, in spite of the fact that each example contains a huge amount of information? We provide a novel analysis for a model of ROBUST concept learning (closely related to ``margin classifiers''), and show that a relatively small number of examples are sufficient to learn rich concept classes (including threshold functions, boolean formulae and polynomial surfaces).As a result, we obtain simple intuitive proofs for the generalization bounds of Support Vector Machines. In addition, the new algorithms have several advantages --- they are faster, conceptually simpler, and highly resistant to noise. For example, a robust half-space can be PAC-learned in linear time using only a constant number of training examples, regardless of the number of attributes. A general (algorithmic) consequence of the model, that "more robust concepts are easier to learn", is supported by a multitude of psychological studies.
Index Terms:
Learning, randomness, algorithms
Citation:
Rosa I. Arriaga, Santosh Vempala, "An Algorithmic Theory of Learning: Robust Concepts and Random Projection," focs, pp.616, 40th Annual Symposium on Foundations of Computer Science, 1999
Usage of this product signifies your acceptance of the Terms of Use.
