Kinds of Learning (Q&A) inductive learning and the acquisition of new knowledge, Come up with some function, Inductive Bias definition, Occam’s Razor, Probably Approximately Correct (PAC) Learning, Version Space. | Kinds of Learning (Q&A) • What do you associate with the term learning? What is for you the prototypical learning task? •Memorization and rote learning like flashcards? •Skill acquisition such as learning to ski or learning to do symbolic integration? •Theory or discovery learning like discovering a new economics model for predicting market fluctuations? CS-424 Gregory Dudek Inductive • inductive learning and the acquisition of new knowledge – inferring generalities from particulars - note that this type of learning is not sound - ., learn what foods served at the cafeteria are digestible CS-424 Gregory Dudek Deductive • deductive learning and the organization of existing knowledge – making explicit deductive consequences of existing axioms - this type of learning generally is sound - ., expedite deductive inference by adding new axioms from forall x, loves(x,x) and forall x,y, loves(x,y) -> (has-money(x) -> pay-bill(x,y)) we can conclude that forall x, has-money(x) -> pay-bill(x,x) – How can this axiom expedite deductive inference? – Could this axiom possibly slow deductive inference? CS-424 Gregory Dudek Lecture 14 • Learning – Inductive inference – Probably approximately correct learning CS-424 Gregory Dudek Learning: formalism Come up with some function f such that • f(x) = y for all training examples (x,y) and • f (somehow) generalizes to yet unseen examples. – In practice, we don’t always do it perfectly. CS-424 Gregory .
