under the hood our brains share one remarkable skill: the ability to reason about how one thing relates to another
Knowledge Representation & Reasoning (KRR) is the field of artificial intelligence
- Knowledge Representation - representing knowledge about the world into computer-sensible format
- Knowledge Reasoning or Machine Reasoning (MR)
- algebraically manipulating previously acquired knowledge in order to answer a new question
- generating new knowledge from previously acquired knowledge by applying reasoning or more specifically logical reasoning techniques (e.g. deduction, induction, etc)
KRR/MR - MR is Hard
There is a hard problem with creating machine that understand:
- under the hood our brains share one remarkable skill: the ability to reason about how one thing relates to another
For example, I could know a sequence of mathematical steps in order to get the final result. But knowing the steps versus understanding why the steps are the way it is, is a different level. Therefore, for humans it is very easy to copy and paste, apply schema solution by plugging the problem inputs into schema. However, it takes time to understand why the schema/model works the way it it. And it is an imperative in order to build upon and improve the schema model.
For Machine to do the latter is beyond my understanding. How do we make a machine understand the latter? Having it apply the problem’s values into the schema model’s input variables is quite easy and can be done much faster than a human. However, machine understand what it is doing is NP-Hard.
- 1980’s not learn what a 1, 2, or 3 is but learns the differences between a 1, 2, and 3
- how words compare in context to others
Do computers think? Well do submarines swim? Do airplanes fly like a bird? What it is we borrow techniques
KRR/MR - System Approaches
Reasoning systems come in different approaches that vary in expressive power, in predictive abilities as well as computational requirements. Léon Bottou classifies seven types of approaches:
- First Order Logic Reasoning
- Probabilistic Reasoning
- Causal Reasoning
- Newtonian Mechanics
- Spatial Reasoning
- Social Reasoning
- Non-Falsifiable Reasoning
KRR/MR - System Components
2 components of reasoning systems (aka Languages or Logic Classes):
- knowledge base (knowledge representation) - a collection of knowledge (e.g. facts, rules and relationships) about a specific domain of interest represented in symbolic form
- inference engine (knowledge reasoning) - describes how to algebraically manipulate and combine these symbols. thus producing new knowledge
KRR/MR - Principles
- representational adequacy - ability to represent knowledge of a domain
- inferential adequacy - ability to manipulate old knowledge and derive new knowledge
- inferential efficiency - ability to derive new knowledge accurately and fast
- acquisitional efficiency - ability to acquire new information easily - and merge it with existing information
KRR/MR - Subpages
KRR/MR - Resources
- AI is About Machine Reasoning – or When Machine Learning is Just a Fancy Plugin
- From Machine Learning to Machine Reasoning - Léon Bottou
- How We Reason by Philip Johnson-Laird
- Rebooting AI: Building Artificial Intelligence We Can Trust
- Thinking, Fast and Slow
- Knowledge Representation, Reasoning, and the Design of Intelligent Agents - The Answer-Set Programming Approach - Summaries
- AI Chapter 12 - Knowledge Representation
KRR/MR - Algorithms
- Relational Networks - DeepMind