under the hood our brains share one remarkable skill: the ability to reason about how one thing relates to another

Knowledge Representation & Reasoning (KRR) is the field of artificial intelligence

  • Knowledge Representation - representing knowledge about the world into computer-sensible format
  • Knowledge Reasoning or Machine Reasoning (MR)
    • algebraically manipulating previously acquired knowledge in order to answer a new question
    • generating new knowledge from previously acquired knowledge by applying reasoning or more specifically logical reasoning techniques (e.g. deduction, induction, etc)

KRR/MR - MR is Hard

There is a hard problem with creating machine that understand:

  • under the hood our brains share one remarkable skill: the ability to reason about how one thing relates to another

For example, I could know a sequence of mathematical steps in order to get the final result. But knowing the steps versus understanding why the steps are the way it is, is a different level. Therefore, for humans it is very easy to copy and paste, apply schema solution by plugging the problem inputs into schema. However, it takes time to understand why the schema/model works the way it it. And it is an imperative in order to build upon and improve the schema model.

For Machine to do the latter is beyond my understanding. How do we make a machine understand the latter? Having it apply the problem’s values into the schema model’s input variables is quite easy and can be done much faster than a human. However, machine understand what it is doing is NP-Hard.

  • 1980’s not learn what a 1, 2, or 3 is but learns the differences between a 1, 2, and 3
  • how words compare in context to others

Do computers think? Well do submarines swim? Do airplanes fly like a bird? What it is we borrow techniques

KRR/MR - System Approaches

Reasoning systems come in different approaches that vary in expressive power, in predictive abilities as well as computational requirements. Léon Bottou classifies seven types of approaches:

  • First Order Logic Reasoning
  • Probabilistic Reasoning
  • Causal Reasoning
  • Newtonian Mechanics
  • Spatial Reasoning
  • Social Reasoning
  • Non-Falsifiable Reasoning

KRR/MR - System Components

2 components of reasoning systems (aka Languages or Logic Classes):

  • knowledge base (knowledge representation) - a collection of knowledge (e.g. facts, rules and relationships) about a specific domain of interest represented in symbolic form
  • inference engine (knowledge reasoning) - describes how to algebraically manipulate and combine these symbols. thus producing new knowledge

KRR/MR - Principles

  • representational adequacy - ability to represent knowledge of a domain
  • inferential adequacy - ability to manipulate old knowledge and derive new knowledge
  • inferential efficiency - ability to derive new knowledge accurately and fast
  • acquisitional efficiency - ability to acquire new information easily - and merge it with existing information

KRR/MR - Subpages

KRR/MR - Resources

KRR/MR - Algorithms