Intelligent Agent

• Definition of ideal rational agent
  • performance measure
    • may not necessarily be right
  • based on the evidence that the agent has
  • knowledge base
    • evolving as the time goes by. This implies that the agent's performance is expected to improve with experience
• A table of percept sequences and actions
  • Potentially infinite
  • We can also have a function/algorithm that can calculate the table
  • Determining the square root
• The agent has autonomy
• Four types of agents
  • Simple reflex agent
    • reacts to the perception: if then rule
  • Agent that keeps track of the world
    • action depend on the current state and the percept sequence
  • Goal based agent
    • just taking the right actions based on current state and percept sequence is not enough
    • the agent has to know what it is that it is achieving
  • Utility-based agent
    • You may or may not achieve your goals through the next action
• Page 46: Types of environments
  • Accessible
    • do you know everything about the environment
  • Deterministic
    • Does your action determine the next state
  • Episodic
    • One episode has no relation with the next episode
  • Static
    • The environment doesn't change as the agent is thinking
    • semistatic: environment is static but quality of reward is going to change
  • Discrete
    • Can we treat the time period as discrete or continuous