1、人工智能基础人工智能基础 Introduction to Artificial Introduction to Artificial Intelligence(AI)Intelligence(AI)1From DeepBlue to AlphaGoChess:Deep Blue defeated human world champion Garry Kasparov in a six-game match in 1997.Deep Blue searches 200 million positions per s e c o n d,u s e s v e r y sophisticated
2、evaluation,and undisclosed methods for extending some lines of search up to 40 ply.From DeepBlue to AlphaGoGo:AlphaGo won 5-0 in a formal match on October 2015,against the reigning 3-times European Champion,Fan Hui,becoming the first program to ever beat a professional Go player in an even game.In M
3、arch 2016 AlphaGo won 4-1 against the legendary Lee Sedol,the top Go player in the world over the past decade.AI is always developingArtificial IntelligenceIntelligence5Lecture OutlinevPhilosophy in Artificial Intelligence(AI)What it means to think and whether artifacts could and should ever do so?v
4、Ideas for AI Learning,Symbolic AI,Connectionism,Nouvelle AI,Evolutionary Computation,Computational Swarm Intelligence vCourse overview62022-7-25Part:Philosophy in AIAI:Introduction72022-7-25What is Intelligence,anyway?R.J.Sternberg:“Viewed narrowly,there seem to be almost as many definitions of inte
5、lligence as there were experts asked to define it.”It is useful to think of intelligence in terms of an open collection of attributes.AI:Introduction82022-7-25vPerception Manipulation,integration,and interpretation of data provided by sensors,including purposeful,goal-directed,active perceptionActio
6、n Coordination,control,and use of effectors to accomplish a variety of tasks,including exploration and manipulation of the environment,including design and construction of tools towards this end.Characteristics of Intelligence(1)AI:Introduction92022-7-25Reasoning Deductive(logical)inference,inductiv
7、e inference,analogical inference,hypothetical reasoning,including reasoning in the face of uncertainty and incomplete information.Problem-solving Setting of goals(without explicit instructions from another entity),Formulation of plans，Evaluating and choosing among alternative plans,adapting plans in
8、 the face of unexpected changesCharacteristics of Intelligence(2)AI:Introduction102022-7-25vLearning and Adaptation Learning to describe specific domains in terms of abstract theories and concepts,Learning to use,adapt,and extend language,Learning to reason,plan,and act.Adapting behavior to better c
9、ope with changing environmental demand.Sociality Into social groups based on shared objectives,development of shared conventions to facilitate orderly interaction,culture.Creativity Exploration,modification,and extension of domains by manipulation of domain-specific constraints,or by other means.Cha
10、racteristics of Intelligence(3)AI:Introduction112022-7-25What is AI,anyway?vUnderstand and BUILD intelligent entities Seeking exact definition?(could last a lifetime)vHighly interdisciplinary Compute Science,Philosophy,Psychology,Linguistics,NeuroScience vCurrently consists of huge variety of subfie
11、ldsAI:Introduction122022-7-25How to measure Machine Intelligence?vTwo views Behavior/action(weak AI)Can the machine act intelligently?Turing test.Thought process/reasoning(strong AI)Are machines actually thinking?Chinese Room of J.R.Searle Turing testvWhen does a system behave intelligently?A.M.Turi
12、ng(1950)Computing Machinery and Intelligence.Mind 49:433-460.Operational test of intelligence:imitation game Requires the collaboration of major components of AI:knowledge,reasoning,language understanding,learning,Chinese Room Argument v Therefore,Searle says:-the idea of a non-biological machine be
13、ing intelligent is incoherentA man is in a room with a book of rules.Chinese sentences are passed under the door to him.The man looks up in his book of rules how to process the sentences.Eventually the rules tell him to copy some Chinese characters onto paper and pass the resulting Chinese sentences
14、 as a reply to the message he has received.The dialog continues.To follow these rules the man need not understand Chinese.Searle,John.R.(1980)Minds,brains,and programs.Behavioral and Brain Sciences 3(3):417-457152022-7-25Goals of AIv Current goal -Making intelligent machines,especially intelligent c
15、omputer programs.-Design and construction of useful new tools to extend human intellectual and creative capabilitiesv Long-term goal Understanding of the mechanisms underlying thought and intelligent behaviors and their embodiment in machinesAI:Introduction162022-7-25Part:Ideas for AIvLearning ”chil
16、d machine”vConnectionismvSymbolic AIvEvolutionary Computation ”artificial life”vComputational Swarm IntelligencevNouvelle AI Ideas for AI1.Learning ApproachQ.What about making a child machine that could improve by reading and by learning from experience?A.This idea has been proposed many times,start
17、ing in the 1940s.Eventually,it will be made to work.However,AI programs havent yet reached the level of being able to learn much of what a child learns from physical experience.Nor do present programs understand language well enough to learn much by reading.John McCarthy:Tasks of Machine LearningvLe
18、arning means changevImprove behaviour/performance:learn to perform new tasks(more)increase ability on existing tasks(better)increase speed on existing tasks(faster)vProduce and increase knowledge:formulate explicit concept descriptions formulate explicit rules discover regularities in data discover
19、the way the world behavesThe Architecture of intelligent system with learning capabilityEnvionmentPerceptionEvaluationPerformanceLearningKinds of LearningvSupervised Learning Given a set of example input/output pairs,find a rule that does a good job or predicting the output associated with a new inp
20、ut.vUnsupervised Learning(clustering)Given a set of examples,no labeling of them,group them into natural clusters.Training data,Validation data,Test dataKinds of Learning contd.vSemi-supervised Learning Combination of supervised and unsupervised learning.vReinforcement Learning An agent interacting
21、with the world makes observation,takes actions,and is rewarded or punished;it should to learn to choose actions in such a way as to obtain a lot of reward.Learning issuesvOverfitting(generalization ability):can the machine well-trained on observed data behave well on other data either?vBias:which hy
22、potheses are preferred?vRobustness:how does the training data influence the learning result?Data Scale,Change,Noise,and ImbalancevTransparency:can we understand what and how has been learnt?vComputation Complexity:what is the efficiency of the learning algorithms?Time,Memory,Scalability,convergencyA
23、I:Introduction242022-7-252.Connectionismv The mechanisms of brains are very different in detail from those in computers v how brains work?Bottom-up strategyNatural Neural NetworkAI:Introduction252022-7-25v A brief history M-P neuron(McCulloch&Pitts)Perceptron(Rosenblatt)Hopfield Model,B-P Learning M
24、ethod(Rumelhart&McClelland)Deep Learning(Geoffrey Hinton)v Applications Recognition,Vision,Business,Medical,.v Core Issues -Topology -Learning MethodsConnectionismAlphaGo-Ground-breakingArtificial BrainvArtificial brains are a man-made machines that have the same cognitive ability as humans and othe
25、r mammals.vProjects SyNAPSE:DAPRA,with IBM,HP,HRL Labs.Blue Brain:EPFL Together with IBM Barin in Silicon:Standford University Neuromorphic chip from Stanford v This tiny chippackaged in black plastic and mounted on a printed circuit boardmodels 1,024 excitatory pyramidal cells and 256 inhibitory ba
26、sket cells.Their cellular properties and synaptic organization are downloaded to the chip over a USB link,which also allows their activity to be visualized in real-time.Emily Nathan 2007 3.Symbolic AIv Physical Symbol System Hypothesis of Newell and Simon -the processing of structures of symbols by
27、a digital computer is sufficient to produce artificial intelligence -the processing of structures of symbols by the human brain is the basis of human intelligence -it remains an open question whether the Physical Symbol System Hypothesis is true or false -Top-down strategyv Problem-sloving Expert Sy
28、stem Knowledge Engineering -Search,Representation,Reasoning -GPS,Deep Blue,DENDRAL,CYC.Symbolic AISearch ProblemHow to search is a key to Symbolic AI as well as AI 4.Evolutionary ComputationvBiological evolution To produce an enormous variety of living organisms closely suited to different sets of n
29、eeds in different environments.vSimulated evolution By modeling those processes of biological evolution on computers,it turns out that we can sometimes get the computers to evolve solutions to problems.AI:Introduction332022-7-25DNA ComputingAI:Introduction342022-7-25v Genetic Algorithm Use strings o
30、f symbols to encode solutions to problems,like strings of molecules in DNA.Transforming and recombining portions of strings enables an evolutionary computation to search for good solutions,partly analogous to biological evolution.Genetic Programming Extends these ideas to automatic programming by us
31、ing structures which are better suited to the problem than strings are.Evolutionary ComputationvEvolutionary Strategy Use natural problem-dependent representations,and primarily mutation and selection as search operators.Mutation is normally performed by adding a normally distributed random value to
32、 each vector component.The step size or mutation strength is often governed by self-adaptation.The selection in evolution strategies is deterministic and only based on the fitness rankings,not on the actual fitness values.vEvolutionary Programming Harder to distinguish from evolutionary strategies.I
33、ts main variation operator is mutation;members of the population are viewed as part of a specific species rather than members of the same species therefore each parent generates an offspring.Evolutionary ComputationExample:Forming body plans with evolutionv Node specifies part type,joint,and range o
34、f movementv Edges specify the joints between partsv Population?Graphs of nodes and edgesv Selection?Ability to perform some task(walking,jumping,etc.)v Mutation?Node types change/new nodes grafted onFrom Virgil Griffith,Google Tech Talk-2007Artificial Life(Alife)v Artificial Life is the study of man
35、-made systems that exhibit behaviors characteristic of natural living systems.It complements the traditional biological sciences concerned with the analysis of living organisms by attempting to synthesize life-like behaviors within computers and other artificial media.By extending the empirical foun
36、dation upon which biology is based beyond the carbon-chain life that has evolved on Earth,Artificial Life can contribute to theoretical biology by locating life-as-we-know-it within the larger picture of life-as-it-could-be.Chris Langton(in Proc.of first Alife conference)Artificial Life and Evolutio
37、naryOrigin of LifeTodayLife,and might have beenas it isFrom Virgil Griffith,Google Tech Talk-20075.Computational Swarm Intelligence vIntelligence is often considered a property of individuals.vAre we social because we are intelligent or are we intelligent because we are social?-Intelligence can emer
38、ge from social interaction.vEmergent behaviour when a group behaves in ways that were not”programmed”into its members.vSwarm intelligence -simulated social interaction -emergent collective intelligence of groups of simple agents402022-7-25Computational Beauty in Nature AI:Introduction412022-7-25Obse
39、rvationsv Bird flocks and fish schools move in a coordinated way,but there is no coordinator(leader)-So,what decides the behaviour of a leader-less flock?v Ants and termites quickly find the shortest path between the nest and a food source -.and solve many other advanced problems as well:keeping cat
40、tle,building(ventilated)housing,coordinated heavy transports,tactical warfare,cleaning house,etc.-A single ant is essentially a blind,memory-less,random walker!v Distributed systems without central controlv Useful not only to simulate but also to solve optimization problemsAI:Introduction422022-7-25
41、Computational SimulationvMulti-Agent Systems -a system composed of multiple interacting intelligent agents.-application including computer games,networks,transportation,logistics,and etc.vAnt Colony Optimization -1991(Dorigo)-mostly for combinatorial optimizationvParticle Swarm Optimization -1995(Ke
42、nnedy&Eberhart)-more general optimization technique6.Nouvelle AIv Rodney Brooks(1991)Insect-like mobile robots:Allen,Herbert,Genghis -The basic building blocks of intelligence are very simple behaviours,More complex behaviours emerge from the interaction of these simple behaviours.-Producing systems
43、 that display approximately the same level of intelligence as insects.AI:Introduction442022-7-25v Situated AI -Build disembodied intelligences who unfriendly interact with the world(traditional)-Build embodied intelligences situated in a real world(Nouvelle).Nouvelle AIv Lifetime Learning -Reinforce
44、ment learning -Adapt to environment by acting and receiving reward/punishment in the environment.AI:Introduction452022-7-25Part Machine Learning(new book,chapters 2-5)Concepts,Methods,Supervised and Unsupervised LearningPart Connectionism(new book,chapters 9-11)Concepts,Problems,ModelsPart Symbolic
45、AI(old book,chapters 2-3)Problem representation,Graph Search,Adversarial Search,Knowledge,Logic inference,UncertaintyPart Evolutionary Computation(old book,chapters 7)Genetic Algorithms,Evolutionary Programming,Evolutionary Strategies Part Computational Swarm Intelligence(old book,chapters 8)Ant Col
46、ony Optimization,Particle Swarm Optimization Part Nouvelle AI(old book,chapters 6,new book,chapter 8)Agent,Reinforcement LearningCourse OverviewAI:Introduction462022-7-25Get a general understanding of AI,preparing yourself for learning and study of braches of AI!GOAL!Loris Malaguzzi:Learning and teaching should not stand on opposite banks and just watch the river flow by;instead,they should embark together on a journey down the water.Through an active,reciprocal exchange,teaching can strengthen learning how to learn.AI:Machine Learning472022-7-25Learning to learn48
