Artificial intelligence

Page semi-protected
From Wikipedia, the free encyclopedia

Artificial intelligence (AI) is the intelligence of machines or software, as opposed to the intelligence of humans or animals. It is the subject of an eponymous field of study in computer science, which develops and studies intelligent machines. The term AI may also refer to the intelligent machines themselves.

AI technology is widely used throughout industry, government and science. Some high-profile applications are: advanced web search engines (e.g., Google Search), recommendation systems (used by YouTube, Amazon, and Netflix), understanding human speech (such as Google Assistant, Siri, and Alexa), self-driving cars (e.g., Waymo), generative and creative tools (ChatGPT and AI art), and superhuman play and analysis in strategy games (such as chess and Go).[1]

Artificial intelligence was founded as an academic discipline in 1956.[2] The field went through multiple cycles of optimism[3][4] followed by disappointment and loss of funding,[5][6] but after 2012, when deep learning surpassed all previous AI techniques,[7] there was a vast increase in funding and interest.

The various sub-fields of AI research are centered around particular goals and the use of particular tools. The traditional goals of AI research include reasoning, knowledge representation, planning, learning, natural language processing, perception, and support for robotics.[a] General intelligence (the ability to complete any task performable by a human) is among the field's long-term goals.[8] To solve these problems, AI researchers have adapted and integrated a wide range of problem-solving techniques, including search and mathematical optimization, formal logic, artificial neural networks, and methods based on statistics, operations research, and economics.[b] AI also draws upon psychology, linguistics, philosophy, neuroscience and many other fields.[9]

Goals

The general problem of simulating (or creating) intelligence has been broken down into sub-problems. These consist of particular traits or capabilities that researchers expect an intelligent system to display. The traits described below have received the most attention and cover the scope of AI research.[a]

Reasoning, problem-solving

Early researchers developed algorithms that imitated step-by-step reasoning that humans use when they solve puzzles or make logical deductions.[10] By the late 1980s and 1990s, methods were developed for dealing with uncertain or incomplete information, employing concepts from probability and economics.[11]

Many of these algorithms are insufficient for solving large reasoning problems because they experience a "combinatorial explosion": they became exponentially slower as the problems grew larger.[12] Even humans rarely use the step-by-step deduction that early AI research could model. They solve most of their problems using fast, intuitive judgments.[13] Accurate and efficient reasoning is an unsolved problem.

Knowledge representation

An ontology represents knowledge as a set of concepts within a domain and the relationships between those concepts.

Knowledge representation and knowledge engineering[14] allow AI programs to answer questions intelligently and make deductions about real-world facts. Formal knowledge representations are used in content-based indexing and retrieval,[15] scene interpretation,[16] clinical decision support,[17] knowledge discovery (mining "interesting" and actionable inferences from large databases),[18] and other areas.[19]

A knowledge base is a body of knowledge represented in a form that can be used by a program. An ontology is the set of objects, relations, concepts, and properties used by a particular domain of knowledge.[20] Knowledge bases need to represent things such as: objects, properties, categories and relations between objects; [21] situations, events, states and time;[22] causes and effects;[23] knowledge about knowledge (what we know about what other people know);[24] default reasoning (things that humans assume are true until they are told differently and will remain true even when other facts are changing);[25] and many other aspects and domains of knowledge.

Among the most difficult problems in KR are: the breadth of commonsense knowledge (the set of atomic facts that the average person knows is enormous);[26] and the sub-symbolic form of most commonsense knowledge (much of what people know is not represented as "facts" or "statements" that they could express verbally).[13]

Knowledge acquisition is the difficult problem of obtaining knowledge for AI applications.[c] Modern AI gathers knowledge by "scraping" the internet (including Wikipedia). The knowledge itself was collected by the volunteers and professionals who published the information (who may or may not have agreed to provide their work to AI companies).[29] This "crowd sourced" technique does not guarantee that the knowledge is correct or reliable. The knowledge of Large Language Models (such as ChatGPT) is highly unreliable -- it generates misinformation and falsehoods (known as "hallucinations"). Providing accurate knowledge for these modern AI applications is an unsolved problem.

Planning and decision making

An "agent" is anything that perceives and takes actions in the world. A rational agent has goals or preferences and takes actions to make them happen.[d][30] In automated planning, the agent has a specific goal.[31] In automated decision making, the agent has preferences – there are some situations it would prefer to be in, and some situations it is trying to avoid. The decision making agent assigns a number to each situation (called the "utility") that measures how much the agent prefers it. For each possible action, it can calculate the "expected utility": the utility of all possible outcomes of the action, weighted by the probability that the outcome will occur. It can then choose the action with the maximum expected utility.[32]

In classical planning, the agent knows exactly what the effect of any action will be.[33] In most real-world problems, however, the agent may not be certain about the situation they are in (it is "unknown" or "unobservable") and it may not know for certain what will happen after each possible action (it is not "deterministic"). It must choose an action by making a probabilistic guess and then reassess the situation to see if the action worked.[34] In some problems, the agent's preferences may be uncertain, especially if there are other agents or humans involved. These can be learned (e.g., with inverse reinforcement learning) or the agent can seek information to improve its preferences.[35] Information value theory can be used to weigh the value of exploratory or experimental actions.[36] The space of possible future actions and situations is typically intractably large, so the agents must take actions and evaluate situations while being uncertain what the outcome will be.

A Markov decision process has a transition model that describes the probability that a particular action will change the state in a particular way, and a reward function that supplies the utility of each state and the cost of each action. A policy associates a decision with each possible state. The policy could be calculated (e.g. by iteration), be heuristic, or it can be learned.[37]

Game theory describes rational behavior of multiple interacting agents, and is used in AI programs that make decisions that involve other agents.[38]

Learning

Machine learning is the study of programs that can improve their performance on a given task automatically.[39] It has been a part of AI from the beginning.[e]

There are several kinds of machine learning. Unsupervised learning analyzes a stream of data and finds patterns and makes predictions without any other guidance.[42] Supervised learning requires a human to label the input data first, and comes in two main varieties: classification (where the program must learn to predict what category the input belongs in) and regression (where the program must deduce a numeric function based on numeric input).[43] In reinforcement learning the agent is rewarded for good responses and punished for bad ones. The agent learns to choose responses that are classified as "good".[44] Transfer learning is when the knowledge gained from one problem is applied to a new problem.[45] Deep learning is a type of machine learning that runs inputs through biologically inspired artificial neural networks for all of these types of learning.[46]

Computational learning theory can assess learners by computational complexity, by sample complexity (how much data is required), or by other notions of optimization.[47]

Natural language processing

Natural language processing (NLP)[48] allows programs to read, write and communicate in human languages such as English. Specific problems include speech recognition, speech synthesis, machine translation, information extraction, information retrieval and question answering.[49]

Early work, based on Noam Chomsky's generative grammar and semantic networks, had difficulty with word-sense disambiguation[f] unless restricted to small domains called "micro-worlds" (due to the common sense knowledge problem[26]).

Modern deep learning techniques for NLP include word embedding (representing words, typically as vectors encoding their meaning),[50] transformers (a deep learning architecture using an attention mechanism),[51] and others.[52] In 2019, generative pre-trained transformer (or "GPT") language models began to generate coherent text,[53][54] and by 2023 these models were able to get human-level scores on the bar exam, SAT, GRE, and many other real-world applications.[55]

Perception

Feature detection (pictured: edge detection) helps AI compose informative abstract structures out of raw data.

Machine perception is the ability to use input from sensors (such as cameras, microphones, wireless signals, active lidar, sonar, radar, and tactile sensors) to deduce aspects of the world. Computer vision is the ability to analyze visual input.[56] The field includes speech recognition,[57] image classification,[58] facial recognition, object recognition,[59] and robotic perception.[60]

Social intelligence

Kismet, a robot with rudimentary social skills[61]

Affective computing is an interdisciplinary umbrella that comprises systems that recognize, interpret, process or simulate human feeling, emotion and mood.[62] For example, some virtual assistants are programmed to speak conversationally or even to banter humorously; it makes them appear more sensitive to the emotional dynamics of human interaction, or to otherwise facilitate human–computer interaction. However, this tends to give naïve users an unrealistic conception of how intelligent existing computer agents actually are.[63] Moderate successes related to affective computing include textual sentiment analysis and, more recently, multimodal sentiment analysis, wherein AI classifies the affects displayed by a videotaped subject.[64]

General intelligence

A machine with artificial general intelligence should be able to solve a wide variety of problems with breadth and versatility similar to human intelligence.[8]

Tools

AI research uses a wide variety of tools to accomplish the goals above.[b]

Search and optimization

AI can solve many problems by intelligently searching through many possible solutions.[65] There are two very different kinds of search used in AI: state space search and local search.

State space search

State space search searches through a tree of possible states to try to find a goal state.[66] For example, Planning algorithms search through trees of goals and subgoals, attempting to find a path to a target goal, a process called means-ends analysis.[67]

Simple exhaustive searches[68] are rarely sufficient for most real-world problems: the search space (the number of places to search) quickly grows to astronomical numbers. The result is a search that is too slow or never completes.[12] "Heuristics" or "rules of thumb" can help to prioritize choices that are more likely to reach a goal.[69]

Adversarial search is used for game-playing programs, such as chess or Go. It searches through a tree of possible moves and counter-moves, looking for a winning position.[70]

Local search

A particle swarm seeking the global minimum

Local search uses mathematical optimization to find a numeric solution to a problem. It begins with some form of a guess and then refines the guess incrementally until no more refinements can be made. These algorithms can be visualized as blind hill climbing: we begin the search at a random point on the landscape, and then, by jumps or steps, we keep moving our guess uphill, until we reach the top. This process is called stochastic gradient descent.[71]

Evolutionary computation uses a form of optimization search. For example, they may begin with a population of organisms (the guesses) and then allow them to mutate and recombine, selecting only the fittest to survive each generation (refining the guesses).[72]

Distributed search processes can coordinate via swarm intelligence algorithms. Two popular swarm algorithms used in search are particle swarm optimization (inspired by bird flocking) and ant colony optimization (inspired by ant trails).[73]

Neural networks and statistical classifiers (discussed below), also use a form of local search, where the "landscape" to be searched is formed by learning.

Logic

Formal Logic is used for reasoning and knowledge representation.[74] Formal logic comes in two main forms: propositional logic (which operates on statements that are true or false and uses logical connectives such as "and", "or", "not" and "implies")[75] and predicate logic (which also operates on objects, predicates and relations and uses quantifiers such as "Every X is a Y" and "There are some Xs that are Ys").[76]

Logical inference (or deduction) is the process of proving a new statement (conclusion) from other statements that are already known to be true (the premises).[77] A logical knowledge base also handles queries and assertions as a special case of inference.[78] An inference rule describes what is a valid step in a proof. The most general inference rule is resolution.[79] Inference can be reduced to performing a search to find a path that leads from premises to conclusions, where each step is the application of an inference rule.[80] Inference performed this way is intractable except for short proofs in restricted domains. No efficient, powerful and general method has been discovered.[81]

Fuzzy logic assigns a "degree of truth" between 0 and 1 and handles uncertainty and probabilistic situations.[82] Non-monotonic logics are designed to handle default reasoning.[25] Other specialized versions of logic have been developed to describe many complex domains (see knowledge representation above).

Probabilistic methods for uncertain reasoning

Expectation-maximization clustering of Old Faithful eruption data starts from a random guess but then successfully converges on an accurate clustering of the two physically distinct modes of eruption.

Many problems in AI (including in reasoning, planning, learning, perception, and robotics) require the agent to operate with incomplete or uncertain information. AI researchers have devised a number of tools to solve these problems using methods from probability theory and economics.[83]

Bayesian networks[84] are a very general tool that can be used for many problems, including reasoning (using the Bayesian inference algorithm),[g][86] learning (using the expectation-maximization algorithm),[h][88] planning (using decision networks)[89] and perception (using dynamic Bayesian networks).[90]

Probabilistic algorithms can also be used for filtering, prediction, smoothing and finding explanations for streams of data, helping perception systems to analyze processes that occur over time (e.g., hidden Markov models or Kalman filters).[90]

Precise mathematical tools have been developed that analyze how an agent can make choices and plan, using decision theory, decision analysis,[91] and information value theory.[92] These tools include models such as Markov decision processes, [93] dynamic decision networks,[90] game theory and mechanism design.[94]

Classifiers and statistical learning methods

The simplest AI applications can be divided into two types: classifiers (e.g. "if shiny then diamond"), on one hand, and controllers (e.g. "if diamond then pick up"), on the other hand. Classifiers[95] are functions that use pattern matching to determine the closest match. They can be fine-tuned based on chosen examples using supervised learning. Each pattern (also called an "observation") is labeled with a certain predefined class. All the observations combined with their class labels are known as a data set. When a new observation is received, that observation is classified based on previous experience.[43]

There are many kinds of classifiers in use. The decision tree is the simplest and most widely used symbolic machine learning algorithm.[96] K-nearest neighbor algorithm was the most widely used analogical AI until the mid-1990s, and Kernel methods such as the support vector machine (SVM) displaced k-nearest neighbor in the 1990s.[97] The naive Bayes classifier is reportedly the "most widely used learner"[98] at Google, due in part to its scalability.[99] Neural networks are also used as classifiers.[100]

Artificial neural networks

A neural network is an interconnected group of nodes, akin to the vast network of neurons in the human brain.

Artificial neural networks[100] were inspired by the design of the human brain: a simple "neuron" N accepts input from other neurons, each of which, when activated (or "fired"), casts a weighted "vote" for or against whether neuron N should itself activate. In practice, the input "neurons" are a list of numbers, the "weights" are a matrix, the next layer is the dot product (i.e., several weighted sums) scaled by an increasing function, such as the logistic function. "The resemblance to real neural cells and structures is superficial", according to Russell and Norvig.[101][i]

Learning algorithms for neural networks use local search to choose the weights that will get the right output for each input during training. The most common training technique is the backpropagation algorithm.[102] Neural networks learn to model complex relationships between inputs and outputs and find patterns in data. In theory, a neural network can learn any function.[103]

In feedforward neural networks the signal passes in only one direction.[104] Recurrent neural networks feed the output signal back into the input, which allows short-term memories of previous input events. Long short term memory is the most successful network architecture for recurrent networks.[105] Perceptrons[106] use only a single layer of neurons, deep learning[107] uses multiple layers. Convolutional neural networks strengthen the connection between neurons that are "close" to each other – this is especially important in image processing, where a local set of neurons must identify an "edge" before the network can identify an object.[108]

Deep learning

Representing Images on Multiple Layers of Abstraction in Deep Learning
Representing images on multiple layers of abstraction in deep learning[109]

Deep learning[107] uses several layers of neurons between the network's inputs and outputs. The multiple layers can progressively extract higher-level features from the raw input. For example, in image processing, lower layers may identify edges, while higher layers may identify the concepts relevant to a human such as digits or letters or faces.[110]

Deep learning has drastically improved the performance of programs in many important subfields of artificial intelligence, including computer vision, speech recognition, image classification[111] and others. The reason that deep learning performs so well in so many applications is not known as of 2023.[112] The sudden success of deep learning in 2012–2015 did not occur because of some new discovery or theoretical breakthrough (deep neural networks and backpropagation had been described by many people, as far back as the 1950s)[j] but because of two factors: the incredible increase in computer power (including the hundred-fold increase in speed by switching to GPUs) and the availability of vast amounts of training data, especially the giant curated datasets used for benchmark testing, such as ImageNet.[k]

Specialized hardware and software

In the late 2010s, graphics processing units (GPUs) that were increasingly designed with AI-specific enhancements and used with specialized TensorFlow software, had replaced previously used central processing unit (CPUs) as the dominant means for large-scale (commercial and academic) machine learning models' training.[121] Historically, specialized languages, such as Lisp, Prolog,Python and others, had been used.

Applications

For this 2018 project of the artist Joseph Ayerle the AI had to learn the typical patterns in the colors and brushstrokes of Renaissance painter Raphael. The portrait shows the face of the actress Ornella Muti, "painted" by AI in the style of Raphael.

AI and machine learning technology is used in most of the essential applications of the 2020s, including: search engines (such as Google Search), targeting online advertisements,[122] recommendation systems (offered by Netflix, YouTube or Amazon), driving internet traffic,[123][124] targeted advertising (AdSense, Facebook), virtual assistants (such as Siri or Alexa),[125] autonomous vehicles (including drones, ADAS and self-driving cars), automatic language translation (Microsoft Translator, Google Translate), facial recognition (Apple's Face ID or Microsoft's DeepFace and Google's FaceNet) and image labeling (used by Facebook, Apple's iPhoto and TikTok).

There are also thousands of successful AI applications used to solve specific problems for specific industries or institutions. In a 2017 survey, one in five companies reported they had incorporated "AI" in some offerings or processes.[126] A few examples are energy storage,[127] medical diagnosis, military logistics, applications that predict the result of judicial decisions,[128] foreign policy,[129] or supply chain management.

Game playing programs have been used since the 1950s to demonstrate and test AI's most advanced techniques. Deep Blue became the first computer chess-playing system to beat a reigning world chess champion, Garry Kasparov, on 11 May 1997.[130] In 2011, in a Jeopardy! quiz show exhibition match, IBM's question answering system, Watson, defeated the two greatest Jeopardy! champions, Brad Rutter and Ken Jennings, by a significant margin.[131] In March 2016, AlphaGo won 4 out of 5 games of Go in a match with Go champion Lee Sedol, becoming the first computer Go-playing system to beat a professional Go player without handicaps.[132] Then it defeated Ke Jie in 2017, who at the time continuously held the world No. 1 ranking for two years.[133][134][135] Other programs handle imperfect-information games; such as for poker at a superhuman level, Pluribus[l] and Cepheus.[137] DeepMind in the 2010s developed a "generalized artificial intelligence" that could learn many diverse Atari games on its own.[138]

In the early 2020s, generative AI gained widespread prominence. ChatGPT, based on GPT-3, and other large language models, were tried by 14% of Americans adults.[139] The increasing realism and ease-of-use of AI-based text-to-image generators such as Midjourney, DALL-E, and Stable Diffusion[140][141] sparked a trend of viral AI-generated photos. Widespread attention was gained by a fake photo of Pope Francis wearing a white puffer coat,[142] the fictional arrest of Donald Trump,[143] and a hoax of an attack on the Pentagon,[144] as well as the usage in professional creative arts.[145][146]

AlphaFold 2 (2020) demonstrated the ability to approximate, in hours rather than months, the 3D structure of a protein.[147]

Ethics

AI, like any powerful technology, has potential benefits and potential risks. AI may be able to advance science and find solutions for serious problems: Demis Hassabis of Deep Mind hopes to "solve intelligence, and then use that to solve everything else".[148] However, as the use of AI has become widespread, several unintended consequences and risks have been identified.[149]

Anyone looking to use machine learning as part of real-world, in-production systems needs to factor ethics into their AI training processes and strive to avoid bias. This is especially true when using AI algorithms that are inherently unexplainable in deep learning.[150]

Risks and harm

Privacy and copyright

Machine learning algorithms require large amounts of data. The techniques used to acquire this data have raised concerns about privacy, surveillance and copyright.

Technology companies collect a wide range of data from their users, including online activity, geolocation data, video and audio.[151] For example, in order to build speech recognition algorithms, Amazon have recorded millions of private conversations and allowed temps to listen to and transcribe some of them.[152] Opinions about this widespread surveillance range from those who see it as a necessary evil to those for whom it is clearly unethical and a violation of the right to privacy.[153]

AI developers argue that this is the only way to deliver valuable applications. and have developed several techniques that attempt to preserve privacy while still obtaining the data, such as data aggregation, de-identification and differential privacy.[154] Since 2016, some privacy experts, such as Cynthia Dwork, began to view privacy in terms of fairness. Brian Christian wrote that experts have pivoted "from the question of 'what they know' to the question of 'what they're doing with it'.".[155]

Generative AI is often trained on unlicensed copyrighted works, including in domains such as images or computer code; the output is then used under a rationale of "fair use". Experts disagree about how well, and under what circumstances, this rationale will hold up in courts of law; relevant factors may include "the purpose and character of the use of the copyrighted work" and "the effect upon the potential market for the copyrighted work".[156] In 2023, leading authors (including John Grisham and Jonathan Franzen) sued AI companies for using their work to train generative AI.[157][158]

Misinformation

YouTube, Facebook and others use recommender systems to guide users to more content. These AI programs were given the goal of maximizing user engagement (that is, the only goal was to keep people watching). The AI learned that users tended to choose misinformation, conspiracy theories, and extreme partisan content, and, to keep them watching, the AI recommended more of it. Users also tended to watch more content on the same subject, so the AI led people into filter bubbles where they received multiple versions of the same misinformation.[159] This convinced many users that the misinformation was true, and ultimately undermined trust in institutions, the media and the government.[160] The AI program had correctly learned to maximize its goal, but the result was harmful to society. After the U.S. election in 2016, major technology companies took steps to mitigate the problem.

In 2022, generative AI began to create images, audio, video and text that are indistinguishable from real photographs, recordings, films or human writing. It is possible for bad actors to use this technology to create massive amounts of misinformation or propaganda.[161] AI pioneer Geoffrey Hinton expressed concern about AI enabling "authoritarian leaders to manipulate their electorates" on a large scale, among other risks.[162]

Algorithmic bias and fairness

Machine learning applications will be biased if they learn from biased data.[163] The developers may not be aware that the bias exists.[164] Bias can be introduced by the way training data is selected and by the way a model is deployed.[165][163] If a biased algorithm is used to make decisions that can seriously harm people (as it can in medicine, finance, recruitment, housing or policing) then the algorithm may cause discrimination.[166] Fairness in machine learning is the study of how to prevent the harm caused by algorithmic bias. It has become serious area of academic study within AI. Researchers have discovered it is not always possible to define "fairness" in a way that satisfies all stakeholders.[167]

On June 28, 2015, Google Photos's new image labeling feature mistakenly identified Jacky Alcine and a friend as "gorillas" because they were black. The system was trained on a dataset that contained very few images of black people,[168] a problem called "sample size disparity".[169] Google "fixed" this problem by preventing the system from labelling anything as a "gorilla". Eight years later, in 2023, Google Photos still could not identify a gorilla, and neither could similar products from Apple, Facebook, Microsoft and Amazon.[170]

COMPAS is a commercial program widely used by U.S. courts to assess the likelihood of a defendant becoming a recidivist. In 2016, Julia Angwin at ProPublica discovered that COMPAS exhibited racial bias, despite the fact that the program was not told the races of the defendants. Although the error rate for both whites and blacks was calibrated equal at exactly 61%, the errors for each race were different -- the system consistently overestimated the chance that a black person would re-offend and would underestimate the chance that a white person would not re-offend.[171] In 2017, several researchers[m] showed that it was mathematically impossible for COMPAS to accommodate all possible measures of fairness when the base rates of re-offense were different for whites and blacks in the data.[173]

A program can make biased decisions even if the data does not explicitly mention a problematic feature (such as "race" or "gender"). The feature will correlate with other features (like "address", "shopping history" or "first name"), and the program will make the same decisions based on these features as it would on "race" or "gender".[174] Moritz Hardt said "the most robust fact in this research area is that fairness through blindness doesn't work."[175]

Criticism of COMPAS highlighted a deeper problem with the misuse of AI. Machine learning models are designed to make "predictions" that are only valid if we assume that the future will resemble the past. If they are trained on data that includes the results of racist decisions in the past, machine learning models must predict that racist decisions will be made in the future. Unfortunately, if an application then uses these predictions as recommendations, some of these "recommendations" will likely be racist.[176] Thus, machine learning is not well suited to help make decisions in areas where there is hope that the future will be better than the past. It is necessarily descriptive and not proscriptive.[n]

Bias and unfairness may go undetected because the developers are overwhelmingly white and male: among AI engineers, about 4% are black and 20% are women.[169]

At its 2022 Conference on Fairness, Accountability, and Transparency (ACM FAccT 2022) the Association for Computing Machinery, in Seoul, South Korea, presented and published findings recommending that until AI and robotics systems are demonstrated to be free of bias mistakes, they are unsafe and the use of self-learning neural networks trained on vast, unregulated sources of flawed internet data should be curtailed.[178]

Other causes of error

One system (Chanda & Banerjee 2022)[179] broadly classifies AI errors into either of the following:

  • Error of omission: Not doing something that should have been done. It often corresponds to design flaws of the system.
  • Error of commission: Doing something that should not have been done. It often corresponds to implementation flaws of the system.
Stage Omission error[179] Commission error[179]
Input - Some scenarios needing decision-making by the AI got excluded
- Fine-grained/less frequent variations of some known/frequent scenarios got excluded
- Some channels of relevant and useful information got missed out
- All salient info is not taken in
- Training data did not contain sufficient number of records for diverse constituents
- Data that was input to the AI during training phase has since become obsolete (making the AI prediction model obsolete)
- Hardware deployed for capturing an input is deficient
- In the step for reduction of data dimension reduction, some correlated columns got included, either due to a mistake, or due to a change in the external environment after design and deployment of the AI solution
- Irrelevant data columns got fed as inputs to the AI solution
- Irrelevant input (noise: environmental or from other connected systems) not blocked off
- Feedback loops that exacerbate biases present in the AI solution
Process - Logic in AI failed to focus on adequately processing a salient part of input information
- Logic in AI failed to resolve ambiguity in input information
- Logic in AI failed to stop execution immediately upon encountering error condition
- Inadequate (insufficient), or slow, processing by an AI system
- Logic in AI focused on non-salient part of input information
- An inappropriate logic was used
- Ill-conceived updates or features from the originators of the AI system break functioning
- Logic necessary for some part of the AI functioning got deployed in another part where it is not required
Output - Failure arising from lack of technological sophistication
- Failure to design new kinds of actions from AI, when environment changes
- Failing to send output to intended party/parties, i.e. expected action by the AI system fails to materialize timely
- Some relevant ways of deciding on an action (for example, consulting a human, asking another AI system) not made available to the AI system
- Adverse interaction between modules of an AI system leads to faulty action
- Inappropriate action stemming from adverse AI-environment interaction
- Questionable action stemming from adverse interaction between AI and other technological systems
- Inappropriate action stemming from adverse interaction between AI and humans
AI learns biased/inappropriate behavior in the wild (from a mix of humans, corpuses including web sites and social media, connected technology systems and other environmental entities)
Comic strip demonstrating a fictional erroneous computer output (making a coffee 5 million degrees [Celsius or Fahrenheit not specified], from a previous definition of "extra hot"). In terms of errors in artificial intelligence categorized by Chanda & Banerjee,[179] this can be classified as both:
- Logic in AI failed to resolve ambiguity in input information ("extra hot" has different meanings)
- Failure to design new kinds of actions from AI, when environment changes (including moderation of heat generation in dining areas)

An example of an omission error where fine-grained variations of some known scenarios got excluded was the instance where a 10-year-old boy was able to unlock his mother's iPhone X using his face. The boy was able to unlock the phone because his mother registered her face under indoor, nighttime lighting, a condition which was not appropriately included in the training of the system.[179][180]

Lack of transparency

Many AI systems are so complex that their designers cannot explain how they reach their decisions.[181] Particularly with deep neural networks, in which there are a large amount of non-linear relationships between inputs and outputs. But some popular explainability techniques exist.[182]

There have been many cases where a machine learning program passed rigorous tests, but nevertheless learned something different than what the programmers intended. For example, a system that could identify skin diseases better than medical professionals was found to actually have a strong tendency to classify images with a ruler as "cancerous", because pictures of malignancies typically include a ruler to show the scale.[183] Another machine learning system designed to help effectively allocate medical resources was found to classify patients with asthma as being at "low risk" of dying from pneumonia. Having asthma is actually a severe risk factor, but since the patients having asthma would usually get much more medical care, they were relatively unlikely to die according to the training data. The correlation between asthma and low risk of dying from pneumonia was real, but misleading.[184]

People who have been harmed by an algorithm's decision have a right to an explanation. Doctors, for example, are required to clearly and completely explain the reasoning behind any decision they make.[clarification needed][185] Early drafts of the European Union's General Data Protection Regulation in 2016 included an explicit statement that this right exists.[o] Industry experts noted that this is an unsolved problem with no solution in sight. Regulators argued that nevertheless the harm is real: if the problem has no solution, the tools should not be used.[186]

DARPA established the XAI ("Explainable Artificial Intelligence") program in 2014 to try and solve these problems.[187]

There are several potential solutions to the transparency problem. SHAP helps visualise the contribution of each feature to the output.[188] LIME can locally approximate a model with a simpler, interpretable model.[189] Multitask learning provides a large number of outputs in addition to the target classification. These other outputs can help developers deduce what the network has learned.[190] Deconvolution, DeepDream and other generative methods can allow developers to see what different layers of a deep network have learned and produce output that can suggest what the network is learning.[191]

Bad actors and weaponized AI

A lethal autonomous weapon is a machine that locates, selects and engages human targets without human supervision.[p] By 2015, over fifty countries were reported to be researching battlefield robots.[193] These weapons are considered especially dangerous for several reasons: if they kill an innocent person it is not clear who should be held accountable, it is unlikely they will reliably choose targets, and, if produced at scale, they are potentially weapons of mass destruction.[194] In 2014, 30 nations (including China) supported a ban on autonomous weapons under the United Nations' Convention on Certain Conventional Weapons, however the United States and others disagreed.[195]

AI provides a number of tools that are particularly useful for authoritarian governments: smart spyware, face recognition and voice recognition allow widespread surveillance; such surveillance allows machine learning to classify potential enemies of the state and can prevent them from hiding; recommendation systems can precisely target propaganda and misinformation for maximum effect; deepfakes and generative AI aid in producing misinformation; advanced AI can make authoritarian centralized decision making more competitive with liberal and decentralized systems such as markets.[196]

Terrorists, criminals and rogue states can use weaponized AI such as advanced digital warfare and lethal autonomous weapons.

Machine-learning AI is also able to design tens of thousands of toxic molecules in a matter of hours.[197]

Technological unemployment

From the early days of the development of artificial intelligence there have been arguments, for example those put forward by Joseph Weizenbaum, about whether tasks that can be done by computers actually should be done by them, given the difference between computers and humans, and between quantitative calculation and qualitative, value-based judgement.[198]

Economists have frequently highlighted the risks of redundancies from AI, and speculated about unemployment if there is no adequate social policy for full employment.[199]

In the past, technology has tended to increase rather than reduce total employment, but economists acknowledge that "we're in uncharted territory" with AI.[200] A survey of economists showed disagreement about whether the increasing use of robots and AI will cause a substantial increase in long-term unemployment, but they generally agree that it could be a net benefit if productivity gains are redistributed.[201] Risk estimates vary; for example, in the 2010s, Michael Osborne and Carl Benedikt Frey estimated 47% of U.S. jobs are at "high risk" of potential automation, while an OECD report classified only 9% of U.S. jobs as "high risk".[q][203] The methodology of speculating about future employment levels has been criticised as lacking evidential foundation, and for implying that technology, rather than social policy, creates unemployment, as opposed to redundancies.[199]

Unlike previous waves of automation, many middle-class jobs may be eliminated by artificial intelligence; The Economist stated in 2015 that "the worry that AI could do to white-collar jobs what steam power did to blue-collar ones during the Industrial Revolution" is "worth taking seriously".[204] Jobs at extreme risk range from paralegals to fast food cooks, while job demand is likely to increase for care-related professions ranging from personal healthcare to the clergy.[205]

In April 2023, it was reported that 70% of the jobs for Chinese video game illlustrators had been eliminated by generative artificial intelligence.[206][207]

Existential risk

It has been argued AI will become so powerful that humanity may irreversibly lose control of it. This could, as physicist Stephen Hawking stated, "spell the end of the human race".[208] This scenario has been common in science fiction, when a computer or robot suddenly develops a human-like "self-awareness" (or "sentience" or "consciousness") and becomes a malevolent character.[r] These sci-fi scenarios are misleading in several ways.

First, AI does not require human-like "sentience" to be an existential risk. Modern AI programs are given specific goals and use learning and intelligence to achieve them. Philosopher Nick Bostrom argued that if one gives almost any goal to a sufficiently powerful AI, it may choose to destroy humanity to achieve it (he used the example of a paperclip factory manager).[210] Stuart Russell gives the example of household robot that tries to find a way to kill its owner to prevent it from being unplugged, reasoning that "you can't fetch the coffee if you're dead."[211] In order to be safe for humanity, a superintelligence would have to be genuinely aligned with humanity's morality and values so that it is "fundamentally on our side".[212]

Second, Yuval Noah Harari argues that AI does not require a robot body or physical control to pose an existential risk. The essential parts of civilization are not physical. Things like ideologies, law, government, money and the economy are made of language; they exist because there are stories that billions of people believe. The current prevalence of misinformation suggests that an AI could use language to convince people to believe anything, even to take actions that are destructive.[213]

The opinions amongst experts and industry insiders are mixed, with sizable fractions both concerned and unconcerned by risk from eventual superintelligent AI.[214] Personalities such as Stephen Hawking, Bill Gates, and Elon Musk have expressed concern about existential risk from AI.[215] In the early 2010s, experts argued that the risks are too distant in the future to warrant research or that humans will be valuable from the perspective of a superintelligent machine.[216] However, after 2016, the study of current and future risks and possible solutions became a serious area of research.[217] AI pioneers including Fei-Fei Li, Geoffrey Hinton, Yoshua Bengio, Cynthia Breazeal, Rana el Kaliouby, Demis Hassabis, Joy Buolamwini, and Sam Altman have expressed concerns about the risks of AI. In 2023, many leading AI experts issued the joint statement that "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war".[218]

Ethical machines and alignment

Friendly AI are machines that have been designed from the beginning to minimize risks and to make choices that benefit humans. Eliezer Yudkowsky, who coined the term, argues that developing friendly AI should be a higher research priority: it may require a large investment and it must be completed before AI becomes an existential risk.[219]

Machines with intelligence have the potential to use their intelligence to make ethical decisions. The field of machine ethics provides machines with ethical principles and procedures for resolving ethical dilemmas.[220] The field of machine ethics is also called computational morality,[220] and was founded at an AAAI symposium in 2005.[221]

Other approaches include Wendell Wallach's "artificial moral agents"[222] and Stuart J. Russell's three principles for developing provably beneficial machines.[223]

Regulation

Sam Altman seated in front of microphone
OpenAI CEO Sam Altman testifies about AI regulation before a US Senate subcommittee, 2023

The regulation of artificial intelligence is the development of public sector policies and laws for promoting and regulating artificial intelligence (AI); it is therefore related to the broader regulation of algorithms.[224] The regulatory and policy landscape for AI is an emerging issue in jurisdictions globally.[225] According to AI Index at Stanford, the annual number of AI-related laws passed in the 127 survey countries jumped from one passed in 2016 to 37 passed in 2022 alone.[226][227] Between 2016 and 2020, more than 30 countries adopted dedicated strategies for AI.[228] Most EU member states had released national AI strategies, as had Canada, China, India, Japan, Mauritius, the Russian Federation, Saudi Arabia, United Arab Emirates, US and Vietnam. Others were in the process of elaborating their own AI strategy, including Bangladesh, Malaysia and Tunisia.[228] The Global Partnership on Artificial Intelligence was launched in June 2020, stating a need for AI to be developed in accordance with human rights and democratic values, to ensure public confidence and trust in the technology.[228] Henry Kissinger, Eric Schmidt, and Daniel Huttenlocher published a joint statement in November 2021 calling for a government commission to regulate AI.[229] In 2023, OpenAI leaders published recommendations for the governance of superintelligence, which they believe may happen in less than 10 years.[230]

In a 2022 Ipsos survey, attitudes towards AI varied greatly by country; 78% of Chinese citizens, but only 35% of Americans, agreed that "products and services using AI have more benefits than drawbacks".[226] A 2023 Reuters/Ipsos poll found that 61% of Americans agree, and 22% disagree, that AI poses risks to humanity.[231] In a 2023 Fox News poll, 35% of Americans thought it "very important", and an additional 41% thought it "somewhat important", for the federal government to regulate AI, versus 13% responding "not very important" and 8% responding "not at all important".[232][233]

In November 2023, a global AI safety summit was held in Bletchley Park to discuss the near and far term risks of AI and the possibility of mandatory and voluntary regulatory frameworks.[234]

History

The study of mechanical or "formal" reasoning began with philosophers and mathematicians in antiquity. The study of logic led directly to Alan Turing's theory of computation, which suggested that a machine, by shuffling symbols as simple as "0" and "1", could simulate both mathematical deduction and formal reasoning, which is known as the Church–Turing thesis.[235] This, along with concurrent discoveries in cybernetics and information theory, led researchers to consider the possibility of building an "electronic brain".[s][237] The first paper later recognized as "AI" was McCullouch and Pitts design for Turing-complete "artificial neurons" in 1943.[238]

The field of AI research was founded at a workshop at Dartmouth College in 1956.[t][2] The attendees became the leaders of AI research in the 1960s.[u] They and their students produced programs that the press described as "astonishing":[v] computers were learning checkers strategies, solving word problems in algebra, proving logical theorems and speaking English.[w][3]

By the middle of the 1960s, research in the U.S. was heavily funded by the Department of Defense[242] and laboratories had been established around the world.[243] Herbert Simon predicted, "machines will be capable, within twenty years, of doing any work a man can do".[244] Marvin Minsky agreed, writing, "within a generation ... the problem of creating 'artificial intelligence' will substantially be solved".[245]

They had, however, underestimated the difficulty of the problem.[x] Both the U.S. and British governments cut off exploratory research in response to the criticism of Sir James Lighthill[247] and ongoing pressure from the U.S. Congress to fund more productive projects. Minsky's and Papert's book Perceptrons was understood as proving that artificial neural networks would never be useful for solving real-world tasks, thus discrediting the approach altogether.[248] The "AI winter", a period when obtaining funding for AI projects was difficult, followed.[5]

In the early 1980s, AI research was revived by the commercial success of expert systems,[249] a form of AI program that simulated the knowledge and analytical skills of human experts. By 1985, the market for AI had reached over a billion dollars. At the same time, Japan's fifth generation computer project inspired the U.S. and British governments to restore funding for academic research.[4] However, beginning with the collapse of the Lisp Machine market in 1987, AI once again fell into disrepute, and a second, longer-lasting winter began.[6]

Many researchers began to doubt that the current practices would be able to imitate all the processes of human cognition, especially perception, robotics, learning and pattern recognition.[250] A number of researchers began to look into "sub-symbolic" approaches.[251] Robotics researchers, such as Rodney Brooks, rejected "representation" in general and focussed directly on engineering machines that move and survive.[y]. Judea Pearl, Lofti Zadeh and others developed methods that handled incomplete and uncertain information by making reasonable guesses rather than precise logic.[83][256] But the most important development was the revival of "connectionism", including neural network research, by Geoffrey Hinton and others.[257] In 1990, Yann LeCun successfully showed that convolutional neural networks can recognize handwritten digits, the first of many successful applications of neural networks.[258]

AI gradually restored its reputation in the late 1990s and early 21st century by exploiting formal mathematical methods and by finding specific solutions to specific problems. This "narrow" and "formal" focus allowed researchers to produce verifiable results and collaborate with other fields (such as statistics, economics and mathematics).[259] By 2000, solutions developed by AI researchers were being widely used, although in the 1990s they were rarely described as "artificial intelligence".[260]

Several academic researchers became concerned that AI was no longer pursuing the original goal of creating versatile, fully intelligent machines. Beginning around 2002, they founded the subfield of artificial general intelligence (or "AGI"), which had several well-funded institutions by the 2010s.[8]

Deep learning began to dominate industry benchmarks in 2012 and was adopted throughout the field.[7] For many specific tasks, other methods were abandoned.[z] Deep learning's success was based on both hardware improvements (faster computers,[262] graphics processing units, cloud computing[263]) and access to large amounts of data[264] (including curated datasets,[263] such as ImageNet).

Deep learning's success led to an enormous increase in interest and funding in AI.[aa] The amount of machine learning research (measured by total publications) increased by 50% in the years 2015–2019,[228] and WIPO reported that AI was the most prolific emerging technology in terms of the number of patent applications and granted patents.[265] According to 'AI Impacts', about $50 billion annually was invested in "AI" around 2022 in the US alone and about 20% of new US Computer Science PhD graduates have specialized in "AI";[266] about 800,000 "AI"-related US job openings existed in 2022.[267]

In 2016, issues of fairness and the misuse of technology were catapulted into center stage at machine learning conferences, publications vastly increased, funding became available, and many researchers re-focussed their careers on these issues. The alignment problem became a serious field of academic study.[217]

Philosophy

Defining artificial intelligence

Alan Turing wrote in 1950 "I propose to consider the question 'can machines think'?"[268] He advised changing the question from whether a machine "thinks", to "whether or not it is possible for machinery to show intelligent behaviour".[268] He devised the Turing test, which measures the ability of a machine to simulate human conversation.[269] Since we can only observe the behavior of the machine, it does not matter if it is "actually" thinking or literally has a "mind". Turing notes that we can not determine these things about other people[ab] but "it is usual to have a polite convention that everyone thinks"[270]

Russell and Norvig agree with Turing that AI must be defined in terms of "acting" and not "thinking".[271] However, they are critical that the test compares machines to people. "Aeronautical engineering texts," they wrote, "do not define the goal of their field as making 'machines that fly so exactly like pigeons that they can fool other pigeons.'"[272] AI founder John McCarthy agreed, writing that "Artificial intelligence is not, by definition, simulation of human intelligence".[273]

McCarthy defines intelligence as "the computational part of the ability to achieve goals in the world."[274] Another AI founder, Marvin Minsky similarly defines it as "the ability to solve hard problems".[275] These definitions view intelligence in terms of well-defined problems with well-defined solutions, where both the difficulty of the problem and the performance of the program are direct measures of the "intelligence" of the machine—and no other philosophical discussion is required, or may not even be possible.

Another definition has been adopted by Google,[276] a major practitioner in the field of AI. This definition stipulates the ability of systems to synthesize information as the manifestation of intelligence, similar to the way it is defined in biological intelligence.

Evaluating approaches to AI

No established unifying theory or paradigm has guided AI research for most of its history.[ac] The unprecedented success of statistical machine learning in the 2010s eclipsed all other approaches (so much so that some sources, especially in the business world, use the term "artificial intelligence" to mean "machine learning with neural networks"). This approach is mostly sub-symbolic, soft and narrow (see below). Critics argue that these questions may have to be revisited by future generations of AI researchers.

Symbolic AI and its limits

Symbolic AI (or "GOFAI")[278] simulated the high-level conscious reasoning that people use when they solve puzzles, express legal reasoning and do mathematics. They were highly successful at "intelligent" tasks such as algebra or IQ tests. In the 1960s, Newell and Simon proposed the physical symbol systems hypothesis: "A physical symbol system has the necessary and sufficient means of general intelligent action."[279]

However, the symbolic approach failed on many tasks that humans solve easily, such as learning, recognizing an object or commonsense reasoning. Moravec's paradox is the discovery that high-level "intelligent" tasks were easy for AI, but low level "instinctive" tasks were extremely difficult.[280] Philosopher Hubert Dreyfus had argued since the 1960s that human expertise depends on unconscious instinct rather than conscious symbol manipulation, and on having a "feel" for the situation, rather than explicit symbolic knowledge.[281] Although his arguments had been ridiculed and ignored when they were first presented, eventually, AI research came to agree.[ad][13]

The issue is not resolved: sub-symbolic reasoning can make many of the same inscrutable mistakes that human intuition does, such as algorithmic bias. Critics such as Noam Chomsky argue continuing research into symbolic AI will still be necessary to attain general intelligence,[283][284] in part because sub-symbolic AI is a move away from explainable AI: it can be difficult or impossible to understand why a modern statistical AI program made a particular decision. The emerging field of neuro-symbolic artificial intelligence attempts to bridge the two approaches.

Neat vs. scruffy

"Neats" hope that intelligent behavior is described using simple, elegant principles (such as logic, optimization, or neural networks). "Scruffies" expect that it necessarily requires solving a large number of unrelated problems. Neats defend their programs with theoretical rigor, scruffies rely mainly on incremental testing to see if they work. This issue was actively discussed in the 70s and 80s,[285] but eventually was seen as irrelevant. Modern AI has elements of both.

Soft vs. hard computing

Finding a provably correct or optimal solution is intractable for many important problems.[12] Soft computing is a set of techniques, including genetic algorithms, fuzzy logic and neural networks, that are tolerant of imprecision, uncertainty, partial truth and approximation. Soft computing was introduced in the late 80s and most successful AI programs in the 21st century are examples of soft computing with neural networks.

Narrow vs. general AI

AI researchers are divided as to whether to pursue the goals of artificial general intelligence and superintelligence directly or to solve as many specific problems as possible (narrow AI) in hopes these solutions will lead indirectly to the field's long-term goals.[286][287] General intelligence is difficult to define and difficult to measure, and modern AI has had more verifiable successes by focusing on specific problems with specific solutions. The experimental sub-field of artificial general intelligence studies this area exclusively.

Machine consciousness, sentience and mind

The philosophy of mind does not know whether a machine can have a mind, consciousness and mental states, in the same sense that human beings do. This issue considers the internal experiences of the machine, rather than its external behavior. Mainstream AI research considers this issue irrelevant because it does not affect the goals of the field: to build machines that can solve problems using intelligence. Russell and Norvig add that "[t]he additional project of making a machine conscious in exactly the way humans are is not one that we are equipped to take on."[288] However, the question has become central to the philosophy of mind. It is also typically the central question at issue in artificial intelligence in fiction.

Consciousness

David Chalmers identified two problems in understanding the mind, which he named the "hard" and "easy" problems of consciousness.[289] The easy problem is understanding how the brain processes signals, makes plans and controls behavior. The hard problem is explaining how this feels or why it should feel like anything at all, assuming we are right in thinking that it truly does feel like something (Dennett's consciousness illusionism says this is an illusion). Human information processing is easy to explain, however, human subjective experience is difficult to explain. For example, it is easy to imagine a color-blind person who has learned to identify which objects in their field of view are red, but it is not clear what would be required for the person to know what red looks like.[290]

Computationalism and functionalism

Computationalism is the position in the philosophy of mind that the human mind is an information processing system and that thinking is a form of computing. Computationalism argues that the relationship between mind and body is similar or identical to the relationship between software and hardware and thus may be a solution to the mind–body problem. This philosophical position was inspired by the work of AI researchers and cognitive scientists in the 1960s and was originally proposed by philosophers Jerry Fodor and Hilary Putnam.[291]

Philosopher John Searle characterized this position as "strong AI": "The appropriately programmed computer with the right inputs and outputs would thereby have a mind in exactly the same sense human beings have minds."[ae] Searle counters this assertion with his Chinese room argument, which attempts to show that, even if a machine perfectly simulates human behavior, there is still no reason to suppose it also has a mind.[295]

Robot rights

If a machine has a mind and subjective experience, then it may also have sentience (the ability to feel), and if so it could also suffer; it has been argued that this could entitle it to certain rights.[296] Any hypothetical robot rights would lie on a spectrum with animal rights and human rights.[297] This issue has been considered in fiction for centuries,[298] and is now being considered by, for example, California's Institute for the Future; however, critics argue that the discussion is premature.[299]

Future

Superintelligence and the singularity

A superintelligence is a hypothetical agent that would possess intelligence far surpassing that of the brightest and most gifted human mind.[287]

If research into artificial general intelligence produced sufficiently intelligent software, it might be able to reprogram and improve itself. The improved software would be even better at improving itself, leading to what I. J. Good called an "intelligence explosion" and Vernor Vinge called a "singularity".[300]

However, technologies can't improve exponentially indefinitely, and typically follow an S-shaped curve, slowing when they reach the physical limits of what the technology can do.[301]

Transhumanism

Robot designer Hans Moravec, cyberneticist Kevin Warwick, and inventor Ray Kurzweil have predicted that humans and machines will merge in the future into cyborgs that are more capable and powerful than either. This idea, called transhumanism, has roots in Aldous Huxley and Robert Ettinger.[302]

Edward Fredkin argues that "artificial intelligence is the next stage in evolution", an idea first proposed by Samuel Butler's "Darwin among the Machines" as far back as 1863, and expanded upon by George Dyson in his book of the same name in 1998.[303]

In fiction

The word "robot" itself was coined by Karel Čapek in his 1921 play R.U.R., the title standing for "Rossum's Universal Robots".

Thought-capable artificial beings have appeared as storytelling devices since antiquity,[304] and have been a persistent theme in science fiction.[305]

A common trope in these works began with Mary Shelley's Frankenstein, where a human creation becomes a threat to its masters. This includes such works as Arthur C. Clarke's and Stanley Kubrick's 2001: A Space Odyssey (both 1968), with HAL 9000, the murderous computer in charge of the Discovery One spaceship, as well as The Terminator (1984) and The Matrix (1999). In contrast, the rare loyal robots such as Gort from The Day the Earth Stood Still (1951) and Bishop from Aliens (1986) are less prominent in popular culture.[306]

Isaac Asimov introduced the Three Laws of Robotics in many books and stories, most notably the "Multivac" series about a super-intelligent computer of the same name. Asimov's laws are often brought up during lay discussions of machine ethics;[307] while almost all artificial intelligence researchers are familiar with Asimov's laws through popular culture, they generally consider the laws useless for many reasons, one of which is their ambiguity.[308]

Several works use AI to force us to confront the fundamental question of what makes us human, showing us artificial beings that have the ability to feel, and thus to suffer. This appears in Karel Čapek's R.U.R., the films A.I. Artificial Intelligence and Ex Machina, as well as the novel Do Androids Dream of Electric Sheep?, by Philip K. Dick. Dick considers the idea that our understanding of human subjectivity is altered by technology created with artificial intelligence.[309]

See also

Explanatory notes

  1. ^ a b This list of intelligent traits is based on the topics covered by the major AI textbooks, including: Russell & Norvig (2021), Luger & Stubblefield (2004), Poole, Mackworth & Goebel (1998) and Nilsson (1998)
  2. ^ a b This list of tools is based on the topics covered by the major AI textbooks, including: Russell & Norvig (2021), Luger & Stubblefield (2004), Poole, Mackworth & Goebel (1998) and Nilsson (1998)
  3. ^ It is among the reasons that expert systems proved to be inefficient for capturing knowledge.[27][28]
  4. ^ "Rational agent" is general term used in economics, philosophy and theoretical artificial intelligence. It can refer to anything that directs its behavior to accomplish goals, such as a person, an animal, a corporation, a nation, or, in the case of AI, a computer program.
  5. ^ Alan Turing discussed the centrality of learning as early as 1950, in his classic paper "Computing Machinery and Intelligence".[40] In 1956, at the original Dartmouth AI summer conference, Ray Solomonoff wrote a report on unsupervised probabilistic machine learning: "An Inductive Inference Machine".[41]
  6. ^ See AI winter § Machine translation and the ALPAC report of 1966
  7. ^ Compared with symbolic logic, formal Bayesian inference is computationally expensive. For inference to be tractable, most observations must be conditionally independent of one another. AdSense uses a Bayesian network with over 300 million edges to learn which ads to serve.[85]
  8. ^ Expectation-maximization, one of the most popular algorithms in machine learning, allows clustering in the presence of unknown latent variables.[87]
  9. ^ Russell and Norvig suggest the alternative term "computational graphs" – that is, an abstract network (or "graph") where the edges and nodes are assigned numeric values.
  10. ^ Some form of deep neural networks (without a specific learning algorithm) were described by: Alan Turing (1948);[113] Frank Rosenblatt(1957);[113] Karl Steinbuch and Roger David Joseph (1961).[114] Deep or recurrent networks that learned (or used gradient descent) were developed by: Ernst Ising and Wilhelm Lenz (1925);[115] Oliver Selfridge (1959);[114] Alexey Ivakhnenko and Valentin Lapa (1965);[115] Kaoru Nakano (1977);[116] Shun-Ichi Amari (1972);[116] John Joseph Hopfield (1982).[116] Backpropagation was independently discovered by: Henry J. Kelley (1960);[113] Arthur E. Bryson (1962);[113] Stuart Dreyfus (1962);[113] Arthur E. Bryson and Yu-Chi Ho (1969);[113] Seppo Linnainmaa (1970);[117] Paul Werbos (1974).[113] In fact, backpropagation and gradient descent are straight forward applications of Gottfried Leibniz' chain rule in calculus (1676),[118] and is essentially identical (for one layer) to the method of least squares, developed independently by Johann Carl Friedrich Gauss (1795) and Adrien-Marie Legendre (1805).[119] There are probably many others, yet to be discovered by historians of science.
  11. ^ Geoffrey Hinton said, of his work on neural networks in the 1990s, "our labeled datasets were thousands of times too small. [And] our computers were millions of times too slow"[120]
  12. ^ The Smithsonian reports: "Pluribus has bested poker pros in a series of six-player no-limit Texas Hold'em games, reaching a milestone in artificial intelligence research. It is the first bot to beat humans in a complex multiplayer competition."[136]
  13. ^ Including Jon Kleinberg (Cornell), Sendhil Mullainathan (University of Chicago), Cynthia Chouldechova (Carnegie Mellon) and Sam Corbett-Davis (Stanford)[172]
  14. ^ Moritz Hardt (a director at the Max Planck Institute for Intelligent Systems) argues that machine learning "is fundamentally the wrong tool for a lot of domains, where you're trying to design interventions and mechanisms that change the world."[177]
  15. ^ When the law was passed in 2018, it still contained a form of this provision.
  16. ^ This is the United Nations' definition, and includes things like land mines as well.[192]
  17. ^ See table 4; 9% is both the OECD average and the US average.[202]
  18. ^ Sometimes called a "robopocalypse".[209]
  19. ^ "Electronic brain" was the term used by the press around this time.[236]
  20. ^ Daniel Crevier wrote, "the conference is generally recognized as the official birthdate of the new science."[239] Russell and Norvig called the conference "the inception of artificial intelligence."[238]
  21. ^ Russell and Norvig wrote "for the next 20 years the field would be dominated by these people and their students."[240]
  22. ^ Russell and Norvig wrote "it was astonishing whenever a computer did anything kind of smartish".[241]
  23. ^ The programs described are Arthur Samuel's checkers program for the IBM 701, Daniel Bobrow's STUDENT, Newell and Simon's Logic Theorist and Terry Winograd's SHRDLU.
  24. ^ Russell and Norvig write: "in almost all cases, these early systems failed on more difficult problems"[246]
  25. ^ Embodied approaches to AI[252] were championed by Hans Moravec[253] and Rodney Brooks[254] and went by many names: Nouvelle AI.[254] Developmental robotics,[255]
  26. ^ Matteo Wong wrote in The Atlantic: "Whereas for decades, computer-science fields such as natural-language processing, computer vision, and robotics used extremely different methods, now they all use a programming method called "deep learning." As a result, their code and approaches have become more similar, and their models are easier to integrate into one another."[261]
  27. ^ Jack Clark wrote in Bloomberg: "After a half-decade of quiet breakthroughs in artificial intelligence, 2015 has been a landmark year. Computers are smarter and learning faster than ever," and noted that the number of software projects that use machine learning at Google increased from a "sporadic usage" in 2012 to more than 2,700 projects in 2015.[263]
  28. ^ See Problem of other minds
  29. ^ Nils Nilsson wrote in 1983: "Simply put, there is wide disagreement in the field about what AI is all about."[277]
  30. ^ Daniel Crevier wrote that "time has proven the accuracy and perceptiveness of some of Dreyfus's comments. Had he formulated them less aggressively, constructive actions they suggested might have been taken much earlier."[282]
  31. ^ Searle presented this definition of "Strong AI" in 1999.[292] Searle's original formulation was "The appropriately programmed computer really is a mind, in the sense that computers given the right programs can be literally said to understand and have other cognitive states."[293] Strong AI is defined similarly by Russell and Norvig: "Stong AI – the assertion that machines that do so are actually thinking (as opposed to simulating thinking)."[294]

References

  1. ^ Google (2016).
  2. ^ a b Dartmouth workshop: The proposal:
  3. ^ a b Successful programs the 60s:
  4. ^ a b Funding initiatives in the early 80s: Fifth Generation Project (Japan), Alvey (UK), Microelectronics and Computer Technology Corporation (US), Strategic Computing Initiative (US):
  5. ^ a b First AI Winter, Lighthill report, Mansfield Amendment
  6. ^ a b Second AI Winter:
  7. ^ a b Deep learning revolution, AlexNet:
  8. ^ a b c Artificial general intelligence: Proposal for the modern version: Warnings of overspecialization in AI from leading researchers:
  9. ^ Russell & Norvig (2021, §1.2)
  10. ^ Problem solving, puzzle solving, game playing and deduction:
  11. ^ Uncertain reasoning:
  12. ^ a b c Intractability and efficiency and the combinatorial explosion:
  13. ^ a b c Psychological evidence of the prevalence sub-symbolic reasoning and knowledge:
  14. ^ Knowledge representation and knowledge engineering:
  15. ^ Smoliar & Zhang (1994).
  16. ^ Neumann & Möller (2008).
  17. ^ Kuperman, Reichley & Bailey (2006).
  18. ^ McGarry (2005).
  19. ^ Bertini, Del Bimbo & Torniai (2006).
  20. ^ Russell & Norvig (2021), pp. 272.
  21. ^ Representing categories and relations: Semantic networks, description logics, inheritance (including frames and scripts):
  22. ^ Representing events and time:Situation calculus, event calculus, fluent calculus (including solving the frame problem):
  23. ^ Causal calculus:
  24. ^ Representing knowledge about knowledge: Belief calculus, modal logics:
  25. ^ a b Default reasoning, Frame problem, default logic, non-monotonic logics, circumscription, closed world assumption, abduction: (Poole et al. places abduction under "default reasoning". Luger et al. places this under "uncertain reasoning").
  26. ^ a b Breadth of commonsense knowledge:
  27. ^ Newquist (1994), p. 296.
  28. ^ Crevier (1993), pp. 204–208.
  29. ^ Gertner (2023).
  30. ^ Russell & Norvig (2021), p. 528.
  31. ^ Automated planning:
  32. ^ Automated decision making, Decision theory:
  33. ^ Classical planning:
  34. ^ Sensorless or "conformant" planning, contingent planning, replanning (a.k.a online planning):
  35. ^ Uncertain preferences: Inverse reinforcement learning:
  36. ^ Information value theory:
  37. ^ Markov decision process:
  38. ^ Game theory and multi-agent decision theory:
  39. ^ Learning:
  40. ^ Turing (1950).
  41. ^ Solomonoff (1956).
  42. ^ Unsupervised learning:
  43. ^ a b Supervised learning:
  44. ^ Reinforcement learning:
  45. ^ Transfer learning:
  46. ^ "Artificial Intelligence (AI): What Is AI and How Does It Work? | Built In". builtin.com. Retrieved 30 October 2023.
  47. ^ Computational learning theory:
  48. ^ Natural language processing (NLP):
  49. ^ Subproblems of NLP:
  50. ^ Russell & Norvig (2021), p. 856–858.
  51. ^ Dickson (2022).
  52. ^ Modern statistical and deep learning approaches to NLP:
  53. ^ Vincent (2019).
  54. ^ Russell & Norvig (2021), p. 875–878.
  55. ^ Bushwick (2023).
  56. ^ Computer vision:
  57. ^ Russell & Norvig (2021), pp. 849–850.
  58. ^ Russell & Norvig (2021), pp. 895–899.
  59. ^ Russell & Norvig (2021), pp. 899–901.
  60. ^ Russell & Norvig (2021), pp. 931–938.
  61. ^ MIT AIL (2014).
  62. ^ Affective computing:
  63. ^ Waddell (2018).
  64. ^ Poria et al. (2017).
  65. ^ Search algorithms:
  66. ^ State space search:
  67. ^ Russell & Norvig (2021), §11.2.
  68. ^ Uninformed searches (breadth first search, depth-first search and general state space search):
  69. ^ Heuristic or informed searches (e.g., greedy best first and A*):
  70. ^ Adversarial search:
  71. ^ Local or "optimization" search:
  72. ^ Evolutionary computation:
  73. ^ Merkle & Middendorf (2013).
  74. ^ Logic:
  75. ^ Propositional logic:
  76. ^ First-order logic and features such as equality:
  77. ^ Logical inference:
  78. ^ Russell & Norvig (2021), §8.3.1.
  79. ^ Resolution and unification:
  80. ^ Forward chaining, backward chaining, Horn clauses, and logical deduction as search:
  81. ^ citation in progress
  82. ^ Fuzzy logic:
  83. ^ a b Stochastic methods for uncertain reasoning:
  84. ^ Bayesian networks:
  85. ^ Domingos (2015), chapter 6.
  86. ^ Bayesian inference algorithm:
  87. ^ Domingos (2015), p. 210.
  88. ^ Bayesian learning and the expectation-maximization algorithm:
  89. ^ Bayesian decision theory and Bayesian decision networks:
  90. ^ a b c Stochastic temporal models: Hidden Markov model: Kalman filters: Dynamic Bayesian networks:
  91. ^ decision theory and decision analysis:
  92. ^ Information value theory:
  93. ^ Markov decision processes and dynamic decision networks:
  94. ^ Game theory and mechanism design:
  95. ^ Statistical learning methods and classifiers:
  96. ^ Decision trees:
  97. ^ Non-parameteric learning models such as K-nearest neighbor and support vector machines:
  98. ^ Domingos (2015), p. 152.
  99. ^ Naive Bayes classifier:
  100. ^ a b Neural networks:
  101. ^ Russell & Norvig (2021), p. 750.
  102. ^ Gradient calculation in computational graphs, backpropagation, automatic differentiation:
  103. ^ Universal approximation theorem: The theorem:
  104. ^ Feedforward neural networks:
  105. ^ Recurrent neural networks:
  106. ^ Perceptrons:
  107. ^ a b Deep learning:
  108. ^ Convolutional neural networks:
  109. ^ Schulz & Behnke (2012).
  110. ^ Deng & Yu (2014), pp. 199–200.
  111. ^ Ciresan, Meier & Schmidhuber (2012).
  112. ^ Russell & Norvig (2021), p. 751.
  113. ^ a b c d e f g Russell & Norvig (2021), p. 785.
  114. ^ a b Schmidhuber (2022), §5.
  115. ^ a b Schmidhuber (2022), §6.
  116. ^ a b c Schmidhuber (2022), §7.
  117. ^ Schmidhuber (2022), §8.
  118. ^ Schmidhuber (2022), §2.
  119. ^ Schmidhuber (2022), §3.
  120. ^ Quoted in Christian (2020, p. 22)
  121. ^ Kobielus (2019).
  122. ^ Targeted advertising:
  123. ^ Lohr (2016).
  124. ^ Smith (2016).
  125. ^ Rowinski (2013).
  126. ^ MIT Sloan Management Review (2018); Lorica (2017)
  127. ^ Frangoul (2019).
  128. ^ Aletras et al. (2016).
  129. ^ Chen (2023).
  130. ^ McCorduck (2004), pp. 480–483.
  131. ^ Markoff (2011).
  132. ^ Google (2016); BBC (2016)
  133. ^ "World's Go Player Ratings". May 2017.
  134. ^ "柯洁迎19岁生日 雄踞人类世界排名第一已两年" (in Chinese). May 2017.
  135. ^ "韩版围棋世界排名:与欧洲版差别大 连笑进前三" (in Chinese).
  136. ^ Solly (2019).
  137. ^ Bowling et al. (2015).
  138. ^ Sample (2017a).
  139. ^ Vogels (2023).
  140. ^ Verma & Schaul (2023).
  141. ^ Kahn (2023).
  142. ^ Novak (2023).
  143. ^ Sharma (2023).
  144. ^ Oremus, Harwell & Armus (2023).
  145. ^ Kolirin (2023).
  146. ^ Eapen et al. (2023).
  147. ^ Heath (2020).
  148. ^ Simonite (2016).
  149. ^ Russell & Norvig (2021), p. 987.
  150. ^ Laskowski (2023).
  151. ^ GAO (2022).
  152. ^ Valinsky (2019).
  153. ^ Russell & Norvig (2021), p. 991.
  154. ^ Russell & Norvig (2021), p. 991–992.
  155. ^ Christian (2020), p. 63.
  156. ^ Vincent (2022).
  157. ^ Reisner (2023).
  158. ^ Alter & Harris (2023).
  159. ^ Nicas (2018).
  160. ^ "Trust and Distrust in America".
  161. ^ Williams (2023).
  162. ^ Taylor & Hern (2023).
  163. ^ a b Rose (2023).
  164. ^ CNA (2019).
  165. ^ Goffrey (2008), p. 17.
  166. ^ Berdahl et al. (2023); Goffrey (2008, p. 17); Rose (2023); Russell & Norvig (2021, p. 995)
  167. ^ Algorithmic bias and Fairness (machine learning):
  168. ^ Christian (2020), p. 25.
  169. ^ a b Russell & Norvig (2021), p. 995.
  170. ^ Grant & Hill (2023).
  171. ^ Larson & Angwin (2016).
  172. ^ Christian (2020), p. 67–70.
  173. ^ Christian (2020, p. 67–70); Russell & Norvig (2021, p. 993–994)
  174. ^ Russell & Norvig (2021, p. 995); Lipartito (2011, p. 36); Goodman & Flaxman (2017, p. 6); Christian (2020, p. 39-40, 65)
  175. ^ Quoted in Christian (2020, p. 65).
  176. ^ Russell & Norvig (2021, p. 994); Christian (2020, p. 40, 80-81)
  177. ^ Quoted in Christian (2020, p. 80)
  178. ^ Dockrill (2022).
  179. ^ a b c d e Chanda SS, Banerjee DN (2022). "Omission and commission errors underlying AI failures". AI Soc: 1–24. doi:10.1007/s00146-022-01585-x. PMC 9669536. PMID 36415822.
  180. ^ Greenberg A (14 November 2017). "Watch a 10-Year-Old's Face Unlock His Mom's iPhone X". Wired.
  181. ^ Sample (2017b).
  182. ^ "Black Box AI". 16 June 2023.
  183. ^ Christian (2020), p. 110.
  184. ^ Christian (2020), pp. 88–91.
  185. ^ Christian (2020, p. 83); Russell & Norvig (2021, p. 997)
  186. ^ Christian (2020), p. 91.
  187. ^ Christian (2020), p. 83.
  188. ^ Verma (2021).
  189. ^ Rothman (2020).
  190. ^ Christian (2020), p. 105-108.
  191. ^ Christian (2020), pp. 108–112.
  192. ^ Russell & Norvig (2021), p. 989.
  193. ^ Robitzski (2018); Sainato (2015)
  194. ^ Russell & Norvig (2021), p. 987-990.
  195. ^ Russell & Norvig (2021), p. 988.
  196. ^ Harari (2018).
  197. ^ Urbina et al. (2022).
  198. ^ Tarnoff, Ben (4 August 2023). "Lessons from Eliza". The Guardian Weekly. pp. 34–9.
  199. ^ a b E McGaughey, 'Will Robots Automate Your Job Away? Full Employment, Basic Income, and Economic Democracy' (2022) 51(3) Industrial Law Journal 511–559 Archived 27 May 2023 at the Wayback Machine
  200. ^ Ford & Colvin (2015);McGaughey (2022)
  201. ^ IGM Chicago (2017).
  202. ^ Arntz, Gregory & Zierahn (2016), p. 33.
  203. ^ Lohr (2017); Frey & Osborne (2017); Arntz, Gregory & Zierahn (2016, p. 33)
  204. ^ Morgenstern (2015).
  205. ^ Mahdawi (2017); Thompson (2014)
  206. ^ Zhou, Viola (11 April 2023). "AI is already taking video game illustrators' jobs in China". Rest of World. Retrieved 17 August 2023.
  207. ^ Carter, Justin (11 April 2023). "China's game art industry reportedly decimated by growing AI use". Game Developer. Retrieved 17 August 2023.
  208. ^ Cellan-Jones (2014).
  209. ^ Russell & Norvig 2021, p. 1001.
  210. ^ Bostrom (2014).
  211. ^ Russell (2019).
  212. ^ Bostrom (2014); Müller & Bostrom (2014); Bostrom (2015)
  213. ^ Harari (2023).
  214. ^ Müller & Bostrom (2014).
  215. ^ Leaders' concerns about the existential risks of AI around 2015:
  216. ^ Arguments that AI is not an imminent risk:
  217. ^ a b Christian (2020), pp. 67, 73.
  218. ^ Valance (2023).
  219. ^ Yudkowsky (2008).
  220. ^ a b Anderson & Anderson (2011).
  221. ^ AAAI (2014).
  222. ^ Wallach (2010).
  223. ^ Russell (2019), p. 173.
  224. ^ Regulation of AI to mitigate risks:
  225. ^ a b Vincent (2023).
  226. ^ Stanford University (2023).
  227. ^ a b c d UNESCO (2021).
  228. ^ Kissinger (2021).
  229. ^ Altman, Brockman & Sutskever (2023).
  230. ^ Edwards (2023).
  231. ^ Kasperowicz (2023).
  232. ^ Fox News (2023).
  233. ^ Milmo, Dan (3 November 2023). "Hope or Horror? The great AI debate dividing its pioneers". The Guardian Weekly. pp. 10–12.
  234. ^ Berlinski (2000).
  235. ^ "Google books ngram".
  236. ^ AI's immediate precursors:
  237. ^ a b Russell & Norvig (2021), p. 17.
  238. ^ Crevier (1993), pp. 47–49.
  239. ^ Russell & Norvig (2003), p. 17.
  240. ^ Russell & Norvig (2003), p. 18.
  241. ^ AI heavily funded in the 1960s:
  242. ^ Howe (1994).
  243. ^ Simon (1965, p. 96) quoted in Crevier (1993, p. 109)
  244. ^ Minsky (1967, p. 2) quoted in Crevier (1993, p. 109)
  245. ^ Russell & Norvig (2021), p. 21.
  246. ^ Lighthill (1973).
  247. ^ Russell & Norvig (2021), p. 22.
  248. ^ Expert systems:
  249. ^ Russell & Norvig (2021), p. 24.
  250. ^ Nilsson (1998), p. 7.
  251. ^ McCorduck (2004), pp. 454–462.
  252. ^ Moravec (1988).
  253. ^ a b Brooks (1990).
  254. ^ Developmental robotics:
  255. ^ Russell & Norvig (2021), p. 25.
  256. ^
  257. ^ Russell & Norvig (2021), p. 26.
  258. ^ Formal and narrow methods adopted in the 1990s:
  259. ^ AI widely used in the late 1990s:
  260. ^ Wong (2023).
  261. ^ Moore's Law and AI:
  262. ^ a b c Clark (2015b).
  263. ^ Big data:
  264. ^ "Intellectual Property and Frontier Technologies". WIPO. Archived from the original on 2 April 2022. Retrieved 30 March 2022.
  265. ^ DiFeliciantonio (2023).
  266. ^ Goswami (2023).
  267. ^ a b Turing (1950), p. 1.
  268. ^ Turing's original publication of the Turing test in "Computing machinery and intelligence": Historical influence and philosophical implications:
  269. ^ Turing (1950), Under "The Argument from Consciousness".
  270. ^ Russell & Norvig (2021), chpt. 2.
  271. ^ Russell & Norvig (2021), p. 3.
  272. ^ Maker (2006).
  273. ^ McCarthy (1999).
  274. ^ Minsky (1986).
  275. ^ "What Is Artificial Intelligence (AI)?". Google Cloud Platform. Archived from the original on 31 July 2023. Retrieved 16 October 2023.
  276. ^ Nilsson (1983), p. 10.
  277. ^ Haugeland (1985), pp. 112–117.
  278. ^ Physical symbol system hypothesis: Historical significance:
  279. ^ Moravec's paradox:
  280. ^ Dreyfus' critique of AI: Historical significance and philosophical implications:
  281. ^ Crevier (1993), p. 125.
  282. ^ Langley (2011).
  283. ^ Katz (2012).
  284. ^ Neats vs. scruffies, the historic debate: A classic example of the "scruffy" approach to intelligence: A modern example of neat AI and its aspirations in the 21st century:
  285. ^ Pennachin & Goertzel (2007).
  286. ^ a b Roberts (2016).
  287. ^ Russell & Norvig (2021), p. 986.
  288. ^ Chalmers (1995).
  289. ^ Dennett (1991).
  290. ^ Horst (2005).
  291. ^ Searle (1999).
  292. ^ Searle (1980), p. 1.
  293. ^ Russell & Norvig (2021), p. 9817.
  294. ^ Searle's Chinese room argument: Discussion:
  295. ^ Robot rights:
  296. ^ Evans (2015).
  297. ^ McCorduck (2004), pp. 19–25.
  298. ^ Henderson (2007).
  299. ^ The Intelligence explosion and technological singularity: I. J. Good's "intelligence explosion" Vernor Vinge's "singularity"
  300. ^ Russell & Norvig (2021), p. 1005.
  301. ^ Transhumanism:
  302. ^ AI as evolution:
  303. ^ AI in myth:
  304. ^ McCorduck (2004), pp. 340–400.
  305. ^ Buttazzo (2001).
  306. ^ Anderson (2008).
  307. ^ McCauley (2007).
  308. ^ Galvan (1997).

AI textbooks

The two most widely used textbooks in 2023. (See the Open Syllabus).

These were the four the most widely used AI textbooks in 2008:

Later editions.

History of AI

Other sources

Further reading

External links