Artificial intelligence (AI) has been a hype since important advances were made in machine-learning, huge data sets became available (\u2018big data\u2019), and speed of computing power steeped up. Machine-learning AI systems are designed for tasks that involve pattern recognition, optimization, or trend extrapolation. Well known applications include image recognition, language translation, and behavioral prediction. They have been used in application domains such as medical diagnosis (e.g. in radiology), financial transactions (e.g., \u2018fintech\u2019, assessment of credit worthiness), law (e.g., prediction of recidivism), meteorology (e.g., weather forecasting), public services (e.g., detection of possible fraud, eligibility for support by social welfare schemes), and security (e.g., surveillance, with the Chinese social credit system perhaps being the most widely implemented).<\/p>\n
In November 2022, when the first edition of ChatGPT was publicly released, AI entered a novel phase: the broad adoption of large language models (LLMs). LLMs differ from machine learning AI in the use of even larger data sets and reliance on even faster computing power, and the integration of pattern recognition, optimization, and trend extrapolation. In terms of functionality, the most important difference is in the ability of LLMs to produce novel output; hence the term \u2018generative AI\u2019.<\/p>\n
AI systems, whether of the machine-learning or the generative kind, have found many useful applications, but their use is also associated with numerous scandals and undesired outcomes. Anybody who has kept themselves informed will be able to list several examples.<\/p>\n
My fascination with AI stems from the question why so many people are so uncritically enthusiastic about AI \u2013 viewing it with rose-tinted glasses, emphasizing all the benefits and future possibilities \u2013 despite the numerous scandals and undesired outcomes. How come? Some would say that undesired outcomes are largely due to the technology still suffering from \u2018child diseases\u2019 that will be cured as the technology is further developed (better data, finetuning of the algorithms). Others claim that a part of the answer is in the attribution of scandals and undesired outcomes to (malicious) intent \u2013 think of the Cambridge Analytics scandal \u2013 or to excessive commercial interest (\u2018greed\u2019) \u2013 think of the endless scrolling on timelines and newsfeeds in social media.<\/p>\n
I believe that these accounts are only part of an explanation, and that they are perhaps not even the most important part. A major factor is that many people attribute sublime qualities to the technology: they are amazed and fascinated by its incredible and unimaginable technical prowess \u2013 and perhaps they also feel a bit uncanny because of its human-like-but-not-really-human abilities. These sentiments are fed, I believe, by the language we use when talking about AI, and because language frames understanding, language matters in how people relate to AI, more often than not, trusting in the relevance, validity, and reliability of the output of AI systems. Let me specify.<\/p>\n
We speak of artificial \u2308intelligence\u2309, machine \u2308learning\u2309, image \u2308recognition\u2309, algorithmic \u2308decision making\u2309, Google\u2019s proficiency in \u2308translating\u2309 from one language into another, Amazon \u2308recommending\u2309 what you might like next, etcetera, etcetera. [I borrow the use of corner quotes from Brian Cantwell Smith<\/strong> in The Promise of Artificial Intelligence<\/em>.] In doing so, we are anthropomorphizing AI systems by projecting our own understandings of intelligence, recognition, decision making, etcetera, etcetera onto the actual abilities and workings of these systems. For example, we implicitly equate the \u2308recognition\u2309 of an image by an AI system with how we recognize an image, but the system doesn\u2019t \u2308see\u2309 a cat (or a dog); it processes a pattern of pixels of varying intensity and wavelength. We tend not to recognize that the semantic meanings of \u2308recognition\u2309 and recognition are different. But they are<\/em> different. Full stop. I believe that the tendency to interpret \u2308learning\u2309 as learning, for example, is a major factor in the many undesired outcomes when we rely on AI systems to inform our doings and dealings.<\/p>\n We seem to forget that AI systems run on algorithms. They rely on mathematics, calculus, statistics, and Boolean logic in their processing of data. But \u201cevery schoolboy knows,\u201d to quote Gregory Bateson<\/strong> in Mind and Nature<\/em>, \u201clogic is a poor model of cause and effect.\u201d Likewise, statistical correlation, or co-occurrence, of variables is a necessary but not a sufficient condition for causality. Many decisions are \u2018tough calls\u2019 in unique situations; decisions require judgment in the weighing of multiple, often contradictory values and interests. AI systems are good at processing data, yet incapable of judgment. Mistaking the former for the latter can be a source of serious problems because it confuses \u2308intelligence\u2309 and intelligence.<\/p>\n Things get potentially even worse when we take data as unproblematic, direct representations of phenomena in the world in which we live. For one, data are always from the past, and therefore the practical value of extrapolation of trends, patterns, and optimizations depends on a belief in the continuity of the domain of (historical) data and the domain of (actual) concern. Furthermore, data are not \u2018given\u2019, as the etymological root of the word from the Latin dare<\/em> (to give) might suggest; they are the result of choice, selection, and construction. We need to question, therefore, not only whether data are \u2018complete\u2019, \u2018accurate\u2019, and \u2018representative\u2019 in a statistical sense, but also how they are infused with values and whether they are reasonable proxies of what is of interest or concern to us. Vilhelm Fl\u00fcsser<\/strong> (in Toward a Philosophy of Photography<\/em>) speaks of \u2018technical images\u2019 to point out how computers work with data constructions in which their infusion with values goes unacknowledged and in which the question of the representativeness of them as proxies is just assumed. With this image, we can say that AI systems process technical images into technical images and that their relationships with the world in which we live are uncertain. And for that reason, these relationships must be examined and questioned instead of being taken for granted. For example, ChatGPT does not, and cannot<\/em> \u2308hallucinate\u2309. Or perhaps it does, but then all it does is \u2308hallucinating\u2309. Relying on highly sophisticated algorithms and incredible amounts of data, ChatGPT just generates strings of words, based on statistical patterns in word sequences \u2013 it is a \u201cstochastic parrot\u201d, in the words of Emily Bender<\/strong> and colleagues \u2013 but it does not have any sense of the meaning of the word strings. We attribute meaning. We are responsible for the attribution of meaning.<\/p>\n Like any other computing system, AI systems \u201cdon\u2019t give a damn\u201d about the world in which we live (the quote is attributed to John Haugeland<\/strong>). And when we forget this basic fact, we can no longer even contemplate the question \u201cwhat humans lose when we let AI decide.\u201d<\/p>\n Frank den Hond This text is based on Frank den Hond\u2019s previous work published in MIT Sloan Management Review<\/em> (reprint 63307), Academy of Management Learning and Education<\/em> (doi: 10.5465\/amle.2020.0287) and Academy of Management Review<\/em> (doi: 10.5465\/amr.2018.0181).<\/p>\n","protected":false},"excerpt":{"rendered":" Artificial intelligence (AI) has been a hype since important advances were made in machine-learning, huge data sets became available (\u2018big data\u2019), and speed of computing power steeped up. Machine-learning AI […]<\/a><\/p>\n","protected":false},"author":34,"featured_media":279,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-278","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/posts\/278","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/users\/34"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/comments?post=278"}],"version-history":[{"count":1,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/posts\/278\/revisions"}],"predecessor-version":[{"id":280,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/posts\/278\/revisions\/280"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/media\/279"}],"wp:attachment":[{"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/media?parent=278"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/categories?post=278"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.hanken.fi\/research\/wp-json\/wp\/v2\/tags?post=278"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n<\/strong>Ehrnrooth Professor of Management and Organization<\/p>\n