Matteo Pasquinelli (2023) The Eye of the Master: A Social History of Artificial Intelligence. Verso, New York.
Summary of Introduction: AI as Division of Labor
Pasquinelli starts out with some apt quotes from Marx and Gramsci, and indicates the stakes and intent of the book with this great point:
In the twentieth century, few would have ever defined a truck driver as a ‘cognitive worker’, an intellectual. In the early twenty-first, however, the application of artificial intelligence (AI) in self-driving vehicles, among other artefacts, has changed the perception of manual skills such as driving, revealing how the most valuable component of work in general has never been just manual, but has always been cognitive and cooperative as well. Thanks to AI research – we must acknowledge it – truck drivers have reached the pantheon of intelligentsia. It is a paradox – a bitter political revelation – that the most zealous development of automation has shown how much ‘intelligence’ is expressed by activities and jobs that are usually deemed manual and unskilled, an aspect that has often been neglected by labour organisation as much as critical theory. (12-13)
He notes Sennet and others who have in fact recognized that “making is thinking;” his point resonates with the beginning Gramsci quote, to the effect that everyone is an intellectual. In this context he will take on the standard ideological account of AI and “intelligence:”
What is AI? A dominant view describes it as the quest ‘to solve intelligence’ – a solution supposedly to be found in the secret logic of the mind or in the deep physiology of the brain, such as in its complex neural networks. In this book I argue, to the contrary, that the inner code of AI is constituted not by the imitation of biological intelligence but by the intelligence of labour and social relations. Today, it should be evident that AI is a project to capture the knowledge expressed through individual and collective behaviours and encode it into algorithmic models to automate the most diverse tasks: from image recognition and object manipulation to language translation and decision-making. As in a typical effect of ideology, the ‘solution’ to the enigma of AI is in front of our eyes, but nobody can see it – nor does anybody want to. (13)
He gives the example of the self-driving car:
If the skill of driving can be translated into an algorithmic model to begin with, it is because driving is a logical activity – because, ultimately, all labour is logic. (14)
What, then, is the relationship between labour, rules, and automation, i.e., the invention of new technologies? This entanglement is the core problem of AI which this book seeks to explore.
The title of the book is from a quote from Engels:
‘The economical development of our actual society tends more and more to concentrate, to socialise production into immense establishments which cannot any longer be managed by single capitalists. All the trash of “the eye of the master”, and the wonders it does, turns into sheer nonsense as soon as an undertaking reaches a certain size. Imagine “the eye of the master” of the London and North Western Railway! But what the master cannot do the workman, the wages- paid servants of the Company, can do, and do it successfully. Thus the capitalist can no longer lay claim to his profits as “wages of supervision”, as he supervises nothing.’ (220n8; from Friedrich Engels, ‘Social Classes: Necessary and Superfluous’, Labour Standard, 6 August 1881.)
He will trace the history of AI more broadly through the developments of Babbage, Taylor, etc.
This book follows these analytical studies of the labour process through the industrial age up to the rise of AI, aiming to show how the ‘intelligence’ of technological innovation has often originated from the imitation of these abstract diagrams of human praxis and collective behaviours. (15)
Here is a thesis:
When industrial machines such as looms and lathes were invented, in fact, it was not thanks to the solitary genius of an engineer but through the imitation of the collective diagram of labour: by capturing the patterns of hand movements and tools, the subdued creativity of workers’ know-how, and turning them into mechanical artefacts. … this book argues that the most sophisticated ‘intelligent’ machines have also emerged by imitating the outline of the collective division of labour. In the course of this book, this theory of technological development is renamed the labour theory of automation, or labour theory of the machine, which I then extend to the study of contemporary AI and generalise into a labour theory of machine intelligence. (15-6)
[Wouldn’t this latter in fact be a subset of the former, not a generalization?]
Following Marx, P says the “master” is not in fact an individual but “an integrated power made up of ‘the science, the gigantic natural forces, and the mass of the social labour embodied in the system of machinery’” (16).
All of society has become a “digital factory” mediated by computer tech, social media, etc. “It is not difficult to see AI nowadays as a further centralisation of digital society and the orchestration of the division of labour throughout society.”
The thesis that the design of computation and ‘intelligent machines’ follow the schema of the division of labour is not heretical but receives confirmation from the founding theories of computer science, which have inherited a subtext of colonial fantasy and class division from the industrial age.
He gives an example of such fantasy from Turing, of his imagined Automatic Computing Engine, with humans divided into its “masters” who control it, and “servants” who it controls as its sensory organs; [aka those above and below the algorithm]; Turing argued that both classes of humans would be progressively replaced, though the masters would have more power to resist this:
Turing’s vision is contradicted today by the army of ‘ghost workers’ from the Global South, who, as Mary Gray and Siddharth Suri have documented, are removed from sight to let the show of machine autonomy go on. Paradoxically for Turing, AI came to replace mostly masters, that is managers, rather than servants – workers are needed (and always will be) to produce data and value for the voracious pipelines of AI and its global monopolies, and, on the other hand, to provide the maintenance of such a mega-machine under the form of content filtering, security checks, evaluation and non-stop optimisation. (17)
As gender studies scholars Neda Atanasoski and Kalindi Vora have pointed out, the dreams of full automation and AI such as Turing’s are not neutral but are historically grounded on the ‘surrogate humanity’ of enslaved servants, proletarians, and women that have made possible, through their invisible labour, the universalistic ideal of the free and autonomous (white) subject.
Writing a history of AI in the current predicament means reckoning with a vast ideological construct: among the ranks of Silicon Valley companies and also hi-tech universities, propaganda about the almighty power of AI is the norm and sometimes even repeats the folklore of machines achieving ‘superhuman intelligence’ and ‘self-awareness’.
Mythologies of technological autonomy and machine intelligence are nothing new: since the industrial age, they have existed to mystify the role of workers and subaltern classes. (17-18)
He quotes Simon Schaffer:
‘To make machines look intelligent it was necessary that the sources of their power, the labour force which surrounded and ran them, be rendered invisible.’ (Schaffer, quoted on page 18)
In addition to these ideological “speculative narratives” offered of AI by Silicon Valley futurists, there are also “technical histories” which voice corporate perspectives and “rarely consider the historical contexts and social implications of automation, and draw a linear history of mathematical achievements which reinforces technological determinism.”
But there are also critical histories, of “the social implications of AI from the standpoint of workers, communities, minorities, and society as a whole,” aka “critical AI studies.”
Within the expanding landscape of critical works, this book’s concern is to illuminate the social genealogy of AI and, importantly, the standpoint – the social classes – from which AI has been pursued as a vision of the world and epistemology. (19)
[Eg. AI as a class project.] Many histories trace AI and related computer techs to WWII and the cold war, but it goes back further than this, and is tied most directly to data collection by the “government machine,” not just wartime; P’s numerous references to Foucault are relevant to this point.
In summary, AI represents the continuation of data analytics techniques first supported by state bureaus, secretly cultivated by intelligence agencies, and ultimately consolidated by internet companies into a planetary business of surveillance and forecasting. (20)
However, this version of the story (which P shares with many of the above critical histories) presumes the targets of control are passive; P reiterates Gramsci’s “everyone is an intellectual” argument, to note that we also have to see (in classic Operaist form) that [the agency of workers is in fact first, and the ruling class’s move to control or coopt it is reactionary, secondary.]
this book aims at rediscovering the centrality of the social intelligence that informs and empowers AI. It also contends – in a more radical thesis – that such social intelligence shapes the very design of AI algorithms from within.
This book is intended as an incursion into both the technical and social histories of AI, integrating these approaches into a sociotechnical history that may identify also the economic and political factors that influenced its inner logic. Rather than siding with a conventional social constructivism and going beyond the pioneering insights of social informatics, it tries to extend to the field of AI the method of historical epistemology …
Where social constructivism generically emphasises the influence of external factors on science and technology, historical epistemology is concerned with the dialectical unfolding of social praxis, instruments of labour, and scientific abstractions within a global economic dynamics.
This links to the political epistemology of feminist critics of science and technology. P states that the title of the book has a double meaning, because current AI tech arose out of the drive to automate pattern recognition; he provides the etymology:
‘Master’ and ‘pattern’ share a common political etymology. The English term ‘pattern’ comes from the French patron and the Latin patronus. Both have the same root of the English ‘paternal’ and ‘father’, that is the Latin pater. The Latin patronus means also protector, also in relation to servants. The French patron has the meaning of leader, boss, or head of a community, which, in patriarchal contexts, implies a model to follow. (223n39)
He turns to the distinction between the original, symbolic AI, and the newer, connectionist AI:
The two lineages pursue different kinds of logic and epistemology. The former professes that intelligence is a representation of the world (knowing- that) which can be formalised into propositions and, therefore, mechanised following deductive logic. The latter, in contrast, argues that intelligence is experience of the world (knowing-how) which can be implemented into approximate models constructed according to inductive logic. (22)
[But is connectionist AI really inductive? It seems like it creates vast categories, and locates tokens inside those, and would thus be deductive. Wouldn’t induction would be a small-data, not a big-data approach? Also, LLMs do not have “experience of the world.”]
P points out that “neither of these two paradigms has managed to fully imitate human intelligence,” but the latter is better at pattern recognition and automation of tasks, and so is the foundation of the current boom. P implies the irony that the hype and ideology surrounding the first kind of AI is now applied to its rival.
Against a tradition which repeats the overly celebrated saga of the Dartmouth workshop, this book highlights the origins of artificial neural networks, connectionism, and machine learning as a more compelling history of AI about which, especially regarding Rosenblatt’s work, critical and exhaustive literature is still missing.
The rest of the chapter provides an overview of rest of the book, then summarizes:
This book proposes the labour theory of automation, in the end, not only as an analytical principle to dismantle the ‘master algorithm’ of AI monopolies but also as a synthetic principle: as a practice of social autonomy for new forms of knowledge making and new cultures of invention. (28)





