Being a stickler for the old ways, I have attempted to throttle my consumption of the Internet’s overwhelmingness by retreating (somewhat) from what’s left of “social” media1 by prioritising email newsletters from a variety of trusted sources.2 A couple of months back, there was a weird week when voices seemed to converge: it was like being at a party when your school friends and your not-school-friends and your cousins are suddenly all in the same space. It feels weird. In this case, it was tech writers and faith commentators and academics from both worlds all highlighting the same thing: Pope Leo’s encyclical, Magnifica Humanitas.
It is a truth, universally acknowledged, that when it comes to twenty-first-century ethics Roman Catholic scholars are ahead of Reformed evangelicals when it comes to making arguments from natural law.3 I have only read section of the encyclical, but Leo’s no slouch. The theme which caught my attention the most was his argument, as summed up accurately in this article by Russell Moore, that the danger in the next few decades is not that so-called artificial intelligence will become too humanlike – but actually, that we, as humans, will end up too closely resembling machines.
Computer scientist Cal Newport, currently dabbling in what he calls, ‘the emerging field of digital ethics’, and writing from the perspective of a secular academic, observes the centrality of the spoken word to the Hebrew Bible – we can extend that to the Greek New Testament also, where God’s creative Word takes on human form as the Son.4 Newport writes:
‘I’ve been thinking about this recently as I grapple with some of the consequences of the generative AI revolution. Like many people, I feel a general sense of unease when holding a fluent conversation with a chatbot. I understand that this lexical fluidity is merely an illusion – the result of endless matrix multiplications, autoregressively generating one token after another – but it still creates a discomforting sense of transgression. The sacredness of speech helps explain these feelings. It also raises some deep questions. Should we be so quick to extend the role of ruach memalela to machines, allowing them, seemingly all at once, to become active participants in a ritual so defining to our experience?’
The answer is no, because the illusion is a shaky one at best. Pope Leo is not concerned about AIs becoming godlike, and I wonder if some of that is because he understands how inevitably stupid a large-language model, trained on both open and stolen data, will increasingly become?5
An extremely significant 2023 study demonstrated, in fairly easy-to-follow ways, what the researchers termed, ‘The Curse of Recursion’ – essentially, that the more LLMs like ChatGPT or Gemini are trained by swallowing what is published across the internet, the stupider they get. Why? Because increasingly, what they are processing/digesting is content written by LLMs. In fact, ultimately these mathematicians demonstrated that the models will collapse in on themselves.
Big tech, I think, being awake to this, have prioritised other sources – namely, you. Meta are the finest example, having literally built an entire closed ecosystem predicated on harvesting users own content to sell products to them, and now to sell those users to other users by using your data to train their models and spit out ‘better’ answers. Here, LLMs take an even darker turn – the consequences of accepting that, when using any ‘AI’ tool, you are also feeding your own data and the outcomes of your engagement back into the machine to ‘improve’ it.
Moreover, as Pope Leo observes, in doing so we begin to tailor our own behaviour to the machine, and not the other way around. About fifteen years ago, I would have prided myself on my Google skills. Part of my role was effectively as a researcher, and I spent a lot of time utilising operators and particular commands to find what I needed. Search engines work best when you have figured out how to phrase your request, or to use particular operators, tags, or search terms, in order to frame your request to the way it ‘thinks’ – i.e., how it organises the data it holds. So, the way I ‘spoke’ to Google Search was adapted in order to best ‘relate’ to the machine.
This type of adaptation is not only amplified, but dramatically accelerated by ‘AI’ search. One study last October found that half of US adults were now starting with AI tools – presumably dominated by Gemini and Chat-GPT – for online searches. Ironically, some of that appears to be driven by how much worse the ‘old-fashioned’ search experience has been made by the attempt to prioritise both commercial interests and AI-generated results into search. Once again, the prophetic words of Ian Malcolm are never far from the surface.6
This week, I am grappling with a sermon on Amos 8: not a regularly-preached passage of the minor prophets. The Christian God levels at his chosen people, the historic kingdom of Israel, a repeated accusation: their false religion is exemplified by their disregard of the poor and needy in their society. These people proclaim great virtue and prosperity, whilst simultaneously they ‘trample the needy and do away with the poor of the land’ (Amos 8:4).
It struck me, as I read of how the morally bankrupt Hebrew elites are found guilty by YHWH of ‘buying the poor with silver and the needy for the pair of sandals’ – probably a reference to the practice of indentured slavery – that Pope Leo’s fears also capture a picture of people being bought and sold for profit – and how most of us seem fairly unbothered by this. TV producer and author Richard Osman recently commented that the time each of us spend using social media – on average in the UK, six hours a day – is our real contribution to the economy.7 It’s hard to dispute – social media platforms generated an estimated £11,500,000,000 for the UK economy last year from advertising alone.
But we don’t care: not because we’re particularly entertained, or inspired, but generally because it passes the time. We don’t care because we get answers slightly quicker, and they might be correct. We don’t care because we have been conformed enough to the machines to buy the lie that this, somehow, is progress.8
There’s no great conspiracy here; there rarely is. It’s just simple economics, which often trumps ethics and religion just about every time.9 It is not, ultimately, that the machines will somehow rise up and destroy us – it is, rather, that we will buy and sell ourselves into destruction, all the while calling it ‘better’. 10
Call me a Luddite – but there must be something more.