The true danger of AI code

Pito Salas talks about one of the less obvious pitfalls of using AI in your development work:

The problem is that while it an almost correct piece of code it is often the totally wrong solution to your problem. In other words, it often sets you on the wrong path. A dead end. The trap is that you spend your time debugging an approach that is totally wrong.

When does this happen? I find that it happens when I am tackling something I don’t really understand and want a shortcut to my sugar high. Upon reflection I have found more than once that I spent hours debugging an approach which, once working, I realized was all wrong and I had to start over.

Which reminds me a lot of myself when trying to solve some technical issue by gleaning possible solutions from Stackoverflow. Not being a developer I still run into coding or other IT issues in my job as software tester, or even in real life and what do I do when I can’t fix it on my own? I google it, or rather look at Reddit or Stackoverflow for possible solutions. The number of times I found something that loos like it might work for my own situation, but turned out not to apply… So easy to get stuck on a particular solution when you actually lack the insight to understand why it’s the wrong one. At least with Reddit or Stackoverflow, there’s still the possibility of asking for help when you don’t understand something…

But there are worse things than AI generating bad or unsuitable code. The true danger lies in what happens when AI generated code is good enough to take into production. AI generated code may solve your immediate problem, but how maintainable is it? How understandable?

Let me explain. In my professional life as a software tester I often end up working on projects using code that can be years or even decades old; it’s not unusual that all of the original programmers have left the team. Given developers usual loathing of commenting, let alone documenting, what you end up with, even in the best of circumstances is code that nobody present understands completely anymore, nor understands why certain design decisions were made.

AI generated code turbocharges this situation. You’re now using code where nobody understands the design decisions made because AI cannot make decisions, with code generated in ways humans could never come up with. That’s a recipe for disaster a couple of iterations down the line.

Charting my anime addiction

You can’t tell that 2015-2018 was my most depressed, so let’s watch every anime being streamed period from this, right?

Twelve most watched anime each year from 2006 to 2024, where you can select which ones you watched and in my case, that's most.

The chart goes from 2006 up until 2024, but only shows the twelve most watched anime (in Japan) each year; I watched a lot more obscure series too. While I started watching anime regularly in 2014, I only started watching it seasonally the year after, Fall 2015 being the first season I did so. Almost a decade of continuous seasonal anime watching in other words. Those first few years I watched a shit ton of anime, because that what everybody does who is falling into the rabbit hole. Everything is new and interesting and you don’t quite know what you’ll like yet. Not to mention that there are decades of finished series to catch up on too. In hindsight though the sheer quantity of anime I watched in 2015-2018 was just abnormal even so; I may not have been quite my usual cheerful self.

One thing I noticed from this is that in the peak Covid era, 2020-2022, I seemingly watched less than in the years before, even though I had more time to spare what with being stuck at home for most of the period. I blame the rise of vtubers.

But there’s also a difference in the reasons for why I’ve not watched series, roughly before and after 2014. Series older than that not listed here I’ve mostly not gotten around to yet. Meanwhile many of the post-2014 series not checked here I’ve consciously avoided. No interest whatsoever in watching Goblin Slayer or Redo of Healer.

You can make your own version at anime-sedai.

Glad we’re not the same

Everybody had their fun mocking this dumb AI shill already, but that won’t stop me:

Twitter screenshot from user TheFuturelsDesigned @designed_future

You: take 2 hours to read 1 book.

Me: take 2 minutes to think of precisely the information I need, write a well-structured query, tell my agent Al to distribute it to the 17 models I've selected to help me with research, who then traverse approximately 1 million books, extract 17 different versions of the information I'm looking for, which my overseer agent then reviews, eliminates duplicate points, highlights purely conflicting ones for my review, and creates a 3-level summary.

And then I drink coffee for 58 minutes.

We are not the same.

First off, if mr Future here is drinking coffee for 58 minutes, what’s he doing that other hour? Pissing it all out again?

Second, what kind of (I assume) work related book that you need this complicated AI setup for to get summarised will only take two hours to read anyway?

Third, the weird exactness of “the 17 models I’ve selected”. Why seventeen? Why not sixteen, or eighteen? Why mention a million books too? Just the first random Big Number that popped in his head? Bad enough having seventeen different AIs to summarise a book, but having a separate agent then collating this “raw output” and summarise it even further is begging for errors.

A man in a suit says: it may sound primitive and unscientific, but through the faires, we could ask Mothra to help.

It all sounds very cool and ccyberpunky, something you could’ve read in a late eighties hack sf novel ripping of Gibson or Sterling, but in real life it all sounds a lot like using the fairies to ask Mothra for help. All it does is make it clear you don’t want to do your job, which lords know I can sympathise with, but also that you don’t know how to do your job, if you think reading a summary of a book is the same thing as reading the book itself. What makes you think you can judge what the AI regurgitates for you if you’re too lazy to do the work yourself?

Willfully ignoring crimes against humanity again

As American planes are renditioning people to South Sudan via Ireland, Simon McGarr is reminded of the last time the country deliberately looked away from crimes against humanity:

We have been here before, of course. Here’s the 2007 Irish Human Rights Commission’s report on Ireland’s role in the George W Bush era of extraordinary renditions of individuals for the purposes of torture abroad. This was expanded upon by the Open Society’s Justice Initiative’s 2013 report “GLOBALIZING TORTURE: CIA SECRET DETENTION AND EXTRAORDINARY RENDITION“, which determined that Ireland had “facilitated” the CIA rendition and torture project.

Furthermore, the question of planes landing in Shannon and flying on to Israel has also triggered questions as to whether Ireland is being used as a refuelling stop in the delivery of arms to Israel’s government while it prosecutes its military action against the people of Gaza.

The reason that these are still only questions- as yet unanswered- is that the government declines to have officials inspect the planes which land. Indeed, An Garda Síochana seem as determined as they were in the Bush era to place the level of evidence required to trigger an examination of what might be on one of these planes so high that it would be impossible for any member of the public to meet it. The view taken then was that police would only inspect US planes if a member of the public could already prove that there were prisoners (or arms shipments or even undeclared restricted items such as guns) on board.

It’s not surprising that the Irish government would rather look away than confront either the US or Israel. Better to tolerate this than to dire the wrath of either country, would be the thought. Few European governments would choose to do otherwise. How then, could you force them to do so anyway? As McGarr outlines, maybe you need to use VAT law:

A few months ago Lelia Doolan assessed the legal situation regarding the treatment of planes used by the US government stopping at Shannon.

She wrote to the Attorney General to put him on notice that she had concerns that Ireland was not complying with its duties of systemic inspection of planes for cargo under EU VAT law.

A clever tactic which might work but I’m doubtful it will. Perhaps the only way to stop these renditions is to do on a massive scale what people have done with success to prevent immigration arrests in the UK, by surrounding the arresting officers and physically keeping them from taking somebody away.