Potential Energy: How IBM i Can Be a Launchpad for AI

The system’s enthusiasts explain what makes it such an effective platform for the technology 

By Andrew Wig

Potential Energy: How IBM i Can Be a Launchpad for AI

The system’s enthusiasts explain what makes it such an effective platform for the technology

By Andrew Wig

When people imagine what it takes to train and run AI models, they’re likely to think of roaring data centers brimming with specially configured GPUs, not the trusty servers that form the backbone of so many small- to medium-sized companies. IBM i may not be synonymous with AI in the popular imagination, but the characteristics that make it such a common, everyday business implement are also what make it a good fit for the technology, champions of the system say.

“People want to pick on it because it's such an older box,” said Monty Chicola, who teaches an AI development class focusing on IBM i at Northwestern State University in Louisiana. Indeed, what would become known as IBM i was originally released in the late 1980s, initially branded as the AS/400.

 

“And the reason it's been around so long is because it's solid,” said Chicola, who is also president of the document imaging company Real Vision Software, where he was programming on the AS/400 when the machine first came out.

Timeline of AS/400 / IBM i. Source: Fortra.
Server
OS

 

System/38
CPF

1978

System/36
System/36

1983

AS/400
OS/400

1988

iSeries
OS/400

2000

System i
i5/OS

2006

IBM Power Systems
IBM i

2008

Knowing Your Data

“If you manage to learn a little bit of Python, have a good idea of how models are actually built and you really know your data,” you’re well on your way to developing AI for your IT environment, doctoral AI researcher Thomas Decorte said in November on Charlie Guarino’s monthly virtual IBM i meeting, iChime. 

 

IBM i users are likely to at least have that third factor covered. “They know their data perfectly,” Decorte said. “It's why we tend to refer to end users as power users, because they actually know how the data looks, how it's structured, how it's connected. Then, you can move towards a very nice use case.”

 

The initial challenge that organizations tend to face in developing AI, Decorte said, is having quality data, in great enough quantities. “Sometimes there's just not enough data to actually be able to deduce something from,” he explained. “And in other use cases, the data quality is not really up to par, or some extra data needs to be collected.”

 

That’s less likely to be the case on IBM i, according to Chicola. “​​It's a great AI machine because you've got good data, real good data,” he said. 

 

Companies that have an IBM i have usually had it for decades, Decorte noted. “They have gathered so much data because they don't tend to throw that much data away,” he said.

 

This, Decorte continued, “is why I think the platform is actually very well suited to build AI models on, because there's just so much data that's continuously kept over time within a very good database, the DB2.”

 

For Chicola, it’s easy to see how organizations on IBM i accumulate so much data, defying the idea that IBM i is just for smaller operations. “Our largest customer probably has 15,000 users on an IBM i, one machine,” he said. 

 

While sufficient data is a necessity, “the biggest positive of doing AI on IBM i is that the platform itself, number one, is stable; number two, is secure,” Chicola said, calling the system a “workhorse” that runs everything from hospitals, to banks, to casinos, to trucking companies. 

​​It’s a great AI machine because you’ve got good data, real good data.

—Monty Chicola, President, Real Vision Software; Instructor, AI Development for IBM i, Northwestern State University

All types of companies run their business-critical applications on IBM i.

Hospitals

Trucking companies

Casinos

Banks

Food producers

Retailers

Restaurants

Manufacturers

Builders

Another factor in the platform’s effectiveness is in its name—the “i” stands for “integrated.” “Here's the deal about an i system,” Chicola said. “An i system has its database already built into it. Has FTP (file transfer protocol) already built into it. Has SFTP (secure file transfer protocol) already built into it. It really is an inclusive machine. So whenever you design something for an i, it'll run on every i because every i really is a footprint of each other.”
ADVERTISEMENT

Explore the Latest Solutions With TechChannel’s Solutions Directory 

Discover the tools and strategies shaping the future of technology with the 2025 TechChannel Solutions Directory. From AI to cybersecurity, this resource is designed to help you stay competitive and connected with the tech community.

You can find the Solutions Directory online at TechChannel.com. See how it works:

You can take all the records for a customer and throw them through the AI engine and they can just come back with analysis that you wouldn't believe in an instant.

—Monty Chicola, President, Real Vision Software; Instructor, AI Development for IBM i, Northwestern State University

‘8,700 Examples’

The suitability of IBM i for AI is more than just theory. “Believe me, there are 8,700 examples of how we use AI,” Chicola said. “...You can take all the records for a customer and throw them through the AI engine and they can just come back with analysis that you wouldn't believe in an instant.”

 

Use cases range from reading customer emails and routing them to the proper departments, analyzing purchase patterns, and indexing invoices, Chicola said. 

 

Working for CD-Invest, an IT company specializing in IBM i, Decorte is also deeply familiar with the practical applications of AI in business. “I regularly do AI projects specifically on the IBM i actually…There are quite a few IBM companies that really want to explore these types of projects,” he said.

 

One option for a company looking to dip its toes into the AI waters might be to create a chatbot, trained on internal documents, that employees can use to inquire about various processes. “Build a RAG [retrieval-augmented generation] model, for example, on those 20, 30, 40, 50 documents,” he said. 

 

This might not only help answer employees’ questions about company processes, but help the company improve those processes. “If a lot of people tend to ask very similar questions about a certain process, something probably needs to change somewhere,” Decorte said. 

 

Another way for an organization to start looking at AI is to reflect on its biggest challenges. “Some of the biggest pain points can just be, really, ‘Summarize this for me, I don't feel like reading all this junk,’” Chicola said.

Plenty of Power, With Some Caveats

Whatever the AI mission, Chicola is adamant that IBM i is up to the task. “There is no shortage of horsepower on an IBM i,” he said. “…I mean they could run a small community bank, right? We’ve got plenty of those. And it could run a monster company, some of the biggest companies in the world.” 

 

Decorte noted, however, that IBM i isn’t the best machine for every task; sometimes, the oomph of a GPU is what’s called for. “In some use cases, the algorithm that's used doesn't benefit from the parallel computation, so then it can be just run on an IBM i,” he said. But in cases where the system is at full capacity, he continued, “then you might opt to offload [the AI task] to a GPU somewhere, usually a GPU in the cloud.”

 

Then again, “you can technically train anything on the IBM i. It might just take a little bit longer than you would on a GPU,” he said.

When it comes to the AI capabilities of IBM i, Chicola is undeterred by any caveats. “It's a great platform to look at doing artificial intelligence from, without question.”

You can technically train anything on the IBM i. It might just take a little bit longer than you would on a GPU.

—Thomas Decorte, Doctoral AI Researcher, University of Antwerp; Data Scientist, DC-Invest

Share this article
Share this article