It came as no surprise when we released the 2024 State of the CIO that artificial intelligence loomed large on the CIO鈥檚 radar this year. In fact, with 80% of CIOs citing AI as their number one area of involvement this year (up from 55% in 2023), it鈥檚 toppled security from the top spot for areas that the CIO is being pulled into. (Hint: that doesn鈥檛 mean cybersecurity isn鈥檛 still consuming a major amount of the CIO鈥檚 time鈥攚e address how they鈥檙e balancing these priorities here.)听

I had lots of questions for Lee Rennick, Executive Director of CIO Communities at Foundry, on how CIOs are perceiving and preparing for an AI-heavy infrastructure in record time. During our conversation on how the findings of the 2024 State of the CIO were playing out in real CIOs鈥 day-to-day, we talked about the mixed feelings that they were having around bringing AI into the enterprise.

While Lee noted that many companies have been using AI for years, she spoke to the Generative AI phenomenon that we all experienced in 2023 as catalyzing a 鈥渄emocratization of AI鈥 that stirred feelings of both excitement and hesitation at the tech leadership level. This tracked with some of the findings from Foundry鈥檚 inaugural AI Priorities Study, released in October of 2023, that found 1 in 4 tech leaders thought their organization was moving too quickly to deploy AI, and only 36% felt their data infrastructure was properly organized to enable AI in an effective way.聽

A fundamental reset to the roadmap

Raji Subramanian CTO Opendoor

Like the internet changed the way everything is done, so will AI. It鈥檚 time to rethink the vision, strategy, and roadmap, and it鈥檚 not an incremental reset鈥攊t鈥檚 a fundamental reset.

Raji Subramanian
CTO, Opendoor

To better understand how CIOs and senior tech leaders were tempering their own enthusiasm and cross-departmental pressure to implement AI tools with cautionary discretion, we looked to two of her CIO Leadership Live interviews.

In the first, , CTO of Opendoor, spoke with Lee about the possibilities for industry reinvention and disruption that AI will enable. Noting that Opendoor has embraced AI and machine learning (ML) to rethink everything from productivity and customer experience to the fundamentals of the real estate industry, Raji urges technology leaders to do the same. 鈥淚t鈥檚 easy to get complacent,鈥 she says, 鈥渂ut this is the time to reset.鈥

鈥淟ike the internet changed the way everything is done,鈥 says Raji, 鈥渟o too will AI. It鈥檚 time to rethink the vision, strategy, and roadmap. And this is not an incremental reset, it鈥檚 a fundamental reset.鈥

Advocating for data quality and due diligence 

Graham O鈥橲ullivan

Right now, every niche vendor seems to have LLMs. I’d encourage peers to be eyes wide open. What have they really built before they sell it to you at a premium?

Graham O鈥橲ullivan
Group CIO, OneFamily

While many CIOs, CTOs, and other tech leaders share Raji鈥檚 enthusiasm for AI and the possibilities it will bring, there is an undercurrent of caution and even apprehension amongst this same group surrounding the flood of new AI tools on the market. Lee鈥檚 February 2024 , CIO of OneFamily, touched on some of the common concerns that tech leaders are facing.

Graham highlights three key areas that he鈥檚 evaluating as AI infiltrates the enterprise. The first are considerations related to large language model (LLM) training, the content being output by these models, and the 鈥渁ppropriateness鈥 of generated content designed for customer-facing applications. His second consideration is around data quality, noting that while data quality initiatives have been a major focus for years, AI is bringing a new sense of urgency around data hygiene to IT leaders being asked to implement these solutions. 

Third, Graham expresses concern around the AI solutions being sold themselves. 鈥淚f you go to a conference right now, every niche vendor seems to have LLMs,鈥 he says. But noting that this technology is still relatively new to market, 鈥渢here鈥檚 a degree of [vendors] rushing in to say 鈥榳e have something.鈥欌 

In this landscape, Graham urges his peers to be 鈥渆yes wide open鈥 in evaluating solutions. He says to ask of vendors, 鈥渨hat have they really built before they sell it to you at a premium鈥濃攊s it truly sound and proprietary, or have they 鈥渨rapped one of these enterprise services in branding and content, and now the hard work begins in terms of safety, data quality, and how you implement it in your environment?鈥

Vendor responsibility in the age of AI

Though Raji and Graham鈥檚 interviews had different tones to them, the reality is that most CIOs and tech leaders find themselves on both sides of the fence when it comes to AI鈥攖hey鈥檙e simultaneously excited about its potential to innovate and disrupt industries, while at the same time aware of the pitfalls of adopting this technology too early, or of being misled by branding and white labeling. 

In this light, the responsibility of vendors is enormous at this moment. As Lee and I wrapped up this segment, she stresses that organizations are still not out of the woods when it comes to modernizing legacy systems鈥攁 prerequisite for enabling AI effectively. For these IT leaders 鈥渄ealing with legacy systems, looking at how to effectively move data into the cloud, and looking at public versus private cloud and hybrid options鈥 there are still a lot of those discussions going on鈥攁nd that鈥檚 where so many of them are requiring support from their vendors,鈥 Lee says.

鈥淭he new overlay on all of that is Generative AI,鈥 Lee continued. 鈥淣ow [these IT leaders] really do need to have all of that in order, know what the strategy is, and start putting that into place so they can move to this next task which is creating better efficiencies, not just for their company but for their customers.鈥

There鈥檚 a key takeaway here for tech vendors, both within and outside of the AI space. As CIOs are being asked to quickly implement AI solutions, many also know that their existing data and infrastructure need an overhaul first for these solutions to benefit them. They鈥檙e excited about the future, but don鈥檛 mistake their excitement as falling victim to the AI hype. Now is the time to deliver value in the form of guidance, education, and personalized support. AI has positioned the CIO to lead their organization through a new vision for the future, and only trusted vendors will be asked to join them along their journey.

To learn more about how tech marketers can support CIO in the age of AI, check out the rest of this video series, and download the today.