Episode 106: [Value Boost] When AI Isn't the Answer
Download MP3[00:00:00] Dr Genevieve Hayes: Hello and welcome back to Value Driven Data Science, where data professionals become strategic experts. I'm Dr. Genevieve Hayes, and I'm here again with Santosh Kaveti, CEO, and founder of ProArch. Last week, Santosh and I discussed how to build a compelling business case for AI initiatives and how to operationalize those initiatives once the business case is approved.
[00:00:26] Today in this value boost episode, we're exploring the situations where AI isn't the answer. How to recognize those situations and the strategic skill of knowing where to push back. Welcome back, Santosh.
[00:00:41] Santosh Kaveti: Thank you. It's good to be back again.
[00:00:43] Dr Genevieve Hayes: Last week we discussed how to turn AI ideas into reality by building a winning business case, but the episode was predicated on the assumption that AI is in fact the right solution to an organization's problems.
[00:00:57] In the rush to find opportunities to use ai, it can sometimes be easy to forget that AI isn't the only way to solve problems, and it's not always the best. In your experience, how often do enterprises come to you with a problem where they believe AI to be the obvious solution, but it actually isn't?
[00:01:17] Santosh Kaveti: It happens. It happens a lot. And I personally believe that AI shouldn't replace humans, and I don't think it will. It'll enable us in many ways. And it's a force multiplier, to our own human capabilities, that's for sure. I truly believe that. But.
[00:01:36] I'll give you several examples. We work with many power plants one of their main concerns especially in their operational OT side of their network. They work with a number of vendors. Sometimes there are 20 vendors supplying different instrumentation, SCADA instrumentation, ICS controls, PLC devices, modern, sensors, IOT devices and edge devices and so on.
[00:01:58] A lot of times for them just having the visibility of what's on their OT network, understanding the data flows, but more importantly, here's where the kicker is when there is an issue. Going and really being able to articulate that to the vendor or set of vendors who are partners who really need to resolve that.
[00:02:22] That's a huge issue for them. Because their job as a power plant operators is to focus on producing and maximizing the throughput. They're not technical enough to be able to say, Hey, this is where the problem is and this vendor needs to solve it. So when they collaborate with all the vendors to figure out what the issue is, they struggle.
[00:02:44] So when it comes to that collaboration. Our teams jump in and help. I don't think that AI is quite there to help in that scenario. The second scenario is when you're applying AI to people-centric processes like hr, you have to understand that AI tool in whatever shape or fashion it is deployed into your enterprise.
[00:03:12] It doesn't have empathy and it doesn't genuinely care. But it could give you or an employee false impression that it cares because it's echoing an acting as an echo chamber or even a listening partner. And that could be a good thing temporarily. As models evolve, and let's say it's behavior changes, it could have a serious impact on one's personality.
[00:03:41] In the world we're seeing now where people are unfortunately committing suicides because models change their behavior. So you cannot build. Human level relationship with ai, and we need to make sure that doesn't happen in enterprises. At the end of the day, as HR and everybody's deploying these AI systems even for wellbeing, I think one needs to be extremely conscious of the fact that AI tools genuinely are not humans and genuinely will not care with all of our biases.
[00:04:22] All of our faults would still. Have the judgment to speak the truth when the truth needs to be said, even if the truth is not comfortable, and that's how we've evolved. So that's another example I would say where no I wouldn't recommend AI as a solution
[00:04:40] Dr Genevieve Hayes: so how would you recognize when AI is the wrong tool for the job?
[00:04:46] Santosh Kaveti: Early on when we started this journey, AI was the answer to almost every problem, and very quickly we realized that it is just being used as a leverage in most cases. AI is not. It's your process. It's your workflow, it's your current tool set, and that really needs to be looked at very hard before you say AI is an answer for me here.
[00:05:16] I advise to our customers. Constantly and all the time is don't patch your systems by bolting on AI to solve your problems that are fundamental to your processes, people tools. Because all you're doing is adding another layer of technical debt at some point that's gonna come back and bite you, and it'll be even worse to deal with that debt at that point.
[00:05:41] There are so many examples like that where AI is not the answer, AI is an answer when you are willing to redesign your entire workflow and reimagine it to be ai, native AI is an answer to solve, really good problems. But it's not an answer to fix your current issues with processes, workflows, tools, or even data.
[00:06:05] In fact, in most cases, when we get into conversations with our customers, it starts with AI conversation, but 90 to 95% of the cases we go down, it's either data. Or people or processes are just complexity of their entire integration.
[00:06:25] That's the issue, and we end up having to deal with that first before they even talk about ai.
[00:06:32] Dr Genevieve Hayes: Sounds like AI's good in that it brings people to you so that you can have these conversations with them to make them aware of the areas where they have problems that need to be solved. But AI isn't automatically the solution to those problems.
[00:06:50] Santosh Kaveti: By default, I would say no, aI is not where you start at all.
[00:06:53] Dr Genevieve Hayes: Is there a framework you use or any specific questions you ask to evaluate whether AI is the answer or not?
[00:07:02] Santosh Kaveti: Yes. But it also depends on the context. I'll give you one example. So when we were looking at applying or building an agent we're beginning to build agent factories now, but before we even started this journey. We were dealing with some water heater pumps.
[00:07:21] There was already a system monitoring the health of the pump. And the customer in this case wanted to accomplish a certain business outcome and thought that they could simply leverage AI to. Make a decision , in this particular case, for that particular pump, there was no need to go to that extent of leveraging ai, whether it's ML or generative.
[00:07:44] Their current system was capable of doing it. They just didn't know. How to work with the system, didn't have training, didn't understand how they can improve the functionality of that system to be able to compare the real time behavior or, look at the manufacturing curve. I look to see how, the pump is behaving over a period of time to be able to make those decisions.
[00:08:08] So they already had everything that they needed to be able to do that and they don't need AI system. Now, where AI system comes into play is. You bring in all of the other equipment, all the pumps, all the IOT devices, and you truly want to create an ontology of the entire plant and then start building some agents that are capable of not just looking at one pump, but having that context of the entire plant, not just ot, but also their IT systems, be able to say, Hey, I see this behavior.
[00:08:43] Tells me that we need to do maintenance, but you know what? I'm gonna go to it, check to see what the warranty is. And see if we have a part in the inventory. If not, I'm gonna go search. See, these are the automated tasks where the agents can become then really good at.
[00:09:02] I'm then start storing that additional context and knowledge for future. So that's one example where. A lot of times you have what you need. You just need to fix it first. In this case, it was a technical problem. It was easy to fix. Sometimes it's not technical. It involves people, processes, and that's where it also gets super complicated.
[00:09:20] Dr Genevieve Hayes: I know a lot of organizations wanna be known as AI first these days. That seems to be the latest buzz word. It's replaced data driven. When you tell your. Prospective clients know AI isn't the solution. This is what I think you should do instead, which doesn't necessarily involve AI straight away. Do you find you ever get pushback on that?
[00:09:43] Santosh Kaveti: Our approach is. Look, we would like to build a human centric, AI native organization. Every organization should aspire to move towards that. Yeah. When we go in there and when we start challenging their.
[00:09:57] Preconceived thesis. Sometimes we get pushed back because, no one likes to be challenged. But then. Our goal is not to offend anybody as much as give them the data and the evidence. I, the story and the director to say, look, this is why, we wanna be great partners for you, but this is the real problem.
[00:10:15] This is what you need to solve first. And once they get it, we typically don't get any pushback. They actually understand why, and once they buy into the Y, then they're aligned.
[00:10:25] Dr Genevieve Hayes: So it's about good communication, it's , not about unwillingness or inability. It's about helping them to get the right solution.
[00:10:31] Santosh Kaveti: In most cases it is about telling a story that they can really believe in and evidence that.
[00:10:38] Dr Genevieve Hayes: So what's one final piece of advice you'd give to data scientists who want to become known as someone who recommends the right solution rather than just the fashionable?
[00:10:49] Santosh Kaveti: My advice would be work with the operators, get closer to the business, really understand the business, and then also understand how you need to work with other experts to help you build the right solution that will not, come back and bite you. Whether from security perspective, risk perspective, but first step is get with the operators, get with the business, and that's where the real knowledge and the power is.
[00:11:16] Dr Genevieve Hayes: So that's it for today's conversation with Santosh. If you haven't already listened to our previous episode where Santosh and I discussed how to build a winning business case for AI initiatives, you'll find it at value-driven data science.com or on your favorite podcast platform. Thanks for joining me again, Santosh.
[00:11:37] Santosh Kaveti: Thanks for having me again and.
[00:11:39] Dr Genevieve Hayes: And for those in the audience, thanks for listening. I'm Dr. Genevieve Hayes, and this has been Value-Driven Data Science.
Creators and Guests