"Human in the loop" — Why AI needs organic intelligence in your dealership | Mackenzie Wiltrout, Stream Companies
About this episode
Mackenzie Wiltrout of Stream Companies breaks down what “impactful AI” should look like for dealerships amid the 2026 AI tool flood. She argues the differentiator isn’t the model—it’s human-in-the-loop implementation, dealer-specific focus, and proof via post-launch reporting/ROI. Generic, one-size-fits-all LLMs can reinforce bias and create “smoke and mirrors” if they don’t deliver measurable results. Stream’s approach centers on purpose-built AI in its Orange OS, paired with education and strategy support, plus a “zoom out” view to avoid data analysis in a vacuum.
The AI hype is real, and every vendor at NADA claims to have the next big thing for your car dealership. But as you consider integrating new tools, are you truly solving problems or just inviting new ones? The promise of AI in automotive retail is vast, yet without a strategic approach and "human in the loop," the technology can quickly become a costly distraction.
In this episode, you’ll discover:
- Why generic AI solutions often fail to deliver real ROI in a dealership setting.
- How to identify and choose AI tools that provide actionable data instead of just affirming biases.
- The critical role of "organic intelligence" in leveraging AI to move more metal and improve fixed ops.
- Strategies for avoiding common technological pitfalls that lead to change management nightmares.
Mackenzie Wiltrout, VP of Innovation at Stream Companies, shares her expert perspective on finding impactful AI that genuinely drives dealer growth.
Follow The Dealer Playbook so you never miss an episode.
Timestamps:
00:00 Intro
01:11 AI Hype Versus Impact
03:14 Proof And ROI Data
05:59 Humans In The Loop
07:57 Bias And Obliging Chatbots
11:03 Stream Vision Orange OS
13:25 Data Vacuum Dangers
16:17 Outro
NADA
"What is my first NADA? [35.8s] So is it really? [37.1s] Yeah. How's it going?"
NADA is a big annual event for car dealerships. It’s where dealers and companies show off new tools and products.
NADA refers to the National Automobile Dealers Association, which hosts an annual convention and trade show for car dealerships. Dealership vendors often unveil new products there, which is why it comes up alongside “booth” and “unveiling.”
booth
"And over at our booth, we've had a lot of fun stuff that we're unveiling. [48.5s] So really just a banner couple of days."
A booth is the company’s booth space at a trade show. That’s where they talk to dealership people and show what they’re selling.
A “booth” is the vendor display space at a trade show where companies demonstrate products and services to dealership attendees. The speaker connects it to “unveiling” and “swag,” indicating they’re actively promoting something new at the event.
impactful AI
"what does it truly mean to find impactful AI? [94.6s] This is a great question because if you've walked the floor here at all [98.6s] and I know that you have every other booth, maybe even every booth [103.2s] has AI somewhere listed."
They’re talking about AI that actually makes a difference in day-to-day dealership work. Not just something cool—something that helps sell cars or reduce problems.
“Impactful AI” in this context means AI tools that produce measurable dealership outcomes, not just demonstrations or generic automation. The speaker frames impact as coming from how well the tool matches real dealer workflows and solves specific problems.
human element
"But when it comes to the impactful AI, I think what sets the tool apart [115.1s] or the vendor apart is not even the tool itself, [118.3s] but still their focus on the human element of it and focusing on people [123.3s] and their pain points and problems,"
The “human element” is the idea that AI performance in a dealership depends on people guiding it, validating outputs, and integrating it into processes. The speaker argues the differentiator isn’t the AI itself, but vendor focus on human workflows and pain points.
internal friction
"What you're making me think of is, you know, back in the day when we introduced [156.8s] websites, then all of a sudden we it was pitched as a solution, [167.1s] but it actually did create some internal friction because now we're like, [170.5s] well, now we need somebody to manage this website."
“Internal friction” describes added workload, process changes, or coordination problems that occur when new tools are introduced without fully considering operational impact. The speaker uses the website rollout as an example: it created new responsibilities and management needs.
manage this website
"because now we're like, [170.5s] well, now we need somebody to manage this website. [173.7s] Now we need and look at how that's evolved."
This highlights a common dealership tech pitfall: implementing a tool without accounting for ongoing operational ownership. Even if the tool is beneficial, someone must manage content, updates, and performance to keep it effective.
sell more cars
"The AI, everybody's telling me it's going to solve all my problems. You know, it's going to help me sell more cars, service more vehicles."
They’re saying the goal of using AI isn’t just to do tasks—it should help the dealership sell more vehicles. And you should be able to measure that improvement.
“Sell more cars” is used as a concrete business outcome for AI initiatives. The speaker frames AI as a tool that should translate into measurable sales performance, not just activity or automation.
reporting data after the fact
"But at the end of the day, if you have the tool and then there is no reporting data after the fact that is actually showing you the tool made a difference, there is no case study, then we have smoke and mirrors."
They’re saying you shouldn’t just buy an AI tool and hope it works. You need reports that show what changed after you used it.
The speaker is emphasizing that AI tools in a dealership need measurable, post-implementation reporting. Without proof in the numbers, the tool may not actually improve outcomes and can become “smoke and mirrors.”
smoke and mirrors
"...there is no case study, then we have smoke and mirrors."
“Smoke and mirrors” is a metaphor for something that looks impressive but doesn’t produce real, measurable outcomes. Here, it’s used to criticize AI deployments that lack post-launch reporting and evidence of impact.
data ahead of time
"So we always prize the data ahead of time, the data that underpins the AI that comes before the AI."
They’re saying you need good information in place before you turn on the AI. And you also need to check results afterward to make sure it actually helped.
“Data ahead of time” refers to having the right underlying data before deploying AI—so the AI can be trained, configured, or guided effectively. The speaker contrasts this with the need for after-the-fact reporting to confirm real-world impact.
marketing funnel
"We need that reporting after the fact that shows that, OK, so this dealer was using this to build strategy, build campaigns to fill out their marketing funnel and then to actually sell cars within their market."
A marketing funnel describes the stages from attracting shoppers to converting them into buyers. The speaker connects AI-enabled campaigns to filling the funnel and then turning that demand into actual car sales.
historical trail of data
"[279.8s] but it's a fact. We're still so early on in understanding what AI [286.3s] can do for us that, to be honest, we don't have that historical trail of data [292.2s] quite yet."
A “historical trail of data” refers to having enough past performance records to validate what the AI will do and how it should be used. Without that baseline, it’s harder to prove outcomes or tune the system to dealership-specific realities.
return on investment (ROI)
"[309.5s] You should be able to see a return on investment and there should be numbers. [313.9s] There should be proof in that pudding that shows that this made a difference"
ROI is basically “did this cost more than it helped?” You look at the results and compare them to the money you spent. If the numbers show a benefit, it’s worth keeping.
Return on investment (ROI) is a way to measure whether a new tool or process actually pays off. In a dealership context, it means you can quantify the impact of AI on sales, efficiency, or costs compared to what you spend on it.
proof in that pudding
"[309.5s] You should be able to see a return on investment and there should be numbers. [313.9s] There should be proof in that pudding that shows that this made a difference"
It means you shouldn’t just trust claims—you need to see results. In this case, you want proof that AI actually improved something.
“Proof in that pudding” is an idiom meaning you need real-world evidence that the approach works. In the dealership/AI context, it points to measurable results rather than promises.
diagnosing the shifts
"[359.7s] So how do we how do we encourage that shift in a way that is palpable and not like a huge change management nightmare? [368.9s] How do we move beyond technology and start diagnosing the shifts that we should make?"
It means figuring out what’s changing and why, then making smarter decisions based on that. The idea is to use AI to spot patterns and guide what you do next.
“Diagnosing the shifts” refers to identifying what operational or customer-behavior changes are happening and then adjusting strategy accordingly. The speaker connects this to using AI as part of an ongoing feedback loop, not a one-time tech install.
people in the loop
"Again, I think it comes back to having people in the loop, in the process, working with you to understand what the AI is doing."
It means the AI doesn’t work completely on its own. A person still checks what the AI is doing and can step in if something looks wrong.
“People in the loop” means keeping dealership staff involved while AI systems operate, so humans can review, correct, and guide outcomes. In a dealership context, this helps prevent AI from making confident mistakes when it doesn’t fully understand a customer’s situation or the dealership’s process.
organic intelligence
"A artificial intelligence needs organic intelligence in order to drive it correctly and to understand your use cases."
They’re basically saying humans bring the real-world understanding that AI lacks. Staff know the dealership rules and customer context, so they help AI make better decisions.
“Organic intelligence” is the speaker’s framing for human judgment and domain knowledge that AI can’t fully replicate. In dealership workflows, this means staff understand customer intent, local policies, and real inventory constraints—things AI may not reliably infer on its own.
use cases
"A artificial intelligence needs organic intelligence in order to drive it correctly and to understand your use cases. And that's another thing I see so much like general purpose, one size fits all AI out there."
Use cases are the specific jobs you want the AI to do. The episode says AI works best when it’s matched to the exact tasks your dealership handles every day.
“Use cases” refers to the specific situations and tasks the AI is expected to handle—like answering lead questions, qualifying buyers, or supporting service scheduling. The speaker argues that AI must be aligned to these real dealership scenarios, not treated as a universal solution.
OpenAI
"And I'm not throwing shade at any of the big enterprise. I'll throw the shade. You know, our open AIs of the world or the anthropics."
OpenAI is a well-known company that makes AI tools. The episode is saying that even with top AI brands, you can’t just plug it in and assume it will handle everything perfectly.
OpenAI is referenced as one of the major “enterprise” AI providers in the market. The speaker’s point is that even with big-name AI companies, dealerships still need human oversight and tailored implementation rather than assuming the model will automatically work for every use case.
Anthropics
"I'll throw the shade. You know, our open AIs of the world or the anthropics."
Anthropic is another big AI company. The takeaway is that even strong AI tools need the dealership’s guidance and supervision to work well in real sales and service situations.
Anthropics (commonly referring to Anthropic, the AI company behind Claude) is mentioned alongside OpenAI as a major enterprise AI provider. The speaker’s argument is that vendor/model quality alone doesn’t replace dealership-specific setup and human-in-the-loop processes.
gamification
"And so there is a sort of gamification of it. Like, I don't know if you've ever gotten into video games or anything like that."
Gamification is when a tool uses “game” tricks to keep you interested. In this case, it’s like the software keeps nudging you to come back and keep working.
Gamification is using game-like mechanics (goals, progress, rewards) to encourage continued engagement. The speaker compares this to how some AI tools are designed to keep users interacting—often by making the next step feel rewarding or necessary.
blanket AI
"Because just a blanket AI is not actually the need. It's it's a hype piece meant to get your attention."
“Blanket AI” implies a one-size-fits-all AI solution that isn’t tailored to the dealership’s specific workflows and needs. The speaker argues that this kind of generic AI is often more about attention/hype than solving the real operational problem.
Stream Companies
"What is Stream's vision for helping dealers avoid these technological pitfalls while still taking advantage of what AI can do well? [676.8s] The end of the day, yeah, we are partners to our dealer clients."
Stream Companies is the company talking about how AI should be used in car dealerships. They’re saying they help dealers use AI safely, not just “turn it on and hope.”
Stream Companies is the company being interviewed about its approach to using AI in dealerships. The discussion frames Stream as a partner that helps dealers avoid AI pitfalls while still leveraging AI’s strengths.
technological pitfalls
"What is Stream's vision for helping dealers avoid these technological pitfalls while still taking advantage of what AI can do well? [676.8s] The end of the day, yeah, we are partners to our dealer clients."
They’re talking about the ways AI can go wrong in real life. Their point is that dealers need help and guidance so the technology doesn’t create new problems.
“Technological pitfalls” refers to common failure modes when adopting AI or automation—such as incorrect outputs, overreliance on the system, or misalignment with dealership processes. The speaker positions Stream’s approach as mitigating these risks through dealer-specific design and support.
educating our clients, helping them strategize
"Technology is part of that. [724.7s] And we believe in educating our clients, helping them strategize. [729.0s] The technology is there as something that helps them accelerate"
They’re saying the company doesn’t just hand over software. They also teach dealers how to use it and help them plan how it fits into their day-to-day business.
The speaker highlights implementation support beyond software—education and strategy help dealers adopt AI effectively. In dealership terms, this means aligning AI usage with sales, service, and operational workflows rather than treating it as a plug-and-play tool.
human in the loop
"There will always be a human in the loop to ensure that when you're using the AI, you're using it in a way that truly solves problems."
It means the AI doesn’t run the whole show by itself. A person checks what the AI suggests so mistakes don’t turn into real problems.
“Human in the loop” means AI recommendations or automation are reviewed or guided by people before they’re acted on. In a dealership context, it helps prevent AI from making decisions based on incomplete context or bad inputs.
bad data
"Or maybe even because there was bad data somewhere along the lines and you kind of were consuming it in a vacuum."
If the information going into the AI is wrong, the AI’s advice will also be wrong. That can cause the dealership to chase the wrong leads or make bad decisions.
“Bad data” refers to incorrect, incomplete, or outdated information feeding into AI systems. If the dealership’s data is wrong, AI outputs can be misleading—leading to wasted effort, poor targeting, and incorrect decisions.
data analysis in a vacuum
"But also the vacuum you're talking about, Mac, which is nothing worse than data analysis in a vacuum."
It’s when you look at numbers without the real context around them. In a dealership, that can lead to advice that sounds smart but doesn’t fit reality.
“Data analysis in a vacuum” describes analyzing information without enough real-world context (like customer behavior, inventory constraints, or local market conditions). For dealerships, this can cause AI-driven conclusions that don’t match what’s actually happening on the floor or in sales.
blinders are on
"So we start looking over here. And we are so fixated on it, blinders are on."
It means you’re only paying attention to one thing and ignoring everything else. In business terms, that can lead to bad conclusions from partial information.
“Blinders are on” is a metaphor for tunnel vision—when attention narrows to one stimulus and you miss other relevant information. In dealership analytics, it describes the risk of over-focusing on a single dashboard alert or metric.
holistic portrait of the data
"we are missing the holistic portrait that ... full picture of the data. ... We see the whole picture, the holistic portrait that the data is telling us."
A holistic view means you look at all the information together, not just one number. That helps you make a better decision.
A “holistic portrait of the data” means combining multiple data points into a single, broader understanding rather than treating each metric independently. The transcript argues that this approach helps avoid tunnel vision and improves how AI-supported decisions are interpreted.
zoomed in vs zoom out
"If I zoomed in really, really close right now, ... Zoom out. I see this whole showroom floor ... Zooming in, you are missing out on so much."
The “zoomed in vs zoom out” framing describes how focusing on a single indicator can cause you to miss other important signals. In dealership operations, this maps to balancing one metric (like a warning) against the overall customer and sales-floor picture.
Request an Explanation
Heard something you'd like explained? We'll add it to this episode.
Sign in to request explanations for terms you heard.
Want to learn more?
Browse our glossary for plain-English explanations of automotive terms, jargon, and concepts.
Help improve this episode
See something that's not quite right? Our annotations are AI-generated and can sometimes miss the mark. Click the flag icon on any annotation to suggest a correction.