Skip to playerSkip to main content
  • 10 minutes ago
Sponsored by Dell AI Factory with NVIDIA

At the dawn of agentic AI, off-the-shelf models seemed to eliminate the complexity that was coming at enterprise leaders at breakneck speed. Now that enterprise AI dexterity has matured, it's become clear that generic models make for generic agents, and that better outcomes will result from smaller, smarter models trained on your data and on AI infrastructure you own.

Dr. Jon Krohn and Frank Basso of Lightning AI break down this mindset shift in terms that will resonate with leaders: ROI that shows up in business outcomes and reduced token usage. They also detail how the Dell AI Factory with NVIDIA powers the principles through full-stack, integrated infrastructure that improves utilization.

Learn how the Dell AI Factory with NVIDIA can power your way to AI here: https://dell.com/YourWayToAI

Category

🤖
Tech
Transcript
00:00The smartest path to better tokenomics isn't haggling over the price of a token.
00:04It's building smarter, smaller models.
00:10Lightning AI is the AI native cloud built to allow organizations to own their own AI.
00:17There's been this evolution where initially we had Gen AI models and
00:22you went to whichever was the best Gen AI frontier provider.
00:26But what we're realizing now is that that can be expensive.
00:30You're locked into a particular system and they can change things on you.
00:34So the shift now, very recently, is a shift to enterprises owning their own AI.
00:40It's historically been hard in a pre-Lightning world to be able to train your own AI models.
00:45The companies in the lead on training AI models are doing three things differently.
00:49The first thing is evaluation.
00:50So even before they start training a model, they have a good sense of what the workflow is that they
00:56want to impact.
00:57The second thing is that they treat training as a loop.
01:01The third thing is owning the AI infrastructure themselves.
01:05As an enterprise buyer, it's always a concern to derive the best value for every dollar you spend.
01:10You have limited budgets and you have to get the most out of it.
01:13With traditional hyperscale cloud providers, you are paying for a large amount of equipment or a large amount of instances
01:21can be very expensive if they're sitting there and running when you're not using them.
01:26As one of the first providers to deploy Dell's GB300 rack scale systems, this gives us an advantage in the
01:32marketplace for our scale-out larger customers that need large amounts of high-performance superpod capacity on demand or in
01:44a dedicated function for either training or other AI workloads.
01:48Generic models make generic agents.
01:50When you have an agent fine-tuned to your own data, it doesn't need to spend a whole bunch of
01:55time in the background thinking, which takes time, which uses tokens, it costs money.
02:00Instead, it can quickly get to the answer because it doesn't need to reason through it.
02:03The economic wins are usually orders of magnitude as opposed to a few percentage points, and that's because we get
02:09to stack a bunch of positive effects together.
02:12We're getting better accuracy on our models, which means that we need fewer human interactions downstream.
02:19We have a smaller model, which means that we're saving on those per-token costs, and we're getting our utilization
02:26up because smaller models make better use of the GPUs that we have available.
02:31Enterprises don't just want access to AI.
02:34They want predictability and performance.
02:36They want to own their own data, and they want the best value for every dollar spent.
02:40The Dell AI factory with NVIDIA makes it so easy for Lightning AI to get hardware deployed for ourselves, which
02:48has downstream benefits for our customers.
02:50So by providing us with all of the pieces as one working kit, the liquid cooling, the GPUs, the storage,
02:59the networking, all of these things being available as one package,
03:03as opposed to something that we have to figure out piece by piece, allows us to serve our customers faster,
03:09lightning faster.
03:13That's why we keep going through.
03:14What makes all the dimensions of players so easy?
03:16I'm a better solution for every dollar."
03:16I'm a better option for everything you're going to have to do in this video.
03:17Yeah, I'm better.
03:17I want you to try to find it as a huge power line with me.
03:18What makes me look like.
Comments

Recommended