Description
Everyone is talking about AI models—but the hardest part of enterprise AI isn't choosing a model. It's building the infrastructure to run it securely, reliably, and at scale. In this episode, Docker's Per Krogslund is joined by Colton Shaw, Principal Architect at Spectro Cloud, for a conversation about the often-overlooked foundation of enterprise AI. They discuss why incidents like Log4Shell transformed software supply chain security, how Software Bills of Materials (SBOMs) provide visibility into application dependencies, and why AI-generated code introduces new governance challenges.
Colton also shares lessons from deploying Kubernetes across highly regulated and air-gapped public sector environments, explains why edge AI is reshaping industries from defense to healthcare, and discusses how organizations can balance open-source innovation with enterprise-grade security, resiliency, and operational control.
Whether you're modernizing cloud infrastructure, evaluating AI platforms, or preparing your organization for production AI, this episode offers practical insights into building systems that are secure, flexible, and ready for the future.
In This Episode You'll Hear:
• Why enterprise AI is fundamentally an infrastructure challenge
• How Log4Shell changed software supply chain security forever
• What Software Bills of Materials (SBOMs) are and why they matter
• The risks AI-generated code introduces into enterprise environments
• How hardened and distroless containers reduce attack surfaces
• The realities of deploying Kubernetes in air-gapped environments
• Why edge AI requires a different operational mindset than cloud AI
• How model routing reduces vendor lock-in and improves resiliency
• The tradeoffs between proprietary and open-source AI models
• Why governance, auditability, and human oversight remain essential as AI scales
Timestamps:
00:00 Welcome to Ship Happens
00:38 Meet Colton and Spectro Cloud
01:22 Why SBOMs Matter for Enterprise AI
03:57 The Log4Shell Wake-Up Call
07:19 Hardening Containers for AI Workloads
09:33 Security Requirements in Regulated Industries
14:16 What Spectro Cloud Does
15:54 Kubernetes in Air-Gapped Defense Environments
19:16 Why AI Infrastructure Is Different
20:45 The Current State of AI Operations
24:24 Budgeting for AI: Tokens vs. Talent
26:28 AI Sovereignty and Avoiding Vendor Lock-In
29:58 Building and Serving Your Own Models
32:54 Choosing the Right AI Model
36:52 Model Routing for Reliability and Resilience
40:33 Designing Invisible AI Failover
41:02 Managing Developer Complexity
43:45 AI Development Environments at Scale
45:04 Edge AI in the Real World
52:28 Why Human-in-the-Loop Still Matters
58:22 Governance, Audit Trails, and Responsible AI
01:05:20 Open-Source vs. Proprietary Models
01:11:46 Moving Beyond APIs to AI Strategy
01:17:39 Closing Predictions
About the Guest:
Colton Shaw is a Principal Architect at Spectro Cloud, where he helps public sector and enterprise organizations design, deploy, and secure Kubernetes platforms across cloud, edge, and air-gapped environments. His work focuses on modern infrastructure, software supply chain security, AI governance, and helping organizations operationalize AI in highly regulated industries, including defense and government. With deep expertise in Kubernetes, container security, and edge computing, Colton works with teams building resilient platforms that support mission-critical applications at scale.
Links & Resources:
🌐 Learn more about Spectro Cloud: https://www.spectrocloud.com
🐳 Learn more about Docker: https://www.docker.com
☸️ Kubernetes Documentation: https://kubernetes.io
🛡️ Learn more about Software Bills of Materials (SBOMs): https://www.cisa.gov/sbom
📄 Learn more about the Log4Shell vulnerability: https://www.cisa.gov/news-events/cybersecurity-advisories/aa21-356a
#Docker #EnterpriseAI #Kubernetes #CloudNative #Cybersecurity #EdgeComputing #DevSecOps #AI