Artificial Intelligence

Category: Advanced (300)

Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM

Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM

Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an OpenAI-compatible endpoint with built-in reasoning, tool calling, and native MTP speculative decoding.

How Heurist Finance built an AI-native investment workbench on Amazon Bedrock AgentCore

How Heurist Finance built an AI-native investment workbench on Amazon Bedrock AgentCore

Learn how Heurist built Heurist Finance, a conversational AI investment workbench, on Amazon Bedrock AgentCore. This customer story shows how AgentCore payments, Identity, Memory, Code Interpreter, and Observability let a small team buy premium market data per query, isolate analysis in a sandbox, and keep every action auditable.

Benchmarking small LLM inference on SageMaker AI: G7 vs G5 and G6

Benchmarking small LLM inference on SageMaker AI: G7 vs G5 and G6

Benchmark two 30B Mixture-of-Experts models, Qwen3-Coder-30B and NVIDIA Nemotron-3-Nano-30B, across G5, G6, G6e, and G7 GPU instances on Amazon SageMaker AI. Compare throughput, latency, and cost-per-token, and see how G7’s NVIDIA Blackwell GPUs deliver measurable price-performance gains for real-time LLM inference.

How HPE Zerto built an agentic troubleshooting system with Amazon Bedrock

How HPE Zerto built an agentic troubleshooting system with Amazon Bedrock

HPE Zerto built an agentic troubleshooting system powered by Amazon Bedrock that runs on-premises inside the customer environment. This post describes the multi-agent architecture, the on-premises deployment model built with Strands Agents, and the engineering challenges of grounding agents in live disaster recovery data.

Designing memory lifecycle policies for Amazon Bedrock AgentCore

Designing lifecycle policies for AgentCore memory

Long-running AI agents accumulate outdated memories that degrade quality and create compliance risk. Learn how to design memory lifecycle policies for Amazon Bedrock AgentCore: scoring, consolidating, and pruning agent memories on a nightly AWS Step Functions workflow, with a deployable AWS CDK stack.

Build a Physical AI model factory with NVIDIA Cosmos 3 on SageMaker HyperPod

Build a Physical AI model factory with NVIDIA Cosmos 3 on SageMaker HyperPod

Building a Physical AI system takes a continuous pipeline, not a single training job. This post shows how to run that model factory (synthetic data generation, post-training, and closed-loop evaluation with NVIDIA Cosmos 3) on a persistent, resilient Amazon SageMaker HyperPod cluster on Amazon EKS, with GPU goodput as the metric that matters.

Run agent-driven Amazon SageMaker HyperPod operations with InstantStart

Run agent-driven Amazon SageMaker HyperPod operations with InstantStart

HyperPod InstantStart is an open source control plane that composes Amazon EKS orchestration with the managed capabilities of Amazon SageMaker HyperPod. It drives the same guarded operations through both a web interface and an AI agent, turning cluster bootstrap, capacity, training, inference, and storage into dependable, agent-driven infrastructure.

How Intuit built an agentic disaster recovery assistant with Amazon Bedrock

How Intuit built an agentic disaster recovery assistant with Amazon Bedrock

Disaster recovery at scale is hard. Learn how Intuit built EWOK Agent, an agentic disaster recovery assistant on Amazon Bedrock that lets on-call engineers run production failovers from a plain-language request while keeping every action audited, policy-compliant, and safe.

AI-driven development lifecycle using Amazon Bedrock AgentCore

AI-driven development lifecycle using Amazon Bedrock AgentCore

Engineering teams adopting the AI-Driven Development Lifecycle (AI-DLC) often struggle to turn concepts into working code. This post walks through two reference implementations on Amazon Bedrock AgentCore, Kiro, and Claude Code: an SQL-to-ER-diagram generator and a multi-agent code security analyzer that put the AI-DLC construction phase into practice.