Artificial Intelligence

Category: Advanced (300)

Tiered KV cache for large LLMs on Amazon SageMaker HyperPod with Curvine

Tiered KV cache for large LLMs on Amazon SageMaker HyperPod with Curvine

Running large language model inference at scale forces a KV cache trade-off: oversized GPU instances or slow time-to-first-token. This post builds a tiered KV cache on Amazon SageMaker HyperPod that extends the cache into a shared, distributed NVMe pool with Curvine, so replicas reuse cache at near-local-disk speeds on cost-efficient instances.

Determining playoff clinching scenarios in the NHL using constraint programming

Determining playoff clinching scenarios in the NHL using constraint programming

The AWS Generative AI Innovation Center built an automated system that uses constraint programming and custom tree search to determine, with mathematical certainty, when and how an NHL team clinches a playoff spot. The approach was validated against four full NHL seasons of officially published results.

Configure rate limits for AI traffic on AgentCore gateway

Configure rate limits for AI traffic on AgentCore gateway

Learn how to configure rate limits on Amazon Bedrock AgentCore gateway to enforce per-user and per-target traffic controls. Define request, token, and connection limits scoped by JWT claims or IAM identity to protect downstream models, tools, and agents from traffic spikes.

Build visibility for Codex on Amazon Bedrock with OpenTelemetry and Amazon CloudWatch

Build visibility for Codex on Amazon Bedrock with OpenTelemetry and Amazon CloudWatch

As engineering teams adopt coding agents like Codex, leaders need visibility into adoption, consumption, and reliability. This post shows how to route Codex OpenTelemetry metrics through a local collector to Amazon CloudWatch for an AWS native view of usage by user, team, and cost center.

Building an agentic app deployer with Amazon Bedrock and AWS Lambda

Building an agentic app deployer with Amazon Bedrock and AWS Lambda

PDI Technologies built PDI Brew, an agentic platform on AWS where non-technical employees describe a tool in plain English and receive a fully provisioned, multi-tenant web application in seconds. See how a pluggable planner and an AWS Lambda provisioning agent turn plain-English intent into governed, multi-tenant apps backed by Amazon Bedrock.

Run production AI agents in n8n with Amazon Bedrock AgentCore harness

Run production AI agents in n8n with Amazon Bedrock AgentCore harness

Amazon Bedrock AgentCore harness is now generally available. Learn how to add it as an agent step in n8n workflows using a new open-source community node, and build agents with persistent memory, real tools, code execution, and VPC isolation — all from the n8n editor with no infrastructure or agent code.

Automated web insight extraction with Amazon Bedrock AgentCore

Extracting insights from dozens of websites by hand quickly becomes overwhelming. This post shows how to build an automated web insight extraction solution with Amazon Bedrock AgentCore Browser, Amazon Bedrock, Amazon OpenSearch Serverless, and AWS Lambda that monitors RSS feeds, renders pages reliably, and makes AI-extracted insights searchable.