AWS

Run agentgateway on AWS to leverage Amazon Bedrock, ECS/EKS, and other AWS services.

Deployment options

Amazon ECS

Run agentgateway as an ECS service with Fargate or EC2.

{
  "family": "agentgateway",
  "networkMode": "awsvpc",
  "containerDefinitions": [
    {
      "name": "agentgateway",
      "image": "ghcr.io/agentgateway/agentgateway:latest",
      "portMappings": [
        {"containerPort": 3000, "protocol": "tcp"}
      ],
      "environment": [
        {"name": "ADMIN_ADDR", "value": "0.0.0.0:15000"}
      ],
      "secrets": [
        {
          "name": "OPENAI_API_KEY",
          "valueFrom": "arn:aws:secretsmanager:us-east-1:123456789:secret:openai-key"
        }
      ],
      "logConfiguration": {
        "logDriver": "awslogs",
        "options": {
          "awslogs-group": "/ecs/agentgateway",
          "awslogs-region": "us-east-1",
          "awslogs-stream-prefix": "agentgateway"
        }
      }
    }
  ],
  "requiresCompatibilities": ["FARGATE"],
  "cpu": "512",
  "memory": "1024"
}

Amazon EKS

For EKS deployments, use Agentgateway on Kubernetes which provides native Kubernetes Gateway API support, dynamic configuration, and MCP service discovery.

AWS integrations

Integration Purpose
Amazon Bedrock Access Claude, Llama, and other models
AWS Secrets Manager Secure API key storage
AWS ALB Load balancing with SSL termination
CloudWatch Logs and metrics
X-Ray Distributed tracing

IAM permissions

Create an IAM role for agentgateway with these permissions:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "bedrock:InvokeModel",
        "bedrock:InvokeModelWithResponseStream"
      ],
      "Resource": "arn:aws:bedrock:*:*:model/*"
    },
    {
      "Effect": "Allow",
      "Action": [
        "secretsmanager:GetSecretValue"
      ],
      "Resource": "arn:aws:secretsmanager:*:*:secret:llm-*"
    }
  ]
}

Learn more

Agentgateway assistant

Ask me anything about agentgateway configuration, features, or usage.

Note: AI-generated content might contain errors; please verify and test all returned information.

↑↓ navigate select esc dismiss

What could be improved?