production-stack/deployment_on_cloud/aws

Setting up EKS vLLM stack with one command

This script automatically configures a EKS LLM inference cluster. Make sure your AWS cli (v2) is installed, logged in, and region set up. You have eksctl, kubectl, helm installed.

Modify fields production_stack_specification.yaml and execute as:

bash entry_point.sh YOUR_AWSREGION YAML_FILE_PATH

Clean up the service with:

bash clean_up.sh production-stack YOUR_AWSREGION

You may also want to manually delete the VPC and clean up the cloud formation in the AWS Console.