Skip to content

Commit 68c4a38

Browse files
committed
bump up version for v2.0.21
1 parent 96c79b7 commit 68c4a38

File tree

6 files changed

+21
-7
lines changed

6 files changed

+21
-7
lines changed

README.md

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,9 @@ Llama3 is now available on SageMaker (read [blog post](https://aws.amazon.com/bl
8888
## New in this release
8989

9090
## 2.0.21
91-
1. Dynamically get EC2 pricing from Boto3 api
91+
92+
1. Dynamically get EC2 pricing from Boto3 API.
93+
1. Update pricing information and model id for Amazon Bedrock models.
9294

9395
## 2.0.20
9496
1. Add `hf_tokenizer_model_id` parameter to automatically download tokenizers from Hugging Face.
@@ -97,10 +99,6 @@ Llama3 is now available on SageMaker (read [blog post](https://aws.amazon.com/bl
9799
1. Config files for `Llama3.1-1b` on AMD/Intel CPU instance types.
98100
1. Bug fixes for token counting for vLLM.
99101

100-
## 2.0.18
101-
1. Delete SageMaker endpoint as soon as the run finishes.
102-
103-
104102

105103
[Release history](./release_history.md)
106104

create_manifest.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@
2121
"phi_tokenizer/.keep",
2222
"scripts/.keep",
2323
"configs/pricing.yml",
24+
"configs/pricing_fallback.yml",
2425
# add new datasets here
2526
"source_data/2wikimqa_e.jsonl",
2627
"source_data/2wikimqa.jsonl",

docs/manifest.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,8 @@ Here is a listing of the various configuration files available out-of-the-box wi
7272
[├── llama3/8b/config-ec2-llama3-8b-m7a-16xlarge.yml](configs/llama3/8b/config-ec2-llama3-8b-m7a-16xlarge.yml)
7373
[├── llama3/8b/config-ec2-llama3-8b-m7a-24xlarge.yml](configs/llama3/8b/config-ec2-llama3-8b-m7a-24xlarge.yml)
7474
[├── llama3/8b/config-ec2-llama3-8b-m7i-12xlarge.yml](configs/llama3/8b/config-ec2-llama3-8b-m7i-12xlarge.yml)
75+
[├── llama3/8b/config-ec2-llama3-8b-m7i-16xlarge.yml](configs/llama3/8b/config-ec2-llama3-8b-m7i-16xlarge.yml)
76+
[├── llama3/8b/config-ec2-llama3-8b-m7i-24xlarge.yml](configs/llama3/8b/config-ec2-llama3-8b-m7i-24xlarge.yml)
7577
[├── llama3/8b/config-ec2-llama3-8b-neuron-trn1-32xl-tp16-sm.yml](configs/llama3/8b/config-ec2-llama3-8b-neuron-trn1-32xl-tp16-sm.yml)
7678
[├── llama3/8b/config-ec2-llama3-8b-p4d-tp-2-mc-max.yml](configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-2-mc-max.yml)
7779
[├── llama3/8b/config-ec2-llama3-8b-p4d-tp-4-mc-max.yml](configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-4-mc-max.yml)
@@ -90,6 +92,7 @@ Here is a listing of the various configuration files available out-of-the-box wi
9092
[├── llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-triton-ec2.yml](configs/llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-triton-ec2.yml)
9193
[├── llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-djl-ec2.yml](configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-djl-ec2.yml)
9294
[├── llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-triton-ec2.yml](configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-triton-ec2.yml)
95+
[├── llama3/8b/config-llama3-8b-g5.48xl-tp-8-mc-max-triton-ec2.yml](configs/llama3/8b/config-llama3-8b-g5.48xl-tp-8-mc-max-triton-ec2.yml)
9396
[├── llama3/8b/config-llama3-8b-g5.4xl-tp-1-mc-max-triton-ec2.yml](configs/llama3/8b/config-llama3-8b-g5.4xl-tp-1-mc-max-triton-ec2.yml)
9497
[├── llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-djl-ec2.yml](configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-djl-ec2.yml)
9598
[├── llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-triton-ec2.yml](configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-triton-ec2.yml)
@@ -233,4 +236,5 @@ Here is a listing of the various configuration files available out-of-the-box wi
233236
[└── multimodal/bedrock/config-llama-3-2-claude-models-scienceqa.yml](configs/multimodal/bedrock/config-llama-3-2-claude-models-scienceqa.yml)
234237
**phi**
235238
[└── phi/config-phi-3-g5.yml](configs/phi/config-phi-3-g5.yml)
236-
[pricing.yml](configs/pricing.yml)
239+
[pricing.yml](configs/pricing.yml)
240+
[pricing_fallback.yml](configs/pricing_fallback.yml)

docs/releases.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,11 @@
11
# Releases
22

3-
## 2.0.22
3+
## 2.0.21
4+
5+
1. Dynamically get EC2 pricing from Boto3 API.
6+
1. Update pricing information and model id for Amazon Bedrock models.
7+
8+
## 2.0.20
49

510
1. Add `hf_tokenizer_model_id` parameter to automatically download tokenizers from Hugging Face.
611

manifest.txt

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -118,6 +118,8 @@ configs/llama3/8b/config-ec2-llama3-8b-m5-16xlarge.yml
118118
configs/llama3/8b/config-ec2-llama3-8b-m7a-16xlarge.yml
119119
configs/llama3/8b/config-ec2-llama3-8b-m7a-24xlarge.yml
120120
configs/llama3/8b/config-ec2-llama3-8b-m7i-12xlarge.yml
121+
configs/llama3/8b/config-ec2-llama3-8b-m7i-16xlarge.yml
122+
configs/llama3/8b/config-ec2-llama3-8b-m7i-24xlarge.yml
121123
configs/llama3/8b/config-ec2-llama3-8b-neuron-trn1-32xl-tp16-sm.yml
122124
configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-2-mc-max.yml
123125
configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-4-mc-max.yml
@@ -136,6 +138,7 @@ configs/llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-djl-ec2.yml
136138
configs/llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-triton-ec2.yml
137139
configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-djl-ec2.yml
138140
configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-triton-ec2.yml
141+
configs/llama3/8b/config-llama3-8b-g5.48xl-tp-8-mc-max-triton-ec2.yml
139142
configs/llama3/8b/config-llama3-8b-g5.4xl-tp-1-mc-max-triton-ec2.yml
140143
configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-djl-ec2.yml
141144
configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-triton-ec2.yml

release_history.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,6 @@
1+
## 2.0.18
2+
1. Delete SageMaker endpoint as soon as the run finishes.
3+
14
## 2.0.17
25
1. Add support for embedding models through SageMaker jumpstart
36
1. Add support for LLama 3.2 11b Vision Instruct benchmarking through FMBench

0 commit comments

Comments
 (0)