All issues

Search results

Support speculative decoding

Status: Open.

#289 In aws-samples/foundation-model-benchmarking-tool;

· myang-tech42 opened on Mar 4, 2025

Bring your own judge functionality

Status: Open.

#283 In aws-samples/foundation-model-benchmarking-tool;

· madhurprash opened on Feb 12, 2025

Dataset handling if any of the keys have missing fields

Status: Open.

#281 In aws-samples/foundation-model-benchmarking-tool;

· madhurprash opened on Feb 5, 2025

Model accuracy result file doesn't show correct candidate model name

Status: Open.

#276 In aws-samples/foundation-model-benchmarking-tool;

· Yiwen-Zhang opened on Jan 24, 2025

Add benchmarking for training models

Status: Open.

#270 In aws-samples/foundation-model-benchmarking-tool;

· madhurprash opened on Jan 17, 2025

The pricing fetching logic only works for EC2

Status: Open.

#268 In aws-samples/foundation-model-benchmarking-tool;

· Yiwen-Zhang opened on Jan 14, 2025

Experiment config file's model name doesn't match with pricing_fallback.yml file's model name

Status: Open.

#267 In aws-samples/foundation-model-benchmarking-tool;

· Yiwen-Zhang opened on Jan 14, 2025

parameterize configuration files

Status: Open.

#261 In aws-samples/foundation-model-benchmarking-tool;

· madhurprash opened on Jan 8, 2025

Fails when testing Haiku on AWS Bedrock

Status: Open.

#247 In aws-samples/foundation-model-benchmarking-tool;

· NidPlays opened on Nov 28, 2024

Allow backup/ failover regions to be specified

Status: Open.

#232 In aws-samples/foundation-model-benchmarking-tool;

· jimburtoft opened on Nov 7, 2024

Add support for Bedrock Custom Import Models

Status: Open.

#224 In aws-samples/foundation-model-benchmarking-tool;

· dickren123 opened on Oct 26, 2024

miss warm up phase

Status: Open.

#213 In aws-samples/foundation-model-benchmarking-tool;

· lxning opened on Oct 8, 2024