Add support for non aws models - openAI + gemini#206

Open

madhurprash wants to merge 24 commits intomainfrom

add-support-for-non-aws-models

Commits on Dec 8, 2024

first working version for openAI on fmbench

Ubuntu
authored and
madhurprash
committed
openai prompt template - test wip
madhurprash
committed
config file for openai+bedrock
madhurprash
committed
support for gemini
madhurprash
committed
config files for openai & gemini - bug fixes to be done for api handling
madhurprash
committed
api handling done, first working version
madhurprash
committed
updated predictor

madhur
authored and
madhurprash
committed
updated bug fix for tokenizer fix

madhur
authored and
madhurprash
committed
config update for gemini

madhur
authored and
madhurprash
committed
new config files for openai and gemini

Ubuntu
authored and
madhurprash
committed
non aws models docs update

Ubuntu
authored and
madhurprash
committed
Updating the model eval judge
madhurprash
committed
code refactoring

Ubuntu
authored and
madhurprash
committed
tested latest updates with openAI and Gemini
madhurprash
committed
Update external_predictor.py
madhurprash
committed
mixtral file for g6.48xl on ec2
madhurprash
committed
Update pricing.yml for opus and 3.5 sonnet
madhurprash
committed
add sonnet 3.5/opus + retry logic and update pricing
madhurprash
committed
add config file for gpt 4o for large prompts
madhurprash
committed
open ai, gemini, nova models
madhurprash
committed
nova, openai addition
madhurprash
committed
nova, openAI implementation
madhurprash
committed

Commits on Dec 9, 2024

updating the nova openai config files
Ubuntu
committed
adding support for nova + openai + gemini
Ubuntu
committed