Per token latency metrics - TTFT, TPOT

aarora79 released this 07 Jul 02:21

· 975 commits to main since this release

54d29ec

What's Changed

rebaseline by @aarora79 in #140
Add ttft tpot ttlt metrics by @aarora79 in #141
updated manifest by @aarora79 in #142

Full Changelog: v1.0.48...v1.0.49

Contributors

aarora79

Assets 2