What's Changed
- Decouple model config from repo, the config priority is the following descending order: user-defined config, cached config, default config
- Code base refactor, command logic moved to helper classes
- Retire launch server bash script, moved server launching logic to python
- Update metrics command to use
metrics
API endpoint - Exposed additional launch parameters for CLI
- Automate docker image build process and pushing to dockerhub
- Added unit tests for
_cli.py
,_utils.py
, and imports, improved test coverage - Add server launch info json to logging
- Misc house-keeping fixes
New Models
- VLM:
- Phi-3.5-vision-instruct
- Molmo-7B-D-0924
- InternVL2_5-8B
- glm-4v-9b
- deepseek-vl2
- deepseek-vl2-small
- Reward Modelling:
- Qwen2.5-Math-PRM-7B
New Contributors
Other Contributors
@amrit110 @XkunW @fcogidi @xeon27 @kohankhaki
Full Changelog: v0.4.1...v0.5.0