launch the script

bash run_qwen_vl.sh

stop the process

bash stop_all.sh

环境配置： cuda 12.1 nccl 2.18.2 deepspeed 0.13.5 torch 2.1

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
Qwen-VL		Qwen-VL
assets		assets
data		data
evaluation_scripts		evaluation_scripts
llama_for_profile		llama_for_profile
utils		utils
README.md		README.md
SimSun.ttf		SimSun.ttf
data_provider.py		data_provider.py
ds_env		ds_env
hostfile		hostfile
hostfile_23		hostfile_23
llava_665k_test.json		llava_665k_test.json
main.py		main.py
pretrain_llama.py		pretrain_llama.py
prompt_eval.py		prompt_eval.py
run_qwen_vl.sh		run_qwen_vl.sh
start_train.py		start_train.py
stop_all.sh		stop_all.sh
test_embedding.py		test_embedding.py