Skip to content

[Bug] 动态batch分档能转出om,但推理报RuntimeError: [1][ACL: invalid parameter] #422

Description

@Positever

操作系统及版本

openEuler22.03 LTS-SP4

安装工具的python环境

在anaconda/miniconda创建的python虚拟环境

python版本

3.10

AISBench工具版本

0.0.2

AISBench执行命令

python -m ais_bench --model onnx_export2/vision_model_dyn_linux_aarch64.om --dymBatch 4

模型配置文件或自定义配置文件内容

None

预期行为

om推理成功

实际行为

(fg_clip2) [root@localhost fg_clip2_test]# python -m ais_bench --model onnx_export2/vision_model_dyn_linux_aarch64.om --dymBatch 4
/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/common/miscellaneous.py:58: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
import pkg_resources
[INFO] acl init success
[INFO] open device 0 success
[INFO] create new context
[INFO] load model onnx_export2/vision_model_dyn_linux_aarch64.om success
[INFO] create model description success
[ERROR] the dynamic_batch_size parameter is not specified for model conversion
[WARN] Check failed:processModel->CheckDynamicBatchSize(batchsize, is_dymbatch), ret:1

Traceback (most recent call last):
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/main.py", line 34, in
ret = infer_process(args)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 808, in infer_process
main(args)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 475, in main
session = init_inference_session(args, tmp_acl_json_path if tmp_acl_json_path is not None else acl_json_path)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 130, in init_inference_session
set_session_options(session, args)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 72, in set_session_options
session.set_dynamic_batchsize(args.dym_batch)
File "/root/miniconda3/envs/fg_clip2/lib/python3.10/site-packages/ais_bench/infer/interface.py", line 138, in set_dynamic_batchsize
self.session.set_dynamic_batchsize(dym_batch)
RuntimeError: [1][ACL: invalid parameter]
[INFO] unload model success, model Id is 2147483648
[INFO] end to reset device 0
[INFO] end to finalize acl

前置检查

  • 我已读懂主页文档的快速入门,无法解决问题
  • 我已检索过FAQ,无重复问题
  • 我已搜索过现有Issue,无重复问题
  • 我已更新到最新版本,问题仍存在

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcontent_check_passedissue content check passed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions