参考:
https://www.hiascend.com/document/detail/zh/mindie/230/quickstart/mindie_quickstart_0004.html
https://www.hiascend.com/document/detail/zh/mindie/230/mindiellm/llmdev/mindie_service0285.html
mkdir /root/tmp
modelscope download --model Qwen/Qwen3-8B --local_dir /root/tmp/
将Qwen3-8B直接放到tmp中,目录结构为
/root/tmp/Qwen3-8B/config.json
1. 拉取镜像
docker pull --platform=arm64 swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.3.0-300I-Duo-py311-openeuler24.03-lts
docker images |grep 2.3.0-300I-Duo-py311-openeuler24.03-lts
2.启动容器
docker run -it -d --net=host --shm-size=4g \
--name qwen3-8b\
-w /home \
--device=/