MiniCPM本地部署记录

发布时间:2026/6/28 15:29:31
MiniCPM本地部署记录 MiniCPM本地部署记录首次尝试本地部署MiniCPM-3.0文档来源https://modelbest.feishu.cn/wiki/WGSuwo6ePiO2wbkGvzdc8Zo9nxh1部署模型MiniCPM-3.02部署框架llamacpp3部署环境4060TICUDA12.8执行语句如下rm -rf build cmake -B build \ -DGGML_CUDAON \ -DCMAKE_BUILD_TYPERelease \ -DCMAKE_CUDA_COMPILER/usr/local/cuda-12.4/bin/nvcc \ -DCMAKE_CUDA_ARCHITECTURES89 \ -DGGML_CUDA_COMPRESSION_MODEnone cmake --build build -j$(nproc)