llama-cpp-python cannot load Gemma 4 models with GPU or even CPU only. Thanks a lot.
Suspected error:
llama_prepare_model_devices: invalid value for main_gpu: 0 (available devices: 0)
llama_model_load_from_file_impl: failed to load model
Problem details:
KLL535/ComfyUI_Simple_Qwen3-VL-gguf#34
llama-cpp-python cannot load Gemma 4 models with GPU or even CPU only. Thanks a lot.
Suspected error:
llama_prepare_model_devices: invalid value for main_gpu: 0 (available devices: 0)
llama_model_load_from_file_impl: failed to load model
Problem details:
KLL535/ComfyUI_Simple_Qwen3-VL-gguf#34