We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Description Failed to bind model. Error (server side):
I0325 07:53:43.826305 1 model_lifecycle.cc:473] "loading: Power:1" I0325 07:53:43.994831 162 pb_stub.cc:320] Failed to initialize Python stub for auto-complete: ModuleNotFoundError: No module named 'zmq' At: /tmp/foldersaZOJT/1/communication.py(30): <module> <frozen importlib._bootstrap>(488): _call_with_frames_removed <frozen importlib._bootstrap_external>(995): exec_module <frozen importlib._bootstrap>(950): _load_unlocked <frozen importlib._bootstrap>(1334): _find_and_load_unlocked <frozen importlib._bootstrap>(1360): _find_and_load <frozen importlib._bootstrap>(488): _call_with_frames_removed <frozen importlib._bootstrap>(1423): _handle_fromlist /tmp/foldersaZOJT/1/model.py(33): <module> <frozen importlib._bootstrap>(488): _call_with_frames_removed <frozen importlib._bootstrap_external>(995): exec_module <frozen importlib._bootstrap>(950): _load_unlocked <frozen importlib._bootstrap>(1334): _find_and_load_unlocked <frozen importlib._bootstrap>(1360): _find_and_load E0325 07:53:43.996933 1 model_lifecycle.cc:654] "failed to load 'Power' version 1: Internal: ModuleNotFoundError: No module named 'zmq'\n\nAt:\n /tmp/foldersaZOJT/1/communication.py(30): <module>\n <frozen importlib._bootstrap>(488): _call_with_frames_removed\n <frozen importlib._bootstrap_external>(995): exec_module\n <frozen importlib._bootstrap>(950): _load_unlocked\n <frozen importlib._bootstrap>(1334): _find_and_load_unlocked\n <frozen importlib._bootstrap>(1360): _find_and_load\n <frozen importlib._bootstrap>(488): _call_with_frames_removed\n <frozen importlib._bootstrap>(1423): _handle_fromlist\n /tmp/foldersaZOJT/1/model.py(33): <module>\n <frozen importlib._bootstrap>(488): _call_with_frames_removed\n <frozen importlib._bootstrap_external>(995): exec_module\n <frozen importlib._bootstrap>(950): _load_unlocked\n <frozen importlib._bootstrap>(1334): _find_and_load_unlocked\n <frozen importlib._bootstrap>(1360): _find_and_load\n" I0325 07:53:43.996964 1 model_lifecycle.cc:789] "failed to load 'Power'"
Triton Information nvcr.io/nvidia/tritonserver:25.02-py3
nvcr.io/nvidia/tritonserver:25.02-py3
To Reproduce Start server: docker run --gpus all --rm -p 8000:8000 -p 8001:8001 -p 8002:8002 -v ${PWD}/model_repository:/models nvcr.io/nvidia/tritonserver:25.02-py3 tritonserver --model-repository=/models --model-control-mode=explicit
docker run --gpus all --rm -p 8000:8000 -p 8001:8001 -p 8002:8002 -v ${PWD}/model_repository:/models nvcr.io/nvidia/tritonserver:25.02-py3 tritonserver --model-repository=/models --model-control-mode=explicit
Client code:
class Power: def __init__(self, triton: RemoteTriton): triton.bind( model_name="Power", infer_func=self.__cal__, inputs=[ Tensor(dtype=np.float32, shape=(-1,)), Tensor(dtype=np.float32, shape=(-1,)), ], outputs=[ Tensor(name="power", dtype=np.float32, shape=(-1,)), ], config=ModelConfig(max_batch_size=128), ) @batch def __cal__(self, **inputs): a_batch, b_batch = inputs.values() dot_result = np.power(a_batch, b_batch) return {"power": dot_result}
with RemoteTriton(url="grpc://localhost:8001") as triton: power = Power(triton=triton) logger.info("Starting triton server...") triton.serve()
Expected behavior Model loaded to server
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Description
Failed to bind model. Error (server side):
Triton Information
nvcr.io/nvidia/tritonserver:25.02-py3
To Reproduce
Start server:
docker run --gpus all --rm -p 8000:8000 -p 8001:8001 -p 8002:8002 -v ${PWD}/model_repository:/models nvcr.io/nvidia/tritonserver:25.02-py3 tritonserver --model-repository=/models --model-control-mode=explicit
Client code:
Expected behavior
Model loaded to server
The text was updated successfully, but these errors were encountered: