BentoML
question: How to use replica in BentoML? #4887
Unanswered
Dawnfz-Lenfeng
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am using the BentoVLLM. How do I configure the service file to use the
replicafeature?Do I need to use the Ray engine for this? I'm not very familiar with these configurations.
Beta Was this translation helpful? Give feedback.
All reactions