Discussions: bentoml/BentoML

Discussions

• 1 You must be logged in to vote

  💡

  Have we considered a bentoml init command?

  phitoduck asked Jan 13, 2023 in Ideas · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Set model attributes from runner?

  RobbieFernandez asked Jan 5, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  How do we scale runner independently of the api server without Yatai?

  cadmusthefounder asked Dec 3, 2022 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  🙌

  batch option doesn't optimize latency , it just trade off latency to throughput isn't it?

  KimSoungRyoul asked Dec 5, 2022 in Show and tell · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Getting the transformers model pre-loaded into the Docker Container

  vvkishere asked Nov 27, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What is the role of yatai-bento-metrics-transformer

  KimSoungRyoul asked Nov 22, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Can I use bento docker image to run on standalone server without Yatai ?

  SpeedEX asked Nov 11, 2022 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is running preprocess, inference, postprocess at each runner the right way?

  quant1216 asked Oct 30, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  No better performance for concurring requests

  katerinafrid asked Oct 24, 2022 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Disabling buildkit while performing bentoml containerize

  sagarjoglekar asked Sep 23, 2022 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How can I convert bentoml example v0.13.2 -> v1.0.5

  KimSoungRyoul asked Sep 1, 2022 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  add documentation about BENTOML_HOME

  ALee008 asked Aug 25, 2022 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Problem about using vm to create bentoml service

  DanielLeung222 asked Aug 5, 2022 in Q&A · Answered

  

  

  1
• 4 You must be logged in to vote

  🙏

  What --production flag does

  Lobosque asked Jul 28, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Deploy BentoService to Kubernetes can not work

  zhuyaguang asked Jul 27, 2022 in Q&A · Unanswered

  

  

  5
• 3 You must be logged in to vote

  🙏

  an exception occurred in remote runner [429] in production mode

  litter-rabbit asked Jul 26, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  bentoml.exceptions.BentoMLRpcError: Failed to upload MyBentoService to the remote yatai server: Deadline Exceeded

  BartlomiejSkwira asked Aug 21, 2021 in General · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Cookie and BentoML Performance

  callmedada asked Jun 16, 2022 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Multi threads in multiple processes

  pre-1.0 Issues related to BentoML 0.13 or below

  lionsheep0724 asked Jun 16, 2022 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  serving keras runner with two Input() layer

  cchrkoc asked May 24, 2022 in General · Answered

  

  

  6
• 1 You must be logged in to vote

  🙏

  memory sharing via gunicorn workers?

  ebbunnim asked Jun 16, 2022 in Q&A · Answered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙏

  DataFrame IODescriptor Information - OpenAI swagger

  gaspardc-met asked Jun 13, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Unable to configure the repository base url for v0.13.1

  dummybot88 asked May 19, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  The correct way of enforcing cpu device type under BentoML 1.0?

  AndreasLR asked Jun 1, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Async support with custom runner

  chlee1016 asked May 14, 2022 in Q&A · Unanswered

  

  

  3