This message was deleted BentoML #ask-for-help

Join Slack

This message was deleted.

# ask-for-help

Slackbot

05/17/2023, 2:26 AM

This message was deleted.

🍱 1

🐞 1

Jiang

05/17/2023, 9:21 AM

Hi Renz

Jiang

05/17/2023, 9:23 AM

This is a bug of current bentoml release. Unlike online features,

run_in_spark

is in early state.

Jiang

05/17/2023, 9:24 AM

The function here should be

wait_until_server_ready

. We shall fix that in the future release. You can workaround it by clone the bentoml repo and patch those source files.

Renz Abergos

05/17/2023, 9:50 AM

Thanks for replying @Jiang , is the fix already in the latest master branch of the repository? maybe I could just pip install directly from github

Renz Abergos

05/17/2023, 9:51 AM

Clarifying also, so I can just rename the

wait_until_server_is_ready

wait_until_server_ready

right?

Jiang

05/17/2023, 9:51 AM

Not yet

Jiang

05/17/2023, 9:51 AM

yes

Renz Abergos

05/17/2023, 9:52 AM

gotcha, will try and update you! thank you!

Jiang

05/17/2023, 9:52 AM

Thanks. Any updates are welcome!

Renz Abergos

05/17/2023, 10:21 AM

Hi @Jiang couldn't seem to install the forked repo with fix properly, am I doing it right?

Copy code

pip install "git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf>"

then when I try

import bentoml

it says no module named

bentoml

Jiang

05/17/2023, 10:38 AM

Copy code

(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) ✗ bentoml
zsh: command not found: bentoml
(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) ✗ pip install git+<https://github.com/bentoml/bentoml.git@main> -q
(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) ✗ bentoml
Usage: bentoml [OPTIONS] COMMAND [ARGS]...

  ██████╗░███████╗███╗░░██╗████████╗░█████╗░███╗░░░███╗██╗░░░░░
  ██╔══██╗██╔════╝████╗░██║╚══██╔══╝██╔══██╗████╗░████║██║░░░░░
  ██████╦╝█████╗░░██╔██╗██║░░░██║░░░██║░░██║██╔████╔██║██║░░░░░
  ██╔══██╗██╔══╝░░██║╚████║░░░██║░░░██║░░██║██║╚██╔╝██║██║░░░░░
  ██████╦╝███████╗██║░╚███║░░░██║░░░╚█████╔╝██║░╚═╝░██║███████╗
  ╚═════╝░╚══════╝╚═╝░░╚══╝░░░╚═╝░░░░╚════╝░╚═╝░░░░░╚═╝╚══════╝

Options:
  -v, --version  Show the version and exit.
  -h, --help     Show this message and exit.

Commands:
  build               Build a new Bento from current directory.
  containerize        Containerizes given Bento into an OCI-compliant...
  delete              Delete Bento in local bento store.
  env                 Print environment info and exit
  export              Export a Bento to an external file archive
  get                 Print Bento details by providing the bento_tag.
  import              Import a previously exported Bento archive file
  list                List Bentos in local store
  models              Model Subcommands Groups
  pull                Pull Bento from a yatai server.
  push                Push Bento to a yatai server.
  serve (serve-http)  Start a HTTP BentoServer from a given 🍱
  serve-grpc          [EXPERIMENTAL] Start a gRPC BentoServer from a...
  yatai               Yatai Subcommands Groups

Jiang

05/17/2023, 10:38 AM

It works in my enviroment

Renz Abergos

05/17/2023, 10:48 AM

can't seem to work on a databricks notebook env 😞

Jiang

05/17/2023, 10:49 AM

The path of notebook is randomly set. You can not trust that

Jiang

05/17/2023, 10:49 AM

you may use this instead

Jiang

05/17/2023, 10:49 AM

Copy code

import sys

Jiang

05/17/2023, 10:49 AM

Copy code

!{sys.executable} -m pip install xxx

Jiang

05/17/2023, 10:49 AM

Copy code

!{sys.executable} -m bentoml

Renz Abergos

05/17/2023, 10:52 AM

still the same 😞

Renz Abergos

05/17/2023, 10:52 AM

I think it has something to do with the metadata

Jiang

05/17/2023, 10:52 AM

UNKNOWN

Jiang

05/17/2023, 10:53 AM

Copy code

Building wheels for collected packages: bentoml
  Building wheel for bentoml (pyproject.toml) ... done
  Created wheel for bentoml: filename=bentoml-1.0.20.post15+gf5623769-py3-none-any.whl size=981856 sha256=ec84a6f5f359314d9a6e403c79013323542ac793210f522b2162030305664e5e
  Stored in directory: /tmp/pip-ephem-wheel-cache-4_d4k3qu/wheels/d7/77/9b/68e72c940db3900d9ae6b577a0b580e0a58e092df42f9e89b4
Successfully built bentoml
Installing collected packages: bentoml
Successfully installed bentoml-1.0.20.post15+gf5623769

Jiang

05/17/2023, 10:54 AM

It should be like this if your repo and branch is correctly set

Renz Abergos

05/17/2023, 11:17 AM

tried this:

!pip install -e "git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>"

still unknown, not really sure why it can't set the correct metadata

Copy code

Obtaining bentoml from git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>
  Updating /local_disk0/.ephemeral_nfs/envs/pythonEnv-63e1d219-9b7d-4cde-a4af-da90de16843b/src/bentoml clone (to revision hotfix/spark_batch_inf)
  Running command git fetch -q --tags
  Running command git reset --hard -q e5e2dfbaca9a98ec5abcf50f776eb234210eb673
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
  WARNING: Generating metadata for package bentoml produced metadata for project name unknown. Fix your #egg=bentoml fragments.
Discarding git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>: Requested unknown from git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml> has inconsistent name: expected 'bentoml', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement bentoml (unavailable) (from versions: 0.0.1, 0.0.2, 0.0.3, 0.0.5, 0.0.6a0, 0.0.7.dev0, 0.0.7, 0.0.8, 0.0.8.post1, 0.0.9, 0.1.1, 0.1.2, 0.2.0, 0.2.1, 0.2.2, 0.3.0, 0.3.1, 0.3.3, 0.3.4, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.4.7, 0.4.8, 0.4.9, 0.5.0, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.5.5, 0.5.6, 0.5.7, 0.5.8, 0.6.0, 0.6.1, 0.6.2, 0.6.3, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.6, 0.7.7, 0.7.8, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.9.0rc0, 0.9.0, 0.9.1, 0.9.2, 0.10.0, 0.10.1, 0.11.dev0, 0.11.0, 0.12.0, 0.12.1, 0.13.0, 0.13.1, 0.13.2, 1.0.0.dev0, 1.0.0.dev1, 1.0.0a1, 1.0.0a2, 1.0.0a3, 1.0.0a4, 1.0.0a5, 1.0.0a6, 1.0.0a7, 1.0.0rc0, 1.0.0rc1, 1.0.0rc2, 1.0.0rc3, 1.0.0, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.0.9, 1.0.10, 1.0.11, 1.0.12, 1.0.13, 1.0.14, 1.0.15, 1.0.16, 1.0.17, 1.0.18, 1.0.19, 1.0.20)
ERROR: No matching distribution found for bentoml (unavailable)

Renz Abergos

05/17/2023, 11:23 AM

tried it on my local tho, it does actually work, but not in Databricks 😞 might probably wait for the next release, thank you tho!

Jiang

05/18/2023, 8:05 AM

That's strange. The last suggestion: you can try run

pip install -U pip

in notebook

Open in Slack

Previous Next