This message was deleted.
# ask-for-help
s
This message was deleted.
🍱 1
🐞 1
j
Hi Renz
This is a bug of current bentoml release. Unlike online features,
run_in_spark
is in early state.
The function here should be
wait_until_server_ready
. We shall fix that in the future release. You can workaround it by clone the bentoml repo and patch those source files.
r
Thanks for replying @Jiang , is the fix already in the latest master branch of the repository? maybe I could just pip install directly from github
Clarifying also, so I can just rename the
wait_until_server_is_ready
->
wait_until_server_ready
right?
j
Not yet
yes
r
gotcha, will try and update you! thank you!
j
Thanks. Any updates are welcome!
r
Hi @Jiang couldn't seem to install the forked repo with fix properly, am I doing it right?
Copy code
pip install "git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf>"
then when I try
import bentoml
it says no module named
bentoml
j
Copy code
(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) βœ— bentoml
zsh: command not found: bentoml
(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) βœ— pip install git+<https://github.com/bentoml/bentoml.git@main> -q
(torch@py3.10)  bojiang ➜  BentoML2 git:(bp) βœ— bentoml
Usage: bentoml [OPTIONS] COMMAND [ARGS]...

  β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ•—β–‘β–‘β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–ˆβ–ˆβ–ˆβ•—β–‘β–‘β–‘β–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•—β–‘β–‘β–‘β–‘β–‘
  β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β•β•β•β–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–ˆβ–ˆβ•‘β•šβ•β•β–ˆβ–ˆβ•”β•β•β•β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–‘β–‘
  β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•¦β•β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–‘β–‘β–ˆβ–ˆβ•”β–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–ˆβ–ˆβ•‘β–‘β–‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β–ˆβ–ˆβ–ˆβ–ˆβ•”β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–‘β–‘
  β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β•β–‘β–‘β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ–ˆβ–ˆβ•‘β–‘β–‘β–‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–ˆβ–ˆβ•‘β–‘β–‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β–‘β–‘
  β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•¦β•β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘β–‘β•šβ–ˆβ–ˆβ–ˆβ•‘β–‘β–‘β–‘β–ˆβ–ˆβ•‘β–‘β–‘β–‘β•šβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘β–‘β•šβ•β•β–‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
  β•šβ•β•β•β•β•β•β–‘β•šβ•β•β•β•β•β•β•β•šβ•β•β–‘β–‘β•šβ•β•β•β–‘β–‘β–‘β•šβ•β•β–‘β–‘β–‘β–‘β•šβ•β•β•β•β•β–‘β•šβ•β•β–‘β–‘β–‘β–‘β–‘β•šβ•β•β•šβ•β•β•β•β•β•β•

Options:
  -v, --version  Show the version and exit.
  -h, --help     Show this message and exit.

Commands:
  build               Build a new Bento from current directory.
  containerize        Containerizes given Bento into an OCI-compliant...
  delete              Delete Bento in local bento store.
  env                 Print environment info and exit
  export              Export a Bento to an external file archive
  get                 Print Bento details by providing the bento_tag.
  import              Import a previously exported Bento archive file
  list                List Bentos in local store
  models              Model Subcommands Groups
  pull                Pull Bento from a yatai server.
  push                Push Bento to a yatai server.
  serve (serve-http)  Start a HTTP BentoServer from a given 🍱
  serve-grpc          [EXPERIMENTAL] Start a gRPC BentoServer from a...
  yatai               Yatai Subcommands Groups
It works in my enviroment
r
can't seem to work on a databricks notebook env 😞
j
The path of notebook is randomly set. You can not trust that
you may use this instead
Copy code
import sys
Copy code
!{sys.executable} -m pip install xxx
Copy code
!{sys.executable} -m bentoml
r
still the same 😞
I think it has something to do with the metadata
j
UNKNOWN
Copy code
Building wheels for collected packages: bentoml
  Building wheel for bentoml (pyproject.toml) ... done
  Created wheel for bentoml: filename=bentoml-1.0.20.post15+gf5623769-py3-none-any.whl size=981856 sha256=ec84a6f5f359314d9a6e403c79013323542ac793210f522b2162030305664e5e
  Stored in directory: /tmp/pip-ephem-wheel-cache-4_d4k3qu/wheels/d7/77/9b/68e72c940db3900d9ae6b577a0b580e0a58e092df42f9e89b4
Successfully built bentoml
Installing collected packages: bentoml
Successfully installed bentoml-1.0.20.post15+gf5623769
It should be like this if your repo and branch is correctly set
r
tried this:
!pip install -e "git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>"
still unknown, not really sure why it can't set the correct metadata
Copy code
Obtaining bentoml from git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>
  Updating /local_disk0/.ephemeral_nfs/envs/pythonEnv-63e1d219-9b7d-4cde-a4af-da90de16843b/src/bentoml clone (to revision hotfix/spark_batch_inf)
  Running command git fetch -q --tags
  Running command git reset --hard -q e5e2dfbaca9a98ec5abcf50f776eb234210eb673
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
  WARNING: Generating metadata for package bentoml produced metadata for project name unknown. Fix your #egg=bentoml fragments.
Discarding git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml>: Requested unknown from git+<https://github.com/renzabergos/bentoml@hotfix/spark_batch_inf#egg=bentoml> has inconsistent name: expected 'bentoml', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement bentoml (unavailable) (from versions: 0.0.1, 0.0.2, 0.0.3, 0.0.5, 0.0.6a0, 0.0.7.dev0, 0.0.7, 0.0.8, 0.0.8.post1, 0.0.9, 0.1.1, 0.1.2, 0.2.0, 0.2.1, 0.2.2, 0.3.0, 0.3.1, 0.3.3, 0.3.4, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.4.7, 0.4.8, 0.4.9, 0.5.0, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.5.5, 0.5.6, 0.5.7, 0.5.8, 0.6.0, 0.6.1, 0.6.2, 0.6.3, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.6, 0.7.7, 0.7.8, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.9.0rc0, 0.9.0, 0.9.1, 0.9.2, 0.10.0, 0.10.1, 0.11.dev0, 0.11.0, 0.12.0, 0.12.1, 0.13.0, 0.13.1, 0.13.2, 1.0.0.dev0, 1.0.0.dev1, 1.0.0a1, 1.0.0a2, 1.0.0a3, 1.0.0a4, 1.0.0a5, 1.0.0a6, 1.0.0a7, 1.0.0rc0, 1.0.0rc1, 1.0.0rc2, 1.0.0rc3, 1.0.0, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.0.9, 1.0.10, 1.0.11, 1.0.12, 1.0.13, 1.0.14, 1.0.15, 1.0.16, 1.0.17, 1.0.18, 1.0.19, 1.0.20)
ERROR: No matching distribution found for bentoml (unavailable)
tried it on my local tho, it does actually work, but not in Databricks 😞 might probably wait for the next release, thank you tho!
j
That's strange. The last suggestion: you can try run
pip install -U pip
in notebook