This message was deleted BentoML #ask-for-help

This message was deleted.

Slackbot

02/02/2023, 4:00 PM

This message was deleted.

👍 1

Yilun Zhang

02/02/2023, 4:50 PM

Ok I found out the issue, seems like the actuall pipeline name should be

token-classification

rather than

ner

ner

is not a supported pipeline by default in transformers, so when loading, bentoml.transformers will look for this pipeline pickle file. Changing to

token-classification

worked perfectly!

Yilun Zhang

02/02/2023, 4:59 PM

Maybe the error message can you more explicit to this scenario so that I don’t get confused by why this

pipeline.v1.pkl

file is not found but actually show the real reason behind it (

pipeline not supported

Yilun Zhang

02/02/2023, 6:13 PM

On a second check, it’s still weird that specifying task as

ner

is not working since it’s one of the value in

TASK_ALIASES

in https://github.com/huggingface/transformers/blob/v4.21.2/src/transformers/pipelines/__init__.py#L129. So theoretically it should work. I will double check if I can consistently reproduce this error.

Yilun Zhang

02/02/2023, 6:43 PM

sauyon

02/02/2023, 8:27 PM

Thanks! We'll look into this, @Aaron Pham did you work on transformers?

Aaron Pham

02/03/2023, 1:00 AM

yep, let me finish that PR.

Aaron Pham

02/09/2023, 5:41 AM

Hi @Yilun Zhang sorry for the ping. I put https://github.com/bentoml/BentoML/pull/3543 in hope to address this issue.

Yilun Zhang

02/09/2023, 1:55 PM

Hey Aaron, thank you for the PR, it looks good to me and I think the changes to ALIASES part should fix the issue. gratitude thank you

4 Views