https://bentoml.com logo
Join Slack
Powered by
# tech-writing
  • a

    Ashley Zhao

    09/22/2022, 10:16 PM
    I think it may have something to do with a VPN client on my mac. I’ll need to test this out in another OS other than my current
  • s

    Sean

    09/25/2022, 7:41 AM
    Hi Ashley, are you still blocked on any of these? We can find some time on Sunday evening to debug together.
  • a

    Ashley Zhao

    09/25/2022, 11:42 PM
    Hi @Sean, Sure, do you have time now?
  • s

    Sean

    09/25/2022, 11:51 PM
    Yes. https://us02web.zoom.us/j/2069799684?pwd=Z2hJbEcxQmRYbEJNY1ZaL2dNQzJlZz09
  • s

    Sean

    09/26/2022, 12:03 AM
    I’m going to step out for a bit, actually.
  • a

    Ashley Zhao

    09/26/2022, 12:03 AM
    Thanks, ok I will hop on whenever
  • s

    Sean

    09/26/2022, 12:05 AM
    Maybe coordinate and chat with @Xipeng Guan? Xipeng, what time is best for you?
  • a

    Ashley Zhao

    09/26/2022, 12:11 AM
    Oh ok, I already scheduled a meeting with Xipeng tomorrow evening
  • s

    Slackbot

    09/26/2022, 2:08 AM
    This message was deleted.
    a
    x
    s
    • 4
    • 15
  • a

    Ashley Zhao

    09/29/2022, 3:02 AM
    Hi again, sorry ran into another issue it was while installing Yatai-deployment I was following instructions up till it hit helm chart configuration for yatai
    Copy code
    kubectl -n yatai-deployment get pod -l app=docker-private-registry-proxy
    NAME                                  READY   STATUS    RESTARTS   AGE
    docker-private-registry-proxy-d9z2x   1/1     Running   0          6s
    (base) ashleyzhao@Ashleys-MacBook-Pro ~ % kubectl -n yatai-deployment patch cm/network --type merge --patch '{"data":{"ingress-class":"$INGRESS_CLASS"}}'
    Error from server (NotFound): configmaps "network" not found
    Error also occurs in the public docker registry
  • a

    Ashley Zhao

    09/29/2022, 3:02 AM
    Here is what I get for INGRESS_CLASS:
    echo $INGRESS_CLASS
    nginx
  • s

    Slackbot

    09/29/2022, 3:58 AM
    This message was deleted.
    a
    s
    • 3
    • 4
  • s

    Slackbot

    09/29/2022, 4:20 AM
    This message was deleted.
    ✅ 1
    x
    a
    s
    • 4
    • 5
  • a

    Ashley Zhao

    09/29/2022, 4:56 AM
    Rough overview of docs: • Get started ◦ Yatai components ▪︎ Yatai (Kubernetes, PostgreSQL protocol database, S3) ▪︎ Yatai deployment (cert-manager, metrics-server, docker registry, ingress class/annotations) ◦ Terminology/Additional resources (links) ◦ Minimum requirements ◦ Supported frameworks? (Everything is bento) ◦ Installation ▪︎ Yatai ▪︎ Yatai Deployment • Update • Tutorial • Yatai ◦ Manage models ◦ Deploy • Monitor ◦ Collecting metrics and logs • Uninstall? • Troubleshoot ◦ Limitations ▪︎ Does not support Docker on MacOS ◦ _Common installation questions (?)_First time set up AWS - give permissions ▪︎ Kubernetes problems - check VPN • Terminology/Additional information ◦ BentoML models ◦ Model registry ◦ Bento ◦ Bento registry ◦ Bento Deployment CRD I’ll share the Notion docs once I refine them. It’s in some very rough patches so I’m not sure if they’ll be ready to be reviewed. However you’re always welcome to take a look.
  • a

    Ashley Zhao

    09/29/2022, 4:58 AM
    The only topic that I’m not sure if we need is an Uninstall section.
  • a

    Ashley Zhao

    09/29/2022, 4:58 AM
    If there are other topics that need to be added/removed, feel free to let me know!
  • s

    Sean

    09/29/2022, 10:36 PM
    New format agree with Ashley.
    Copy code
    ## TOC
    
    - Concepts
        - Architecture
            - Diagram ([<https://excalidraw.com/](https://excalidraw.com/)>)
        - Yatai (Kubernetes, PostgreSQL protocol database, S3)
        - Yatai deployment (cert-manager, metrics-server, docker registry, ingress class/annotations)
        - Observability (Prometheus, Grafana, Loki)
        - Terminology/Additional resources (links?)
            - BentoML models
            - Model registry
            - Bento
            - Bento registry
            - Bento Deployment CRD
    - Installation
        - Yatai Installation/System requirements
        - [Yatai Deployment](<https://docs.bentoml.org/projects/yatai/en/latest/installation/yatai_deployment.html)/System> requirements
        - (Install) Observability (for Prometheus/Grafana/Loki)
        - [Update](<https://docs.bentoml.org/projects/yatai/en/latest/installation/yatai.html>) / Migration from Yatai 0.4
        - Troubleshoot
            - Limitations
                - Does not support Docker on MacOS
            - *Common installation questions (?)*
                - First time set up AWS - give permissions
                - Kubernetes problems - check VPN
        - Uninstall
    - Tutorial (Video)
        - Yatai
            - Model and bento repository (push/pull and UI)
            - Administrator (manage users)
        - Yatai Deployment
            - Create, delete, update deployments from UI
            - Create, delete, update deployments from BentoDeployment CRD
                - Kubernetes
                    - BentoDeployment CRD (Examples)
                        - Note: comes with `yatai-deployment`
                        
                        ```jsx
                        > kubectl apply deployment.yaml
                        > k get svc
    - Observability - Metrics, Logs, (Traces) [Collecting metrics and logs](https://docs.bentoml.org/projects/yatai/en/latest/observability/metrics.html)```
  • a

    Ashley Zhao

    09/29/2022, 10:44 PM
    Hi @Tim Liu, How are you? Just wondering if we have a video that covers the end-to-end user experience, specifically these points:
    Copy code
    - Yatai (Dashboard overview)
        - Model and bento repository (push/pull and UI)
        - Administrator (manage users)
    I can probably help since I’ve gone through a quick user experience. Can you connect with me/Sean to see if we can do a video together?
  • t

    Tim Liu

    09/29/2022, 10:45 PM
    Nope, no video of that. Yea we should do that. I'm kinda slammed this week. Maybe next week take a look at it? A series of yatai videos was one of my next to dos if you can help with that
  • a

    Ashley Zhao

    09/29/2022, 10:47 PM
    Of course! Would be glad to help.
  • a

    Ashley Zhao

    09/30/2022, 5:30 PM
    Hello, @Xipeng Guan and @Jiang, I have a quick question about uninstall, which method is preferred for uninstalling Yatai, via deleting all its components:
    Copy code
    helm uninstall yatai -n yatai-system
    helm uninstall yatai -n yatai-components
    helm uninstall yatai-csi-driver-image-populator -n yatai-components
    helm list -n yatai-operators | tail -n +2 | awk '{print $1}' | xargs -I{} helm -n yatai-operators uninstall {}
    or additionally deleting the namespace, like the Bash script does? Thank you! I hope I’m not taking up too much of your time with these questions.
  • x

    Xipeng Guan

    09/30/2022, 6:03 PM
    The command you gave is an uninstall command for an older version of yatai, with the current version you can only delete yatai by following the delete-yatai.sh script https://github.com/bentoml/Yatai/blob/main/scripts/delete-yatai.sh
    gratitude thank you 1
  • s

    Slackbot

    10/04/2022, 2:52 AM
    This message was deleted.
    s
    j
    • 3
    • 4
  • s

    Slackbot

    10/10/2022, 1:24 AM
    This message was deleted.
    s
    x
    a
    • 4
    • 6
  • a

    Ashley Zhao

    10/13/2022, 9:36 PM
    Hello @Xipeng Guan @Jiang, I have a question about the issuer for the webhook, it looks like the example given presumes the user uses a self-signed certificate. Would you have an example of when the user has an issued certificate? (Here is the Issuer example in question)
    Copy code
    cat <<EOF > test-resources.yaml
    apiVersion: v1
    kind: Namespace
    metadata:
      name: cert-manager-test
    ---
    apiVersion: <http://cert-manager.io/v1|cert-manager.io/v1>
    kind: Issuer
    metadata:
      name: test-selfsigned
      namespace: cert-manager-test
    spec:
      selfSigned: {}
    ---
    apiVersion: <http://cert-manager.io/v1|cert-manager.io/v1>
    kind: Certificate
    metadata:
      name: selfsigned-cert
      namespace: cert-manager-test
    spec:
      dnsNames:
        - <http://example.com|example.com>
      secretName: selfsigned-cert-tls
      issuerRef:
        name: test-selfsigned
    EOF
  • s

    Slackbot

    07/02/2023, 8:10 AM
    This message was deleted.
    t
    • 2
    • 1
  • v

    Victor king Oshimua

    07/09/2023, 7:43 AM
    Do you know machine learning can be used to detect financial fraud? In this article, I discussed how to leverage the power of machine learning to detect and prevent financial fraud. https://dev.to/cyber_holics/credit-card-fraud-detection-a-machine-learning-approach-to-combat-financial-fraud-dee
    👍 1
  • s

    Sean

    07/14/2023, 11:24 AM
    Hi @Victor king Oshimua, please feel free to publish to #ml-learning-potluck.
  • v

    Victor king Oshimua

    07/27/2023, 8:53 AM
    I deployed an sklearn model with BentoMl, I really love this tool and I hope to explore more Here is an article about the project : https://dev.to/cyber_holics/deploy-a-machine-learning-spam-sms-filter-app-in-minutes-using-bentoml-k14
    👍 1
  • c

    Chaoyu

    01/12/2024, 1:07 AM
    archived the channel