This message was deleted.
# ask-for-help
s
This message was deleted.
x
Can you show the logs of this pod?
j
@Xipeng Guan
Here is the full log!
x
j
We tried to install image-builder and yatai-deployement by following the instructions step by step, and when we deployed this time, the deployment says unhealthy. We tried to call the url but it doesn't seem working. Here are the events:
Copy code
2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [GetBento] Bento test1 is found
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [GetDeployment] Getting Deployment yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateDeployment] Creating a new Deployment yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateDeployment] Created Deployment yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [GetHPA] Getting HPA yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Scheduled] Successfully assigned yatai/my-bento-deployment-runner-0-6bd8487b44-g4jf5 to minikube
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateHPA] Creating a new HPA yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateHPA] Created HPA yatai/my-bento-deployment-runner-0
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [GetService] Getting Service yatai/my-bento-deployment-runner-5988673c9d2d180b297ab365af2fc157
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateService] Creating a new Service yatai/my-bento-deployment-runner-5988673c9d2d180b297ab365af2fc157
[2023-05-11 01:09:39] [BentoDeployment] [my-bento-deployment] [CreateService] Created Service yatai/my-bento-deployment-runner-5988673c9d2d180b297ab365af2fc157
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GetDeployment] Getting Deployment yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateDeployment] Creating a new Deployment yatai/my-bento-deployment
[2023-05-11 01:09:40] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Scheduled] Successfully assigned yatai/my-bento-deployment-66fd4d4978-cqn7p to minikube
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateDeployment] Created Deployment yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GetHPA] Getting HPA yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateHPA] Creating a new HPA yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateHPA] Created HPA yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GetService] Getting Service yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateService] Creating a new Service yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateService] Created Service yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GenerateIngressHost] Generating hostname for ingress
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GenerateIngressHost] Generated hostname for ingress: <http://my-bento-deployment-yatai.192.168.49.2.sslip.io|my-bento-deployment-yatai.192.168.49.2.sslip.io>
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GetOrganization] Getting organization for bento iris_classifier:2xt3mwhpswu7kiwg
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [GetIngress] Getting Ingress yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateIngress] Creating a new Ingress yatai/my-bento-deployment
[2023-05-11 01:09:40] [BentoDeployment] [my-bento-deployment] [CreateIngress] Created Ingress yatai/my-bento-deployment
[2023-05-11 01:09:41] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Pulling] Pulling image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg"
[2023-05-11 01:09:41] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulling] Pulling image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg"
[2023-05-11 01:09:55] [HorizontalPodAutoscaler] [my-bento-deployment] [SuccessfulRescale] New size: 2; reason: Current number of replicas below Spec.MinReplicas
[2023-05-11 01:09:55] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Scheduled] Successfully assigned yatai/my-bento-deployment-66fd4d4978-lvwmf to minikube
[2023-05-11 01:09:56] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulling] Pulling image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg"
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Pulled] Successfully pulled image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg" in 33.72199539s (33.722105368s including waiting)
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulled] Successfully pulled image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg" in 111.445856ms (33.811320602s including waiting)
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulling] Pulling image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>"
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulled] Successfully pulled image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg" in 159.756872ms (19.425617382s including waiting)
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulling] Pulling image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>"
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Created] Created container main
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Started] Started container main
[2023-05-11 01:10:15] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Pulling] Pulling image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>"
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulled] Successfully pulled image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>" in 1.512951418s (1.661641681s including waiting)
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Created] Created container metrics-transformer
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Started] Started container metrics-transformer
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulling] Pulling image "<http://quay.io/bentoml/bentoml-proxy:0.0.1|quay.io/bentoml/bentoml-proxy:0.0.1>"
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulled] Successfully pulled image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>" in 467.24977ms (1.967065099s including waiting)
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Created] Created container metrics-transformer
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Started] Started container metrics-transformer
[2023-05-11 01:10:17] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulling] Pulling image "<http://quay.io/bentoml/bentoml-proxy:0.0.1|quay.io/bentoml/bentoml-proxy:0.0.1>"
[2023-05-11 01:10:18] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Pulled] Successfully pulled image "<http://quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3|quay.io/bentoml/yatai-bento-metrics-transformer:0.0.3>" in 485.206259ms (2.303220185s including waiting)
[2023-05-11 01:10:18] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Created] Created container metrics-transformer
[2023-05-11 01:10:18] [Pod] [my-bento-deployment-runner-0-6bd8487b44-g4jf5] [Started] Started container metrics-transformer
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulled] Successfully pulled image "<http://quay.io/bentoml/bentoml-proxy:0.0.1|quay.io/bentoml/bentoml-proxy:0.0.1>" in 3.89954752s (4.523443166s including waiting)
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Created] Created container proxy
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Started] Started container proxy
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulled] Successfully pulled image "<http://quay.io/bentoml/bentoml-proxy:0.0.1|quay.io/bentoml/bentoml-proxy:0.0.1>" in 497.887163ms (4.617142979s including waiting)
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Created] Created container proxy
[2023-05-11 01:10:22] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Started] Started container proxy
[2023-05-11 01:11:12] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Failed] Error: Error response from daemon: Minimum memory limit allowed is 6MB
[2023-05-11 01:11:22] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Failed] Error: Error response from daemon: Minimum memory limit allowed is 6MB
[2023-05-11 01:12:55] [HorizontalPodAutoscaler] [my-bento-deployment] [FailedComputeMetricsReplicas] invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
[2023-05-11 01:14:53] [Pod] [my-bento-deployment-66fd4d4978-cqn7p] [Pulled] Container image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg" already present on machine
[2023-05-11 01:14:55] [HorizontalPodAutoscaler] [my-bento-deployment] [FailedGetResourceMetric] failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
[2023-05-11 01:15:05] [Pod] [my-bento-deployment-66fd4d4978-lvwmf] [Pulled] Container image "127.0.0.1:5000/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg" already present on machine
[2023-05-11 00:31:56] [BentoDeployment] [my-bento-deployment] [Reconciling] Starting to reconcile BentoDeployment
[2023-05-11 00:31:56] [BentoDeployment] [my-bento-deployment] [ReconcileError] Failed to reconcile BentoDeployment: BentoRequest yatai/test1 is not available: check image xxx/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg exists: create docker registry client for <http://xxx>: Get "<http://xxx/v2/>": dial tcp: lookup xxx on 10.96.0.10:53: no such host
When we looked into the log for image-builder and yatai-deployment, we found these two issues repeating: 1. Yatai-deployment repeats this error:
Copy code
1.6837801481073093e+09 ERROR  conversion-webhook     failed to convert      {"request": "a4d9d2db-c46b-45f1-a49c-203178e05128", "error": "get Bento CR test1: <http://bentoes.resources.yatai.ai|bentoes.resources.yatai.ai> \"test1\" not found", "errorVerbose": "<http://bentoes.resources.yatai.ai|bentoes.resources.yatai.ai> \"test1\" not found\nget Bento CR test1\<http://ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha3.getBentoTagFromBentoName|ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha3.getBentoTagFromBentoName>\n\t/workspace/apis/serving/v1alpha3/bentodeployment_conversion.go:284\ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha3.(*BentoDeployment).ConvertFrom\n\t/workspace/apis/serving/v1alpha3/bentodeployment_conversion.go:390\ngithub.com/bentoml/yatai-deployment/apis/serving/v1alpha1.(*BentoDeployment).ConvertFrom\n\t/workspace/apis/serving/v1alpha1/bentodeployment_conversion.go:26\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).convertObject\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:142\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).handleConvertRequest\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:107\nsigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).ServeHTTP\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:74\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerInFlight.func1\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:40\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:117\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func2\n\t/go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:84\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2109\nnet/http.(*ServeMux).ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2487\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2947\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1991\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1594"}
<http://sigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).ServeHTTP|sigs.k8s.io/controller-runtime/pkg/webhook/conversion.(*Webhook).ServeHTTP>
       /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/webhook/conversion/conversion.go:76
<http://github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerInFlight.func1|github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerInFlight.func1>
       /go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:40
net/http.HandlerFunc.ServeHTTP
       /usr/local/go/src/net/http/server.go:2109
<http://github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1|github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1>
       /go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:117
net/http.HandlerFunc.ServeHTTP
       /usr/local/go/src/net/http/server.go:2109
<http://github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func2|github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func2>
       /go/pkg/mod/github.com/prometheus/client_golang@v1.12.2/prometheus/promhttp/instrument_server.go:84
net/http.HandlerFunc.ServeHTTP
       /usr/local/go/src/net/http/server.go:2109
net/http.(*ServeMux).ServeHTTP
       /usr/local/go/src/net/http/server.go:2487
net/http.serverHandler.ServeHTTP
       /usr/local/go/src/net/http/server.go:2947
net/http.(*conn).serve
       /usr/local/go/src/net/http/server.go:1991
yatai-deployment-default-domain remains the same. 2. Image-builder seems to have problems reconciling.
Copy code
1.6837801723988564e+09 ERROR  Reconciler error       {"controller": "bentorequest", "controllerGroup": "<http://resources.yatai.ai|resources.yatai.ai>", "controllerKind": "BentoRequest", "BentoRequest": {"name":"test1","namespace":"yatai"}, "namespace": "yatai", "name": "test1", "reconcileID": "89f6041b-c92f-43ec-b6da-f190ad58b81e", "error": "check image xxx/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg exists: create docker registry client for <http://xxx>: Get \"<http://xxx/v2/>\": dial tcp: lookup xxx on 10.96.0.10:53: no such host", "errorVerbose": "Get \"<http://xxx/v2/>\": dial tcp: lookup xxx on 10.96.0.10:53: no such host\ncreate docker registry client for <http://xxx>\<http://ngithub.com/bentoml/yatai-image-builder/controllers/resources.checkImageExists|ngithub.com/bentoml/yatai-image-builder/controllers/resources.checkImageExists>\n\t/workspace/controllers/resources/bentorequest_controller.go:919\ngithub.com/bentoml/yatai-image-builder/controllers/resources.(*BentoRequestReconciler).Reconcile\n\t/workspace/controllers/resources/bentorequest_controller.go:187\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:234\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1594\ncheck image xxx/yatai-bentos:yatai.iris_classifier.2xt3mwhpswu7kiwg exists\<http://ngithub.com/bentoml/yatai-image-builder/controllers/resources.(*BentoRequestReconciler).Reconcile|ngithub.com/bentoml/yatai-image-builder/controllers/resources.(*BentoRequestReconciler).Reconcile>\n\t/workspace/controllers/resources/bentorequest_controller.go:189\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:121\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:320\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:273\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:234\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1594"}
<http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler|sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler>
       /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:326
<http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem|sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem>
       /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:273
<http://sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2|sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2>
       /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.13.0/pkg/internal/controller/controller.go:234
1.6837804056261685e+09 INFO   getting yatai client   {"func": "doRegisterYataiComponent"}
x
It seems that your cluster is unable to resolve the domain name of your image registry.
You can use the following command to test your DNS:
Copy code
kubectl run test --rm -it --restart='Never' --image <http://quay.io/bentoml/bento-debugger:0.0.8|quay.io/bentoml/bento-debugger:0.0.8> --command -- sh
Copy code
dig $yourImageRegistryDomain
🍱 1
🫡 1
j
I got the following response. I am using docker for image registry.
Copy code
~$ kubectl run test --rm -it --restart='Never' --image <http://quay.io/bentoml/bento-debugger:0.0.8|quay.io/bentoml/bento-debugger:0.0.8> --command -- sh
If you don't see a command prompt, try pressing enter.

# dig $yourImageRegistryDomain

; <<>> DiG 9.16.33-Debian <<>>
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 64998
;; flags: qr rd ra; QUERY: 1, ANSWER: 13, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
; COOKIE: 9adc769700e4a299 (echoed)
;; QUESTION SECTION:
;.                              IN      NS

;; ANSWER SECTION:
.                       30      IN      NS      <http://i.root-servers.net|i.root-servers.net>.
.                       30      IN      NS      <http://j.root-servers.net|j.root-servers.net>.
.                       30      IN      NS      <http://e.root-servers.net|e.root-servers.net>.
.                       30      IN      NS      <http://b.root-servers.net|b.root-servers.net>.
.                       30      IN      NS      <http://g.root-servers.net|g.root-servers.net>.
.                       30      IN      NS      <http://f.root-servers.net|f.root-servers.net>.
.                       30      IN      NS      <http://d.root-servers.net|d.root-servers.net>.
.                       30      IN      NS      <http://c.root-servers.net|c.root-servers.net>.
.                       30      IN      NS      <http://h.root-servers.net|h.root-servers.net>.
.                       30      IN      NS      <http://a.root-servers.net|a.root-servers.net>.
.                       30      IN      NS      <http://m.root-servers.net|m.root-servers.net>.
.                       30      IN      NS      <http://l.root-servers.net|l.root-servers.net>.
.                       30      IN      NS      <http://k.root-servers.net|k.root-servers.net>.

;; Query time: 4 msec
;; SERVER: 10.96.0.10#53(10.96.0.10)
;; WHEN: Thu May 11 17:19:00 UTC 2023
;; MSG SIZE  rcvd: 443

# dig <http://docker.io|docker.io>

; <<>> DiG 9.16.33-Debian <<>> <http://docker.io|docker.io>
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 56217
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
; COOKIE: 986e25549992a926 (echoed)
;; QUESTION SECTION:
;docker.io.                     IN      A

;; ANSWER SECTION:
<http://docker.io|docker.io>.              30      IN      A       52.3.144.121
<http://docker.io|docker.io>.              30      IN      A       54.165.156.197
<http://docker.io|docker.io>.              30      IN      A       44.196.175.70

;; Query time: 16 msec
;; SERVER: 10.96.0.10#53(10.96.0.10)
;; WHEN: Thu May 11 17:22:28 UTC 2023
;; MSG SIZE  rcvd: 125
@Xipeng Guan sorry for taking your time, but we still need your help here🫡