Ashwin Sreenivas
07/20/2021, 1:24 AMDhirendra Prajapati
07/20/2021, 1:00 PMRobert Xin
07/20/2021, 4:55 PMKyle Cheung
07/20/2021, 10:12 PMJaafar
07/21/2021, 11:55 AMIsaline L.
07/21/2021, 2:49 PMRobert Xin
07/21/2021, 5:40 PMBart Lammers
07/21/2021, 7:36 PMBob Briski
07/22/2021, 1:46 AMDaniel
07/22/2021, 2:32 PMtakan
07/23/2021, 6:50 AMkubectl apply -k kube/overlays/stable
serviceaccount/airbyte-admin created
<http://role.rbac.authorization.k8s.io/airbyte-admin-role|role.rbac.authorization.k8s.io/airbyte-admin-role> created
<http://rolebinding.rbac.authorization.k8s.io/airbyte-admin-binding|rolebinding.rbac.authorization.k8s.io/airbyte-admin-binding> created
configmap/airbyte-env-m2467g889g created
configmap/airbyte-temporal-dynamicconfig created
configmap/sweep-pod-script created
secret/gcs-log-creds created
service/airbyte-db-svc created
service/airbyte-minio-svc created
service/airbyte-server-svc created
service/airbyte-temporal-svc created
service/airbyte-webapp-svc created
deployment.apps/airbyte-db created
deployment.apps/airbyte-pod-sweeper created
deployment.apps/airbyte-scheduler created
deployment.apps/airbyte-temporal created
deployment.apps/airbyte-webapp created
persistentvolumeclaim/airbyte-minio-pv-claim created
persistentvolumeclaim/airbyte-volume-configs created
persistentvolumeclaim/airbyte-volume-db created
persistentvolumeclaim/airbyte-volume-workspace created
Error from server ([denied by autogke-no-host-port] container airbyte-minio specifies a host port; disallowed in Autopilot. error when creating "kube/overlays/stable": admission webhook "validation.gatekeeper.sh" denied the request: [denied by autogke-no-host-port] container airbyte-minio specifies a host port; disallowed in Autopilot.
Error from server ([denied by autogke-pod-affinity-limitation] pod affinity is not allowed in Autopilot on topologyKeys: <{"kubernetes.io/hostname"}>; Autopilot allows pod affinity only on topologyKeys: <["topology.kubernetes.io/region", "topology.kubernetes.io/zone", "failure-domain.beta.kubernetes.io/region", "failure-domain.beta.kubernetes.io/zone"]>. error when creating "kube/overlays/stable": admission webhook "validation.gatekeeper.sh" denied the request: [denied by autogke-pod-affinity-limitation] pod affinity is not allowed in Autopilot on topologyKeys: <{"kubernetes.io/hostname"}>; Autopilot allows pod affinity only on topologyKeys: <["topology.kubernetes.io/region", "topology.kubernetes.io/zone", "failure-domain.beta.kubernetes.io/region", "failure-domain.beta.kubernetes.io/zone"]>.
Are there any workarounds on this issue?David Schenk
07/23/2021, 9:39 AMQuentin Moret
07/23/2021, 5:19 PM2021-07-23 17:08:06 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-07-23 17:08:06 INFO () DefaultNormalizationWorker(run):77 - Normalization executed in 0.
2021-07-23 17:08:06 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...
2021-07-23 17:08:06 ERROR () Exceptions(swallow):84 - Swallowed error.
java.lang.NullPointerException: null value in entry: sync_cpu_request=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[guava-30.1.1-jre.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[guava-30.1.1-jre.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[guava-30.1.1-jre.jar:?]
at io.airbyte.scheduler.persistence.job_tracker.TrackingMetadata.generateSyncMetadata(TrackingMetadata.java:62) ~[io.airbyte.airbyte-scheduler-persistence-0.27.5-alpha.jar:?]
at io.airbyte.scheduler.persistence.job_tracker.JobTracker.generateSyncMetadata(JobTracker.java:211) ~[io.airbyte.airbyte-scheduler-persistence-0.27.5-alpha.jar:?]
at io.airbyte.scheduler.persistence.job_tracker.JobTracker.lambda$trackSync$3(JobTracker.java:134) ~[io.airbyte.airbyte-scheduler-persistence-0.27.5-alpha.jar:?]
Thanks !Moises Vega Guhlin DataKubes
07/23/2021, 8:56 PMRahul Vishnoi
07/27/2021, 6:29 AMDaniel
07/28/2021, 6:35 PMLuke Bussey
07/28/2021, 7:15 PMdate-time
but they appear in the destination as varchar
. Do i need to add my own dbt transformation to fix?Daniel
07/28/2021, 9:06 PMfeat/user-access
This is the command I'm using for DBT inside Airbyte: run --project-dir dbt
(if anyone needs it, this is the link directly to the branch: https://github.com/delucca-workspaces/analytics/tree/feat/user-access)
I've attached the logs. In a nutshell, it fails after a few minutes.
I've tried running dbt run --project-dir dbt
locally (inside the root of my repository) and it works. Only in Airbyte it failsgunu
07/29/2021, 12:34 PMmytable
, mytable_scd
, _airbyte_raw_mytable
. and resync the connector, will it perform a full-refresh?Qira Ahmad
07/29/2021, 5:25 PMKyle Cheung
07/30/2021, 4:15 AMCREATE OR REPLACE
because every time the data syncs I have to re-grant the SELECT ON TABLE
. Is there a way to change this or update the create to add COPY GRANTS
Riya Tyagi
07/30/2021, 5:17 AMBart Lammers
07/30/2021, 7:43 AMAshish Gupta
08/01/2021, 8:14 AMAshish Gupta
08/01/2021, 8:15 AMRiya Tyagi
08/03/2021, 7:17 AMKyle Cheung
08/03/2021, 2:44 PMJay Patel
08/04/2021, 5:45 AMgunu
08/04/2021, 11:43 PMAfam Uzoka
08/05/2021, 1:21 PM