https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
i

Ignacio Alasia

03/23/2022, 6:07 PM
Hello there I'm testing the local airbyte version to then move on to the kubernetes version. Currently I have it mounted in a docker, also a postgres image as source and snowflake as destination. I add how to configure it from pgAdmin following the documentation.
Copy code
--CREATE USER
CREATE USER nacho PASSWORD 'MyPassword';

--Grant to user
GRANT USAGE ON SCHEMA public TO nacho;

--More grants
GRANT SELECT ON ALL TABLES IN SCHEMA public TO nacho;

-- Allow user to see tables created in the future
ALTER DEFAULT PRIVILEGES IN public SCHEMA GRANT SELECT ON TABLES TO nacho;

--Replication slots
--This Airbyte user for your instance needs to be granted REPLICATION and LOGIN permissions.
--You can create a role with
CREATE ROLE rsrole REPLICATION LOGIN;

--And grant that role to the user
GRANT rsrole TO nacho;

--CREATE REPLICATION SLOT
SELECT pg_create_logical_replication_slot('rs_nacho', 'pgoutput');

--DROP REPLICATION SLOT
--select pg_drop_replication_slot('rs_nacho');

--ACTIVATE RS
SELECT redo_lsn, slot_name, restart_lsn,
round((redo_lsn-restart_lsn) / 1024 / 1024 / 1024, 2) AS GB_behind, database, active
FROM pg_control_checkpoint(), pg_replication_slots;

--CREATE RANDOM TABLE
CREATE TABLE stage(
IDESTADE SERIAL PRIMARY KEY,
name VARCHAR(45) NOT NULL,
address VARCHAR(45) NOT NULL
);

--inserts
INSERT INTO stadium (name, address) VALUES ('pepito','bsas');
INSERT INTO stadium (name, address) VALUES ('rolinga','bsas');
--
ALTER TABLE stage REPLICA IDENTITY DEFAULT;
--create Publication
CREATE PUBLICATION airbyte_test FOR TABLE stage;
I managed to make the connection between source and destination successfully, it creates the normalization table but when it comes to taking the information it throws me the following error:
Copy code
"2022-03-23 ​​17:26:41 normalization > 17:26:41 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
2022-03-23 ​​17:26:41 INFO i.a.w.DefaultNormalizationWorker(run):69 - Normalization executed in 23 seconds.
2022-03-23 ​​17:26:41 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-03-23 ​​17:26:41 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporary heartbeat...
2022-03-23 ​​17:26:41 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.errors: $.plugin: is not defined in the schema and the schema does not allow additional properties, $.publication: is not defined in the schema and the schema does not allow additional properties, $.replication_slot: is not defined in the schema and the schema does not allow additional properties, $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard
2022-03-23 ​​17:26:41 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.method: does not have a value in the enumeration [Standard]"
Could someone shed a little light here?
👀 1
m

Marcos Marx (Airbyte)

03/23/2022, 10:20 PM
The sync finished successfully?
i

Ignacio Alasia

03/23/2022, 11:00 PM
Nop
m

Marcos Marx (Airbyte)

03/23/2022, 11:01 PM
Can you share the complete logs because the error you shared is not the root cause of the failure
i

Ignacio Alasia

03/23/2022, 11:05 PM
Hi Marcus, could you take a look on this?
@Jhon Edison Bambague Calderon
m

Mijbel Alqattan

04/20/2022, 9:14 AM
@Ignacio Alasia Did you resolve this? I’m getting a similar error
raw
i

Ignacio Alasia

04/20/2022, 1:20 PM
Hi Mijbel. I didnt resolve this, but it was a POC. So I left behind and moved on with the Kubernetes localhost version and now I am working on that. Hope u can find a solution! Best.
m

Mijbel Alqattan

04/20/2022, 2:42 PM
So this error is docker install only? Interesting, thanks
i

Ignacio Alasia

04/20/2022, 2:43 PM
idk, I install docker after this error
👍 1