Alfie Mountfield
03/21/2022, 11:10 AMMiquel Rius
03/21/2022, 11:58 AMTan Ho
03/21/2022, 12:22 PMclass CustomDestination(Destination):
def write(
self, config: Mapping[str, Any], configured_catalog: ConfiguredAirbyteCatalog, input_messages: Iterable[AirbyteMessage]
) -> Iterable[AirbyteMessage]:
# How to get the current job id of current connection sync
Thomas Ebermann
03/21/2022, 7:34 PMIvan Zhabin
03/22/2022, 7:20 AMJohan Strand
03/22/2022, 8:49 AMgcloud --project=$PROJECT_ID beta compute ssh $INSTANCE_NAME -- -L 8000:localhost:8000 -N -f
I get ssh: connect to host xx.xx.xx.xx port 22: Operation timed out
Anything else that needs to be done?
Also tried changing to port 22Saket Singh
03/23/2022, 6:08 AMAshish
03/23/2022, 11:01 AMMartin Carlsson
03/23/2022, 12:45 PMdocker-compose up
Chris Stout
03/23/2022, 2:37 PMVladimir Remar
03/23/2022, 3:14 PMDavid Copeland
03/23/2022, 5:23 PMIgnacio Alasia
03/23/2022, 6:07 PM--CREATE USER
CREATE USER nacho PASSWORD 'MyPassword';
--Grant to user
GRANT USAGE ON SCHEMA public TO nacho;
--More grants
GRANT SELECT ON ALL TABLES IN SCHEMA public TO nacho;
-- Allow user to see tables created in the future
ALTER DEFAULT PRIVILEGES IN public SCHEMA GRANT SELECT ON TABLES TO nacho;
--Replication slots
--This Airbyte user for your instance needs to be granted REPLICATION and LOGIN permissions.
--You can create a role with
CREATE ROLE rsrole REPLICATION LOGIN;
--And grant that role to the user
GRANT rsrole TO nacho;
--CREATE REPLICATION SLOT
SELECT pg_create_logical_replication_slot('rs_nacho', 'pgoutput');
--DROP REPLICATION SLOT
--select pg_drop_replication_slot('rs_nacho');
--ACTIVATE RS
SELECT redo_lsn, slot_name, restart_lsn,
round((redo_lsn-restart_lsn) / 1024 / 1024 / 1024, 2) AS GB_behind, database, active
FROM pg_control_checkpoint(), pg_replication_slots;
--CREATE RANDOM TABLE
CREATE TABLE stage(
IDESTADE SERIAL PRIMARY KEY,
name VARCHAR(45) NOT NULL,
address VARCHAR(45) NOT NULL
);
--inserts
INSERT INTO stadium (name, address) VALUES ('pepito','bsas');
INSERT INTO stadium (name, address) VALUES ('rolinga','bsas');
--
ALTER TABLE stage REPLICA IDENTITY DEFAULT;
--create Publication
CREATE PUBLICATION airbyte_test FOR TABLE stage;
I managed to make the connection between source and destination successfully, it creates the normalization table but when it comes to taking the information it throws me the following error:
"2022-03-23 17:26:41 normalization > 17:26:41 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
2022-03-23 17:26:41 INFO i.a.w.DefaultNormalizationWorker(run):69 - Normalization executed in 23 seconds.
2022-03-23 17:26:41 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-03-23 17:26:41 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporary heartbeat...
2022-03-23 17:26:41 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.errors: $.plugin: is not defined in the schema and the schema does not allow additional properties, $.publication: is not defined in the schema and the schema does not allow additional properties, $.replication_slot: is not defined in the schema and the schema does not allow additional properties, $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard
2022-03-23 17:26:41 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.method: does not have a value in the enumeration [Standard]"
Could someone shed a little light here?Jyothi
03/23/2022, 7:27 PMNirmit Jain
03/24/2022, 6:23 AMNaphat Theerawat
03/24/2022, 8:36 AMShubham Pinjwani
03/24/2022, 8:44 AMShubham Pinjwani
03/24/2022, 8:46 AMDavid Copeland
03/24/2022, 9:48 AMHarry.C
03/24/2022, 1:01 PMMiquel Rius
03/24/2022, 2:44 PMYour connection from Google Sheets version 0.2.9 to Redshift version 0.3.23 succeeded
This was for sync started on Thursday, March 24, 2022 at 8:40:34 AM Coordinated Universal Time, running for 30 seconds.
I would like to add name of the connection. and change the url as it says localhost:8080, and it dont redirect to the server installed in EC2.Emil Ordonez
03/24/2022, 5:53 PMAndrei Batomunkuev
03/24/2022, 6:48 PMArvi
03/25/2022, 1:55 AMRC
03/25/2022, 8:16 AMBenoit Hugonnard
03/25/2022, 5:20 PMsaad ab
03/26/2022, 7:42 PMdocker-compse up
, any one can help me out please
WARNING: The DB_DOCKER_MOUNT variable is not set. Defaulting to a blank string.
ERROR: Duplicate mount points: [data:.:rw, workspace:.:rw, .:.:rw]
Marcus Vinicius Silva De Azevedo
03/27/2022, 10:13 PMBenoit Hugonnard
03/28/2022, 8:09 AMAlexandre Chouraki
03/28/2022, 9:43 AM