https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
e

Eliot Salant

04/24/2022, 1:18 PM
I am just starting with Airbyte and am trying to write local csv files to a Mac (Intel chip). I think I have the local mount set up correctly, since I am able to do a read operation. The write operation appears to succeed, but no information is actually written out. Command used: echo ‘{“record”: {“stream”: “testing”, “data”: {“DOB”: “01/02/1988", “First Name”: “John”, “Last NAME”: “Jones”}, “emitted_at”: 1650284493000}’ | docker run -v /Users/eliot/temp:/tmp airbyte/destination-csv write --catalog /tmp/airbyte_catalog.txt --config /tmp/airbyte_write.json Output:
Copy code
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=/tmp/airbyte_catalog.txt, write=null, config=/tmp/airbyte_write.json}
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.csv.CsvDestination
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Command: WRITE
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=WRITE, configPath='/tmp/airbyte_write.json', catalogPath='/tmp/airbyte_catalog.txt', statePath='null'}
2022-04-24 13:11:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(<init>):139 - initializing consumer.
2022-04-24 13:11:28 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):63 - Airbyte message consumer: succeeded.
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(close):178 - finalizing consumer.
2022-04-24 13:11:28 INFO i.a.i.d.c.CsvDestination$CsvConsumer(close):194 - File output: /local/airbyte_out/_airbyte_raw_testing.csv
2022-04-24 13:11:28 INFO i.a.i.b.IntegrationRunner(runInternal):153 - Completed integration: io.airbyte.integrations.destination.csv.CsvDestination
Created output % more /Users/eliot/temp/airbyte_out/_airbyte_raw_testing.csv “_airbyte_ab_id”,_airbyte_emitted_at,_airbyte_data What am I doing wrong? (Also, trying to go through the Pokemon example through the OpenSource framework example I cannot find my output file either…). Thanks, Eliot
3 Views