https://linen.dev logo
c

charles

10/16/2020, 3:20 PM
In our protocol should each message still be one a single line (like in singer) or are we allowing multiline?
u

user

10/16/2020, 3:21 PM
my preference is single line. it simplifies parsing a lot. i had to bring back my multi-line parser last night and it wasn’t seeming terribly reliable.
u

user

10/16/2020, 3:22 PM
Should be single line
u

user

10/16/2020, 3:22 PM
@Jared Rhizor (Airbyte) i’m asking because the new exchange rate integration it outputting it’s spec object across multiple lines.
u

user

10/16/2020, 3:23 PM
jared, do you mind looking into turning this into a single line?
u

user

10/16/2020, 3:42 PM
Yeah that should become a single line.
u

user

10/16/2020, 3:42 PM
I'll look.
u

user

10/16/2020, 3:58 PM
Copy code
→ docker run -v $(pwd):/mount --rm airbyte/source-exchangeratesapi-singer:dev discover --config /mount/config.json
{"type": "LOG", "log": {"level": "INFO", "message": "Replicating exchange rate data from 2020-10-16 using base USD"}}
{"type": "LOG", "log": {"level": "INFO", "message": "Tap exiting normally"}}
{"streams": [{"name": "exchange_rate", "schema": {"date": {"type": "string", "format": "date-time"}, "CAD": {"type": ["null", "number"]}, "HKD": {"type": ["null", "number"]}, "ISK": {"type": ["null", "number"]}, "PHP": {"type": ["null", "number"]}, "DKK": {"type": ["null", "number"]}, "HUF": {"type": ["null", "number"]}, "CZK": {"type": ["null", "number"]}, "GBP": {"type": ["null", "number"]}, "RON": {"type": ["null", "number"]}, "SEK": {"type": ["null", "number"]}, "IDR": {"type": ["null", "number"]}, "INR": {"type": ["null", "number"]}, "BRL": {"type": ["null", "number"]}, "RUB": {"type": ["null", "number"]}, "HRK": {"type": ["null", "number"]}, "JPY": {"type": ["null", "number"]}, "THB": {"type": ["null", "number"]}, "CHF": {"type": ["null", "number"]}, "EUR": {"type": ["null", "number"]}, "MYR": {"type": ["null", "number"]}, "BGN": {"type": ["null", "number"]}, "TRY": {"type": ["null", "number"]}, "CNY": {"type": ["null", "number"]}, "NOK": {"type": ["null", "number"]}, "NZD": {"type": ["null", "number"]}, "ZAR": {"type": ["null", "number"]}, "USD": {"type": ["null", "number"]}, "MXN": {"type": ["null", "number"]}, "SGD": {"type": ["null", "number"]}, "AUD": {"type": ["null", "number"]}, "ILS": {"type": ["null", "number"]}, "KRW": {"type": ["null", "number"]}, "PLN": {"type": ["null", "number"]}}}]}
u

user

10/16/2020, 3:58 PM
It looks like it's on one line but log messages aren't being filtered on your side?
u

user

10/16/2020, 3:59 PM
I think it is for spec
u

user

10/16/2020, 3:59 PM
oh
u

user

10/16/2020, 3:59 PM
oops
u

user

10/16/2020, 3:59 PM
I can read
u

user

10/16/2020, 3:59 PM
I promise