Hi everyone! I am new to airbyte. Could someone help me with this issue? I am trying to figure out how to get the message stream from the

read()

function of the connector by running the container. The docs mention that the message stream is output to STDOUT, however I can't find it there. All I can see are the log messages of the container. I have tried this with the postgres connector only so far as it is the only connector relevant to me right now. Please help me out!

Hi @Saket Singh, I think this might be due to a specific implementation for this connector using ssh tunneling. Could you explain your use case? I'm going to reach my team to give you a more detailed answer.

Hey @[DEPRECATED] Augustin Lafanechere thanks for your response! I want to perform some value transformations before I send the extracted data to the destination. I understand that Airbyte is an EL(T) platform, however I want to change the value of the extracted data and not its structure. I think for my use case, if I could get the message stream, I would be done.

Hi @Saket Singh, this is not the approach we'd suggest taking as you'll have to patch the Postgres connector yourself. Transformation should happen after the load, and I'd instead suggest you use our custom transformation feature with DBT (we have a guide here)

As I mentioned, I need to change the value of data and not the structure. I don't mind patching things if you could help me with where in the code I can look? If you could tell me where the

read()

function is implemented in the postgres connector, that should be good too!

Hi @Saket Singh, you can also change the data value with DBT. In the postgres source connector you could patch the class

PostgresSourceOperations

class in

airbyte-integrations/connectors/source-postgres/src/main/java/io/airbyte/integrations/source/postgres/PostgresSourceOperations.java