Good day everyone,
I am facing a "problem" with Po...
# ingestionm
microscopic-mechanic-13766
10/04/2022, 11:21 AMGood day everyone,
I am facing a "problem" with PostgreSQL ingestion. I am trying to ingest from all the databases that exist in my PostgreSQL using the postgres user but, although the ingestion succeeds, no data is ingested.
But if I ingest one database at a time with the same user, it is ingested correctly.
Does anybody know why this might be happening?
(I will upload both the recipe that I use for all the databases ingestion and the resultant log in the thread)
microscopic-mechanic-13766
10/04/2022, 11:21 AMRecipe:
Copy code
sink:
type: datahub-rest
config:
server: '<http://datahub-gms:8080>'
source:
type: postgres
config:
database: null
password: '${POSTGRES_PASSWORD}'
profiling:
enabled: true
host_port: 'postgresql:5432'
username: postgresd
dazzling-judge-80093
10/04/2022, 12:44 PMThis
database: nullm
microscopic-mechanic-13766
10/04/2022, 1:09 PMIsn't that the way to indicate that it should ingest from all the databases that exist in such source??
d
dazzling-judge-80093
10/04/2022, 1:10 PMahh, I guess the same happens if you omit the
databasem
microscopic-mechanic-13766
10/04/2022, 1:12 PMThat is right, at least it was in previous versions
microscopic-mechanic-13766
10/21/2022, 8:16 AMHello @dazzling-judge-80093, any news on how to avoid this strange behaviour and be able to ingest from all the databases of a postgres?