Hello everyone, Though I have previously worked w...
# general
p
Hello everyone, Though I have previously worked with Druid for a real time use case using Kafka as the source, now I have a new requirement to ingest data from RDBMS (Oracle SQL) into druid directly. Is this even possible, I see only MySQL and Postgress as the SQL input sources? The requirement is to, 1. directly fetch tables from Oracle SQL and ingest into druid, is oracle supported as SQL input source? 2. This needs to handle incremental data as well, how can I achieve this?(Please point me to appropriate document) 3. If the incremental data UPSERT is supported from Oracle SQL, does druid itself support scheduling this job? or data pull as and when something is updated at source(something like CDC), like how does it work exactly and what are the limitations I should focus on before building this usecase. NOTE: Ideally, I am trying to avoid any third component, be it an orchestrator like Airflow or CRON, or streaming tools like Kafka or kinesis, or third party CDC tools like Debezium. I am just trying to see if a direct data pull from Oracle SQL can be handled within Druid itself, while also being able to pull updated data from Oracle SQL.
k
AFAIK only MySQL and Postgres are supported for this operation