Hi, Sorry I have large number of questions I creat...
# issues
d
Hi, Sorry I have large number of questions I created table for logs. We send logs via vector and it works great. Greptime 1.1.2 and vector 0.56 (latest I think) When I create json column type for message (message is valid json) - vector can't ingest data - I see lots of errors. But if message is just string - it works perfectly fine. Maybe its known issue and you know how to make it work? Thank you in advance
n
hi @Denys Zorinets, can you post how you configured your greptimedb sink in vector, and how your greptimedb pipeline looks if any to store message as json, you will need a greptimedb pipeline like:
Copy code
processors:
     - json_parse:          # string -> object (fails rows that aren't valid JSON)
         fields:
           - message
   transform:
     - field: message
       type: json
     - field: greptime_timestamp   # must match the table's TIME INDEX column name
       type: timestamp, ns
       index: time
d
sinks: greptimedb_logs_indexed: type: greptimedb_logs inputs: - detect_severity compression: zstd dbname: logs endpoint: ${greptimedb_endpoint} extra_params: source: vector pipeline_name: greptime_identity table: logs_indexed username: ${greptimedb_user} password: ${greptimedb_password} buffer: - type: memory max_events: 10000 when_full: overflow - type: disk max_size: 8589934592
I will try your approach. Thank you