Hey, I was out of the office for a week and I now that I'm back I'm seeing that our O2 instance is down. A co-worker was adding some alerts while I was gone, and I'm thinking one of them might have caused this based on the logs (below). Can you think of anything I can do to get the system back up? O2 version:

v0.92.0

Logs:

open-observe  | 2026-09-27T14:39:03.151995768Z 2026-09-27T14:39:03.151980948+00:00 INFO infra::coordinator::synthetics: Start watching synthetics cache events
open-observe  | 2026-09-27T14:39:03.151998088Z 2026-09-27T14:39:03.151982998+00:00 INFO enrichment_data::enrichment_table::runtime: Start watching stream enrichment_table
open-observe  | 2026-09-27T14:39:03.165984926Z
open-observe  | 2026-09-27T14:39:03.166044395Z thread '<unnamed>' (72) panicked at src/jobs/src/job/mod.rs:586:31:
open-observe  | 2026-09-27T14:39:03.166049286Z stream cache failed: SqlxError# error occurred while decoding column "key2": invalid utf-8 sequence of 1 bytes from index 9
open-observe  | 2026-09-27T14:39:03.166052546Z
open-observe  | 2026-09-27T14:39:03.166054806Z Caused by:
open-observe  | 2026-09-27T14:39:03.166056615Z     0: error occurred while decoding column "key2": invalid utf-8 sequence of 1 bytes from index 9
open-observe  | 2026-09-27T14:39:03.166058806Z     1: invalid utf-8 sequence of 1 bytes from index 9
open-observe  | 2026-09-27T14:39:03.166060595Z
open-observe  | 2026-09-27T14:39:03.166062355Z Stack backtrace:
open-observe  | 2026-09-27T14:39:03.166064006Z    0: <unknown>
open-observe  | 2026-09-27T14:39:03.166065946Z    1: <unknown>
open-observe  | 2026-09-27T14:39:03.166067675Z    2: <unknown>
open-observe  | 2026-09-27T14:39:03.166069366Z    3: <unknown>
open-observe  | 2026-09-27T14:39:03.166071035Z    4: <unknown>
open-observe  | 2026-09-27T14:39:03.166072715Z    5: <unknown>
open-observe  | 2026-09-27T14:39:03.166074405Z    6: <unknown>
open-observe  | 2026-09-27T14:39:03.166076095Z    7: <unknown>
open-observe  | 2026-09-27T14:39:03.166077775Z    8: clone
open-observe  | 2026-09-27T14:39:03.166079415Z stack backtrace:
open-observe  | 2026-09-27T14:39:03.166081095Z    0:     0x555dcfcf08e9 - <unknown>
open-observe  | 2026-09-27T14:39:03.166089895Z    1:     0x555dc55bd7da - <unknown>
open-observe  | 2026-09-27T14:39:03.166091775Z    2:     0x555dcfcfb396 - <unknown>
open-observe  | 2026-09-27T14:39:03.166093545Z    3:     0x555dcfcc9506 - <unknown>
open-observe  | 2026-09-27T14:39:03.166096035Z    4:     0x555dcfce5b76 - <unknown>
open-observe  | 2026-09-27T14:39:03.166097815Z    5:     0x555dcfce5e02 - <unknown>
open-observe  | 2026-09-27T14:39:03.166099575Z    6:     0x555dcfcc95c2 - <unknown>
open-observe  | 2026-09-27T14:39:03.166101345Z    7:     0x555dcfcbdc99 - <unknown>
open-observe  | 2026-09-27T14:39:03.166103125Z    8:     0x555dcfccaced - <unknown>
open-observe  | 2026-09-27T14:39:03.166104895Z    9:     0x555dc55bdf3c - <unknown>
open-observe  | 2026-09-27T14:39:03.166106645Z   10:     0x555dc55bdd12 - <unknown>
open-observe  | 2026-09-27T14:39:03.166108435Z   11:     0x555dca4d6536 - <unknown>
open-observe  | 2026-09-27T14:39:03.166110195Z   12:     0x555dca340a89 - <unknown>
open-observe  | 2026-09-27T14:39:03.166111965Z   13:     0x555dc9d5d367 - <unknown>
open-observe  | 2026-09-27T14:39:03.166113725Z   14:     0x555dca7eb14d - <unknown>
open-observe  | 2026-09-27T14:39:03.166115495Z   15:     0x555dcfcef204 - <unknown>
open-observe  | 2026-09-27T14:39:03.166117265Z   16:     0x7f81f16128bb - <unknown>
open-observe  | 2026-09-27T14:39:03.166119055Z   17:     0x7f81f1690370 - clone
open-observe  | 2026-09-27T14:39:03.166120815Z   18:                0x0 - <unknown>
open-observe  | 2026-09-27T14:39:03.169205652Z Error: backend job init failed: channel closed
open-observe  | 2026-09-27T14:39:03.169212832Z
open-observe  | 2026-09-27T14:39:03.169214872Z Stack backtrace:
open-observe  | 2026-09-27T14:39:03.169216852Z    0: <unknown>
open-observe  | 2026-09-27T14:39:03.169219012Z    1: <unknown>
open-observe  | 2026-09-27T14:39:03.169220772Z    2: <unknown>
open-observe  | 2026-09-27T14:39:03.169222592Z    3: <unknown>
open-observe  | 2026-09-27T14:39:03.169224272Z    4: <unknown>
open-observe  | 2026-09-27T14:39:03.169226062Z    5: <unknown>
open-observe  | 2026-09-27T14:39:03.169227702Z    6: <unknown>
open-observe  | 2026-09-27T14:39:03.169229482Z    7: <unknown>
open-observe  | 2026-09-27T14:39:03.169231142Z    8: __libc_start_main
open-observe  | 2026-09-27T14:39:03.169235542Z    9: <unknown>

Thanks Matt. can you plz upgrade. create a github issue.

Still happens after upgrading to

v1.0.4

but I did make an issue here Thanks for any help 🙏

Thank you