https://www.boundaryml.com logo
🟡 Question about parser allowing alternative sepa...
# questions
n
Does parser allow for alternative separators. I had gpt-oss-20b use ";" instead of ",". Is there a way to allow for such?
Copy code
json
...
  "7": {
    "r": "Ekizo lwe ku 11600.0 UGX ephibwa.";
    "a": 7,
    "c": "waggulu"
  }
...
v
oh sadly not trivially. we support some amount of error correcting in the parser but not 100% 🙂
i have no idea if that would work, let me try real quic
our current parser turns that into:
Copy code
"7": {
  "r": "Ekizo lwe ku 11600.0 UGX ephibwa.\";\n    \"a\": 7,\n    \"c\": \"waggulu"
}
(which then fails, since "a" and "c" are required)
we have some ideas regarding a key-based error correction, but they just aren't a priority atm
n
do you use a lexer in json parsing?
v
we have 2 phases: 1. json error correction 2. type error corrections
so phase 1 has a lexer of sorts, but its a bit more nuances, since it actually traverses multiple different lexes simultaneously
2 Views