Mixed
Output format we ask for JSON. But it is not valid json many times (, after last element, missing } after element etc)
kumarm on Hacker News
1024 output tokens
In the thread “Generative AI support on Vertex AI is now generally available”, replying to this comment
Got in the way: Invalid JSON output requiring custom parsing code to work around format issues.
… 2. Output format we ask for JSON. But it is not valid json many times (, after last element, missing } after element etc). We have to write our own parsing code in the end to work around these JSON format issues.