All 4,799 reports

NoLlama · 25 Jan 2024

getting the LLM (Llama2) to write SQL queries to robustly answer natural language questions about the data is tough

swimwiththebeat on Hacker News

In the thread “An open source DuckDB text to SQL LLM”

Got in the way: Custom types and enums made robust SQL generation difficult.

… The promise does sound enticing, but it's actually kind of hard to get working in practice. A lot of our databases at work have columns with custom types and enums, and getting the LLM (Llama2) to write SQL queries to robustly answer natural language questions about the data is tough. It requires a lot of instruction prompting, context, and question-SQL examples (few-shot learning), and it still fails in unexpected ways. …