From a80a8363e6777c235d3b436f7ac5942996687e67 Mon Sep 17 00:00:00 2001 From: Shorthills AI <141953346+ShorthillsAI@users.noreply.github.com> Date: Fri, 9 Feb 2024 21:35:45 +0530 Subject: [PATCH] Fixing minor spelling error (#10516) --- benchmarks/struct_indices/spider/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/benchmarks/struct_indices/spider/README.md b/benchmarks/struct_indices/spider/README.md index 1f0db4a9bd..bb2cf19139 100644 --- a/benchmarks/struct_indices/spider/README.md +++ b/benchmarks/struct_indices/spider/README.md @@ -31,7 +31,7 @@ python generate_sql.py --input spider-0_001 --output spider-0_001-pred --model g ./evaluate.sh spider-0_001 spider-0_001-pred ``` -5. **New**! Use `evaluate.py` to evalaute the generated SQLs against +5. **New**! Use `evaluate.py` to evaluate the generated SQLs against golden SQLs by matching the natural language answers generated from their respective execution outputs. This is called [Answer Accuracy](https://ekzhu.medium.com/human-aligned-text-to-sql-evaluation-399123fa0a64). -- GitLab