Egothor/Radixor
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

feat: Apply metadata-driven case normalization in get/getAll

Browse Source
This commit is contained in:
Leo Galambos
2026-04-23 22:32:05 +02:00
parent 4d939f5b6e
commit 8785f2b7cb
14 changed files with 353 additions and 43 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/dictionary-format.md
View File

@@ -111,7 +111,7 @@ This is also valid:
## Case normalization
Input lines are normalized to lower case using `Locale.ROOT` before tab-separated columns are processed into dictionary entries.
Input-line case normalization is controlled by `CaseProcessingMode`; by default the parser uses `LOWERCASE_WITH_LOCALE_ROOT` before tab-separated columns are processed into dictionary entries.
That means dictionary authors should treat the format as **case-insensitive at load time**. If a file contains uppercase or mixed-case tokens, they will be normalized during parsing.
@@ -193,7 +193,7 @@ Run Running Runs Ran
CONNECT Connected Connecting
```
This is accepted, but it is normalized to lower case during parsing.
This is accepted. Under the default `LOWERCASE_WITH_LOCALE_ROOT` mode it is normalized to lower case during parsing; under `AS_IS` it is preserved.
## Format limitations