About the Remove Duplicate Lines
Unlike sort | uniq, this keeps the original order: each line is compared with a set of lines already seen, and repeats are dropped. Keep first keeps the first copy in its position; Keep last keeps the last copy, useful for logs or config where later entries override earlier ones.
Ignore case treats Apple and apple as the same line, and Trim spaces before comparing ignores leading and trailing whitespace, which often hides duplicates in data pasted from spreadsheets. In both cases the kept line is output as written. Remove empty lines drops blank lines entirely. The status line shows how many duplicates were removed.
The comparison uses a JavaScript Set, so lists with hundreds of thousands of lines are processed in a fraction of a second, all in your browser. Typical uses: cleaning email lists, keyword lists, .gitignore entries or log lines.
Example: with Ignore case on, the list apple, banana, Apple, cherry becomes apple, banana, cherry.
How to use it
- Paste your lines or open a text file.
- Choose keep first or keep last.
- Set the ignore-case, trim and empty-line options.
- Copy or download the result.