Free · No sign-up · Private
Remove Duplicate Lines
Remove duplicate lines from a list, with optional case-insensitive matching.
Quick answer
Paste a list with one item per line and every repeated line is removed, keeping the first time each line appears and the original order. Tick Ignore case to treat “Banana” and “banana” as the same line. The result shows how many duplicates were removed.
Step by step
How to use the Remove Duplicate Lines
01
Paste your lines.
02
Choose whether to ignore case.
03
Get the deduplicated list.
Worked examples
Example
| Input | Output (ignore case off) | Output (ignore case on) |
|---|---|---|
| apple, banana, apple, cherry, Banana | apple, banana, cherry, Banana | apple, banana, cherry |
Good to know
Common uses
Cleaning email lists before an import, removing repeated keywords from a research export, deduplicating log lines, and merging two lists into one without repeats. Paste both lists one after the other and run the tool once.
Spaces count
Lines that differ only by a trailing space are treated as different. Run the text through Remove Extra Spaces first if your data comes from a spreadsheet or a PDF.
Counting what was removed
The result heading shows how many duplicate lines were removed. If the number is much higher or lower than expected, check for case differences and trailing spaces, the two most common reasons lines that look the same are treated as different.
FAQ
Frequently asked questions
Does it sort the list?
No, it keeps the original order. Use the text sorter afterwards if you want it sorted.
Is there a size limit?
Only your browser’s memory; lists with tens of thousands of lines work fine.
More text tools
Related tools
Remove Extra Spaces
Remove extra spaces, tabs and blank lines from text.
Open toolText Sorter
Sort lines alphabetically, by length or numerically, ascending or descending.
Open toolSlug Generator
Convert text into a URL-friendly slug, with custom separators.
Open toolLorem Ipsum Generator
Generate Lorem Ipsum paragraphs, sentences or words for mockups, layouts and design testing.
Open tool