Remove Duplicate Lines

How to use

1. Paste one item per line into the input box.
2. Choose whether to keep the first or last matching occurrence.
3. Turn on whitespace, case, empty-line, or Unicode matching options when needed.
4. Leave the order intact or choose a natural A–Z or Z–A sort.
5. Review the live result and copy it when it is ready.

What counts as the same line?

By default, two lines match only when every character is the same, and the first copy stays in its original position. “Apple”, “apple”, and “apple ” are therefore three different lines. Turn off case-sensitive matching to merge capitalization differences, or turn on surrounding-whitespace matching when copied lists contain accidental spaces or tabs. These options affect comparison only: the retained line keeps its original capitalization and whitespace so the result does not silently rewrite your data.

The Unicode option compares text after NFC normalization. It catches visually identical text that may be stored differently, such as a Korean syllable pasted as separate jamo characters on one device and as one composed character on another. It is not fuzzy matching: different words, punctuation, and internal spaces remain different.

Keep order, keep the latest, or sort naturally

Keep First is safest for lists whose early order matters: it removes later repeats without moving the surviving line. Keep Last is useful for pasted exports where the most recent copy should win; the surviving line remains at its last original position. Choose Original order to preserve that position, or sort the already de-duplicated result afterward.

Natural sorting compares number runs as numbers, so “item 2” comes before “item 10” rather than after it. Sorting does not decide which duplicate survives—the keep rule does that first. The counters always describe the current options, including any removed blank lines, so there is no separate run button or stale result to interpret.

Line endings and privacy

The remover recognizes Windows CRLF, Unix and current macOS LF, classic Mac CR, and Unicode line and paragraph separators as line boundaries. A pasted trailing line break counts as one final empty line; enable Remove empty lines to exclude it along with blank and whitespace-only lines. This is a line tool, so a CSV row or a sentence with commas is still compared as one complete line.

Processing and the optional saved draft stay in this browser. The page does not upload the text for comparison. Use Clear to remove the saved input from this tool, then copy the cleaned list into a spreadsheet, editor, terminal, or import form.

Frequently asked questions