Text and list dedupe
Duplicate Remover Online for Text & Lists
Paste text or one list, then choose how items are split, matched, retained, and shown. Use Lines, Words, or Delimiter mode and keep the entire workflow in your browser.
Paste/type up to 300 KB · local text files up to 10 MB per file and batch · CSV is plain text
Text and list dedupe
Choose the rules that define the result
Choose what counts as one item
Start with Lines, switch to Unicode word tokens, or split one list with a comma, semicolon, space, tab, new line, or literal custom delimiter.
Choose how values match and which copy is kept
Ignore case, trim outer whitespace, remove empty items, and keep the first or last matching value according to the visible options you enable.
Choose the result view
Result keeps one value for each distinct match, Repeated shows values found at least twice, and Once only returns values that appear exactly once.
A general workflow for text and lists
Paste text or one list
Use the general page when the input boundaries or matching rules still need to be chosen.
Set split and matching rules
Select Lines, Words, or Delimiter, then adjust case, whitespace, retention, and sorting only when needed.
Review and copy the right view
Check the counts, then copy the distinct result, repeated values, once-only values, or a counted report.
Text and list duplicate remover FAQ
When should I use this general page?
Use it when you need to choose whether the input contains lines, words, or delimiter-separated items. For a fixed one-item-per-line workflow, use the dedicated Remove Duplicate Lines page.
Is my text uploaded?
No. The duplicate remover runs in your browser, and input/output fields are masked for analytics.
Duplicate-removal workflows
Related duplicate-removal workflows
Each route uses the local processing engine with defaults and guidance for one clearly defined task.
Line dedupe
Remove Duplicate Lines Online
Treat each newline as one item, then remove, find, or count repeated lines.
List dedupe
Remove Duplicates From a List Online
Split one list by comma, tab, or another delimiter and keep stable item order.
TXT and local text files
Remove Duplicates From TXT Files
Start with local TXT or plain-text files, process them in the browser, and download the result.
