Lines
Treats each CRLF, LF, or CR-separated line as one item. This is the default for pasted lists, logs, code, and line-oriented text.
Product reference
Capabilities & limits
A precise guide to what the duplicate remover does, how each mode changes the result, and where browser, file, CSV, preview, and privacy boundaries apply.
Choose how input becomes items
The selected mode controls tokenization before matching, filtering, or sorting begins.
Words
Finds Unicode letter-and-number word tokens. Browser word segmentation is used when available; punctuation, emoji, apostrophes, and hyphens act as boundaries rather than output characters.
Delimiter
Splits on New line, comma, semicolon, space, tab, or a literal custom delimiter. Line breaks remain boundaries even when another delimiter is selected.
Choose which matches to return
Result
Returns one retained value for every distinct match. Keep first is the default; Keep last can retain the final spelling or formatting instead.
Repeated
Returns one retained value for each match that appears at least twice. Copy with counts adds the occurrence count beside each returned value.
Once only
Returns only values whose match appears exactly once after the selected case, whitespace, empty-item, and delimiter rules are applied.
Input, file, and preview limits
- Manual typing or paste
- 300 KB (300,000 UTF-8 bytes) per current text input.
- Local text files
- 10 MB (10,000,000 bytes) per file and 10 MB (10,000,000 bytes) total per selected batch. The browser reads accepted files locally.
- Interactive result preview
- Up to 500 rows, with a maximum of 2,000 UTF-8 bytes per preview row and 64,000bytes across the preview.
CSV means plain text here
The tool does not parse headers, columns, quoted delimiters, escaped quotes, or multiline fields. Lines mode can deduplicate complete text rows; Delimiter mode splits raw items, so a comma inside quotes is still treated as a delimiter.
A bounded preview does not shorten the export
Large results use a bounded interactive preview. A preview may contain fewer rows or shorten a very long row, while full-result Copy actions and Download continue to use the complete processed output. Download creates a plain-text deduplicated.txt file; it does not rebuild the original CSV structure.
Local processing and limited telemetry are separate
Pasted text and selected file contents are processed locally and are not uploaded for deduplication. When Analytics is configured and enabled in Production, Microsoft Clarity and Google Analytics may process limited page and interaction telemetry. This information page has no text or file input and emits no duplicate-remover content events.