Remove Duplicate Text

Remove duplicate items from text in various formats including line-separated, space-separated, JSON arrays, and CSV.

Options

Override automatic format detection.
0
Original Items
0
Unique Items
0
Duplicates Removed
empty
Detected Format
Input Text
Deduplicated Text

How to Use Remove Duplicate Text

Supported Formats

Line Separated

Input:
AAA
BBB
CCC
AAA
Output:
AAA
BBB
CCC

Space Separated

Input:
AAA BBB CCC AAA
Output:
AAA BBB CCC

JSON Array

Input:
["aaa","bbb","ccc","aaa"]
Output:
["aaa","bbb","ccc"]

CSV Format

Input:
"aaa","bbb","ccc","aaa"
Output:
"aaa","bbb","ccc"
  • 1. Paste Your Text: Enter your text in the input area. The tool will automatically detect the format.
  • 2. Configure Options:
    • Case Sensitive: Whether "ABC" and "abc" are treated as different items.
    • Preserve Order: Keep the original order of first occurrences vs alphabetical sorting.
    • Format Override: Manually specify the format if auto-detection is incorrect.
  • 3. View Results: The deduplicated text appears in the output area with statistics showing how many duplicates were removed.
  • 4. Copy or Reset: Use the Copy button to copy results to clipboard, or Reset to clear everything.