Remove duplicate lines

Paste text or load a file and every repeated line is deleted, while the first occurrence stays where it was. It runs in your browser – the text never leaves your device.

How it works

  1. Paste the text or load a .txt, .csv, .md or other text file.
  2. Choose options such as ignoring letter case or keeping the last occurrence.
  3. Copy the result or download it as a .txt file.

Works well for

  • E-mail, keyword and URL lists merged from several sources
  • Log files and exports where the same line appears many times
  • CSV rows that are exact copies of each other
  • Lines that differ only in spaces at the start or end

Limitations

  • Lines must match as a whole – near-duplicates with a typo or one different word stay.
  • CSV rows are compared as text, not by column: a row with the same ID but other values is kept.
  • Blank lines are never treated as duplicates, so paragraph gaps stay – use Remove empty lines for them.

Frequently asked questions

Which occurrence is kept?

The first one, in its original position. You can switch to keeping the last occurrence instead. The order of the remaining lines does not change.

Does it ignore upper and lower case?

Matching is case-sensitive by default. Turn on case-insensitive matching to treat “Apple” and “apple” as the same line. Spaces at the start and end of a line are ignored when comparing, but the output keeps the original line.

Is my text uploaded anywhere?

No. The text is processed by JavaScript in your browser and is never sent to our server.

How much text can I process?

Up to 1 MB of text without an account, 2 MB with a free account and 10 MB with Pro. Pro also includes an HTTP API for automated use.