curlytab

curlytab / Remove Duplicate Lines

Once is enough.

Remove Duplicate Lines

Paste a list of emails, names, keywords or anything else, one per line, and get it back with every duplicate removed. Choose whether capital letters and extra spaces count, sort the result, and see exactly which lines were repeated.

Your list
Result

How to use the Remove Duplicate Lines

  1. Paste your list into Your list, or open a text or CSV file.
  2. Duplicates are removed instantly. The first copy of each line is kept in its original order.
  3. Tick Ignore case so Apple and apple count as the same, and choose a sort order if you like.
  4. Copy or download the result. The table below shows every line that was repeated and how many times.

More than just deduplication

  • Only lines that appear once: drop every line that has a duplicate, keeping only the truly unique ones.
  • Only repeated lines: list just the lines that appear more than once, such as duplicate orders or emails.
  • Most repeated first: sort by frequency to find the most common entries in a list.

Common uses

  • Clean an email list before importing it into a newsletter tool.
  • Remove repeated keywords from SEO research.
  • Merge two lists and remove the overlap: paste both, one after the other.
  • Find duplicate IDs, order numbers or product codes.

Working with spreadsheets

Copy a single column from Excel or Google Sheets and paste it here: each cell becomes a line. Paste the result back into a column. For whole rows, copy them as text; each row is compared as one line.

Frequently asked questions

Is the original order kept?

Yes, unless you choose a sort order. By default the first copy of each line stays where it was.

How large a list can it handle?

Hundreds of thousands of lines. Everything runs on your device, so the limit is your browser's memory.

Does ‘Ignore case’ change my text?

No. It only affects which lines count as duplicates. The kept line appears exactly as you typed it.

Is my list uploaded?

No. Your list never leaves your browser.

Add this duplicate line remover to your website

Free for blogs, schools and businesses. Copy the code below and paste it into your page's HTML. The tool works exactly like this one and runs in your visitors' browsers, so nothing is uploaded. Please keep the credit line so others can find it too.

Preview embed ↗