Remove Duplicate Lines

Case sensitive. Remove empty lines. Display removed.

Enter text here, select options and click the "Remove Duplicate Lines" button from above.
Duplicate text removal is only between content on new lines and duplicate text within the same line will not be removed.
The line order/sorting will not be affected other than subsequent duplicate lines being deleted.
Check the "Case sensitive." checkbox for case sensitive matching of duplicate line removal.
Check the "Remove empty lines." checkbox to remove/delete all blank/empty lines.
Check the "Display removed." checkbox to save removed lines. Lines are prefixed with removal information for reference.

Example:
Click the "Remove Duplicate Lines" button and watch these duplicate lines become one.
Click the "Remove Duplicate Lines" button and watch these duplicate lines become one.
Click the "Remove Duplicate Lines" button and watch these duplicate lines become one.

Note: For files too large to successfully load into this text field, use the "Big File Tool" link below.
Privacy of Data: This tool is built-with and functions-in Client Side JavaScripting, so only your computer will see or process your data input/output./

Unix Dos. Big File Tool - Remove Duplicate Lines

About this tool

Does this upload my list?

No. This tool runs in your browser with client-side JavaScript. Your text never leaves your browser.

Does it keep the original line order?

Yes. The first occurrence of each line is kept. Later duplicates are removed. The list is not sorted unless you use Sort Text Lines afterward.