Tool: Remove Duplicate Lines
Case sensitive.
Remove empty lines.
Display removed.
Enter text here, select options and click the "Remove Duplicate Lines" button from above. Duplicate text removal is only between content on new lines and duplicate text within the same line will not be removed. The line order/sorting will not be affected other than subsequent duplicate lines being deleted. Check the "Case sensitive." checkbox for case sensitive matching of duplicate line removal. Check the "Remove empty lines." checkbox to remove/delete all blank/empty lines. Check the "Display removed." checkbox to save removed lines. Lines are prefixed with removal information for reference. Example: Click the "Remove Duplicate Lines" button and watch these duplicate lines become one. Click the "Remove Duplicate Lines" button and watch these duplicate lines become one. Click the "Remove Duplicate Lines" button and watch these duplicate lines become one. Note: For files too large to successfully load into this text field, use the "Big File Tool" link below. Privacy of Data: This tool is built-with and functions-in Client Side JavaScripting, so only your computer will see or process your data input/output.
Removed Line Box - Removed lines will display here. Removed lines will be prefixed with their duplicate info* for reference and analysis. *e.g. (Line 10 was a duplicate of line 9.)
Unix
Dos.
Big File Tool - Remove Duplicate Lines