Remove duplicate lines
Load your text in the input form on the left and you'll instantly get text with no duplicate lines in the output area. Powerful, free, and fast. Load text lines – get unique text lines
Input text
Text without duplicates
Tool options
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Remove duplicate lines Examples
Click to try!
Remove Duplicate Items from List
Removes duplicate items from a shopping list, keeping only the first occurrence of each item.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Clean Consecutive Duplicates
Removes consecutive duplicates from log entries, which often happen when a system repeatedly logs the same error.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Extract Unique Entries Only
Filters a list to keep only entries that appear exactly once, removing any duplicated items entirely.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
Sort and Clean Data
Removes duplicate items from a list, trims whitespace, and sorts the results alphabetically.
Operation Mode
Remove All Duplicate Lines
If this option is selected, then all repeated lines across entire text are removed, starting from the second occurrence.
Remove Consecutive Duplicate Lines
If this option is selected, then only consecutive repeated lines are removed.
Leave Absolutely Unique Text Lines
If this option is selected, then all lines that appear more than once are removed.
Newlines, Tabs and Spaces
Preserve All Newlines
Leave all empty lines in the output.
Filter All Newlines
Process newlines as regular lines.
Delete All Newlines
Before filtering uniques, remove all newlines.
Before filtering uniques, remove tabs and spaces from the beginning and end of all lines.
Sort Lines
After removing the duplicates, sort the unique lines.
All Text Tools