awk

awk examples

awk '!x[$0]++' file.txt