uniq

Uniq is a not so well known command from the GNU Coreutils which removes duplicate lines from a sorted file. FYI, sorting can be done with... sort!