Skip to content

Python remove duplicates from list of lists | Example code

  • by

Use the itertools to remove duplicates from a list of lists in Python. The itertools often offers the fastest and most powerful solutions to this kind of problem.

Example remove duplicates from the lists of list in Python

Simple example code. Before removing duplicates from a list you have to sort the list and don’t forget to import the itertools module.

import itertools

k = [[1, 2], [4], [5, 6, 2], [1, 2], [3], [4]]
k.sort()
res = list(k for k, _ in itertools.groupby(k))
print(res)

Output:

Python remove duplicates from list of lists

Python remove duplicates from nested list

Using sorted() + set() : Examples removing duplicate sublist.

list1 = [[1, 2], [4], [5, 6, 2], [1, 2], [3], [4]]

res = res = list(set(tuple(sorted(sub)) for sub in list1))
print(res)

Output: [(1, 2), (3,), (2, 5, 6), (4,)]

Using set() + map() + sorted()

list1 = [[1, 2], [4], [5, 6, 2], [1, 2], [3], [4]]

res = res = list(set(map(lambda i: tuple(sorted(i)), list1)))
  
print(res)

Output: [(1, 2), (3,), (2, 5, 6), (4,)]

Do comment if you have any doubts and suggestions on this list tutorial.

Note: IDE: PyCharm 2021.3.3 (Community Edition)

Windows 10

Python 3.10.1

All Python Examples are in Python 3, so Maybe its different from python 2 or upgraded versions.

Leave a Reply

Discover more from Tutorial

Subscribe now to keep reading and get access to the full archive.

Continue reading