How to remove duplicates from list in python 3 :
Hello friends, In this article, we will see How to remove duplicates items or elements from the list in python so Let’s start :
 |
| How to remove duplicates from list in python 3 |
There are different way to remove duplicates from list :
- Method 1 : Using list comprehension method
- Method 2 : Using list comprehension + enumerate() method
- Method 3 : Using set() method
- Method 4 : Naive method
- Method 5 : Using collections.OrderedDict.fromkeys() method
Method 1 : Using list comprehension method
This method has working similar to the Naive method , but small difference is it just a liner shorthand of longer methods done with the help of lists comprehension method.
# Demonstrate Python 3 code
# remove duplicated from list using list comprehension
# first we initializing list
use_list = [4, 3, 7, 6, 3, 5, 7, 1]
print (“The main/original list is : ” + str(use_list))
# then we use using list comprehension method
# to remove from list
rest = []
[rest.append(x) for x in use_list if x not in rest]
# printing list output after removal
print (“The unique list after removing dupli is follow: ” + str(rest))
Output :
The main/original list is : [4, 3, 7, 6, 3, 5, 7, 1]
The unique list after removing dupli is follow : [4, 3, 7, 6, 5, 1]
This time to learn different python terminologies in python.
Method 2 : Using list comprehension + enumerate()
list comprehension coupled with enumerate function can also achieve this task. It basically looks for already occurred elements and skips adding them. It preserves the list ordering.
# removing duplicated from list using list comprehension + enumerate()
# first initializing list
use_list = [4, 3, 7, 6, 3, 5, 7, 1]
print (“The main/original list is : ” + str(use_list))
# using list comprehension + enumerate() method to remove duplicated
# from the list
rest = [i for n, i in enumerate(use_list) if i not in test_list[:n]]
print (“TThe unique list after removing dupli is follow : ” + str(rest))
Output :
The main/original list is : [4, 3, 7, 6, 3, 5, 7, 1]
The unique list after removing dupli is follow: [4, 3, 7, 6, 5, 1]
Method 3 : Naive method
In this method (naive method), we simply append the first occurrence of the element in new existing list and ignore all the other occurrences of the list.
# Demonstrate Python program
# remove duplicated element from list using list Naive method
# first we initializing list
use_list = [4, 3, 7, 6, 3, 5, 7, 1]
print (“The main/original list is : ” + str(use_list))
# then we use using list Naive method
rest = []
for i in test_list:
if i not in rest:
rest.append(i)
# printing output after removal
print (“The unique list after removing dupli is follow: ” + str(rest))
Output :
The main/original list is : [4, 3, 7, 6, 3, 5, 7, 1]
The unique list after removing dupli is follow: [4, 3, 7, 6, 5, 1]