Which algorithm to choose to remove duplicates?

Question

Algorithms

There is a list like this:

site.com/index.php?id=1
site.com/index.php?id=2
site.com/index.php?id=3
site.com/index.php?id=1¶m=a
site.com/ index.php?id=1¶m=b
site2.com/index.php?id=3
site2.com/index.php?id=4
site2.com/index.php?id=5
site2.com/index.php? id=1¶m=x
site2.com/index.php?id=1¶m=y
site2.com/index.php?id=2¶m=z

It is required to bring it to the form:

site.com/index.php?id=1
site.com/index.php?id=1¶m=a
site2.com/index.php?id=3
site2.com/index.php?id=1¶m=x

That is, remove links where only the parameter values ​​differ, but the parameters themselves are the same. Advise on which algorithm is better to go and how would it be easier to implement all this?