How to clean up recent colors in Adobe Photoshop CC 2015?

Question

Adobe Photoshop

I know holding down the alt key brings up the scissors icon and we get the ability to delete color swatches and recent brushes, I also managed to delete three cells from recent colors once so it's definitely possible, I remember that I pressed alt but whatever I don't did now repeat this experiment, I can’t and the recent colors are simply flipped over instead of being cleared? maybe they can be cleaned somehow, I want to know how?
Video - I managed to clear one of the cells again.

Answer 1

No matter how I tried, I could not imagine why it might be necessary to selectively delete them =\