How to destroy an object by coordinates (or the desired clone)?

Question

Unity

I have a grid with x and y coordinates and an object name

private Dictionary<(int,int), string> grid = new Dictionary<(int,int), string>();

when an object is created, the coordinates and name are recorded on it, and a copy of the prefab is also created there

grid[(placeX,placeY)] = Building.name;
Instantiate(Building, new Vector3(placeX, 0, placeY), Quaternion.identity); // в курсе что там Z но у меня такая сетка

Next, I need to remove it from there for example

grid[(placeX,placeY)] = "";
Destroy (???);

But how to remove the copy itself?
The clones are all called the same (for example, Tree(Clone) )...