Find References: allow me to remove files without expanding nodes

[bpasero]

I often jump between search results and find references results and they almost behave identical, which is good. However in search I can:

• collapse all nodes
• click on the "X" to remove files from the result
• have the collapsed state preserved

With find references, everytime I click the X it seems to expand one node again. Can we prevent that from happening?