To remove a reference right click on the reference(s) you want to delete then:
You can also delete a reference by selecting it and hitting the Delete key on your keyboard.
Do not try to drag and drop a reference to Bin because this does not work.
References will remain in the Bin folder until you empty it. Right click on the Bin folder to empty it.