If you have been it means you are not there now. If you have gone it means you are still there.
- Gary has been to the bank.
(He is not there; he is now home.)
- Gary has gone to the bank.
(He is still there; he has not returned.)
- Adrian has been to Poland. Now he has gone to Iraq.