If you have been it means you are not there now. If you have gone it means you are still there.
- Gary has been to the bank.
(He is not there; he is now home.) - Gary has gone to the bank.
(He is still there; he has not returned.) - Adrian has been to Poland. Now he has gone to Iraq.