Senior Sergeant Anthony Bond, of Dunedin, said police were called to Crawford St at 12am after reports of two males going through the skip bin around the back of the Briscoes building.
The 31-year-old and 32-year-old men were "trying to recover disposed of stock the store threw away".
The two men were warned for their behaviour, Snr Sgt Bond said.