The Australian Bourse made a cautious start to the new financial year and the stocks gave up their morning gains in the afternoon.