Take a bus back to Melbourne (4.5h), then a connecting V/Line train and bus to Phillip Island (3h total from Melbourne). Budget option with multiple connections.
Take a local shuttle or rent a budget car to drive the Great Ocean Road section westwards; stops include Otway National Park, Gibson Steps to Twelve Apostles - dramatic coastal views.