The Fences Act in Victoria states that the owners of houses on adjoining properties are jointly responsible for the cost of repairing/replacing their boundary fence.
Try to reach an agreement with your neighbour again – raise your concerns, why the fence replacement is needed and try to clarify...