For the existing child, you can move without the father's consent, but he can file for a relocation order to have you and/or the child moved back.
For the unborn child, there are no relevant laws under the Family Law Act until the child is born, so you can relocate at will.