You say you don't owe him any money, but does he think you owe him money?
Advise the solicitor that he is in breach of section 14 of the NSW solicitor's rules. BTW, the solicitor does need to, nor should he, give you 'your file'. He only has to give certain documents to you.