You don't into trouble for hiding/ignoring a process server.
The other side will arrange alternative service. And once that happens, you may not find out and the court matter may proceed undefended. You won't be the first and won't be the last. The courts have evolved ways to deal with people who don't want to be served for this very reason.
Better to accept service.