Network packet loss between the RM Noise Client software and the RMN server is critical. At a packet loss of 1%, you will start to notice audio clicks, at a 3% packet loss it starts to get annoying. I experimented and simulated packet loss with a tool called clumsy https://jagt.github.io/clumsy/index.html to see how it impacts RM Noise.
When you start seeing "lost packet count" in the log, the sound will start dropping out, the higher the number, the worse it gets.
If you are suffering from packet loss, I can recommend https://www.pingplotter.com/ to find the source of the packet loss.