It took me a week or so to make it work, it's easier to run it on Intel Mac. But have to build from source for M1 Macs. You'll need MacPorts to install dependencies, HomeBrew doesn't support M1 as well as MacPorts as of now. The last piece was SDRplay API/driver, I created a ticket a few days ago on SDRplay's website. I got an email from SDRplay today saying they just released a beta version of the API to support M1 Macs. And it worked perfectly!
It works pretty well, and looks much better than gqrx and CubicSDR! Hopefully Tom, DL2RUM will update RUMlogNG to support controlling SDR via Hamlib, so I can have a working panadapter on Mac finally!