I also have MBP M1 and have two rules set. Then turning off and on wifi on MBP, I auto connect to wifi (at different locations) but the MAC is not changed. I can change MAC manually just fine. Running v3.8.5 from Apple Store on Ventura 13.0.1 with helper installed
double click to open the .dmg file
drag the Helper app into your Applications folder
double click the helper app to install
and leave it in your Applications folder
@sweetp As of v3.8.4 it shows that dialogue once when I start it after a restart, then does not appear until another restart. Other than the dialogue appearing, everything seems to be normal.