What I do is every time you finish a battle, pause the dungeon, then go to Party -> Solo Party -> tap the Rcmd. Party again. It will be put back into the modded amount, and then you can resume the dungeon again. It's annoying that you have to keep pausing the dungeon but it's worth it to get S+.