> Ashley Madison facilitated relations between consenting adults.

Unless all parties involved (spouses included) consented, this is partially false. Full stop.

> The jilted spouses had nothing to do with it.

The jilted spouses were betrayed, even if unaware and not "involved" in the sex. Full stop.

Even in cases where cheating is remotely justified, an honest conversation beats sneaking around.