Hi, my husband does not stay alone, so he would not be able to withdrawal money on his own. I too took his bank cards away and just ask him how much cash he wants to keep on his person (it was $20 yesterday).
That way he still has some spending independence but can't commit any further financial abuse.
If you or someone else isn't with him all the time, it could easily happen again.
Good luck managing this tough situation.