He didn't, and it almost became a domestic violence situation, but Alec realized as he was about to hit Viola that escalating it like that right on the heels of Viola having learned that he sexually abused their daughter was a Very Bad Idea so he didn't follow through. He took out most of his anger on Isabelle instead because, of course, she's the one less likely to make him suffer consequences.