No, you don't necessarily have to go to counseling together. In some cases, it may be more helpful for each spouse to meet with the counselor individually. This can be a good way to address specific issues that one spouse may be struggling with.