Though his attacks pack a punch, you can protect against most of them, so use Tips to keep your defense up.
However, staying on the defense won't give you any openings to attack. Hold down Tips, then move towards the side from where Majima is facing and press Tips to circle around while evading attacks.