For attacks that you cannot defend against using Tips, such as needle and throwing attacks, hold down Tips, then move towards the side from where Majima is facing and press Tips to circle around behind the enemy.
You can also protect yourself using Slugger style, which lets you defend against weapon attacks, but pay attention to positioning so your attacks aren't deflected by the walls.