I felt the same way too. Was bouncing between Nu, Mu and Terumi. Was getting bodied to hell and back. Now that I went back to Nu, I realized the mode change isn't too bad once you practice as much as you can.
That flip kick is still a pain though. i wish there were damaging combos that didn't involve that stupid thing...at least until i get the hang of the motions.