H-Shifter only 3 gears work need help

So everything else is working just not my h-shiftier at least no properly the gears change when they are in neutral but only the bottom 3 so if i move it left it goes to gear 2nd if left neutral its in 4th and if right it goes to 6th 2 3 and 5 wont work so what could be the problem?