This response is provided based on the information you shared and should not be used as the sole source for making a decision. You should seek guidance from the chain of command, IG, JAG or other certified agencies before making any decisions. How you chose to use this information is totally up to you and is your sole responsibility.
The only other option that I can think of is to have either the battalion or brigade commander or CSM call the Branch Sergeant Major and talk to them about modifying your assignment. I was an assignment manager during my career. Unfortunately, sometimes there is nothing an assignment manager can do because the slot might require specific skills, training, or be a priority assignment and no on e else is available to fill the position.