What is your mother tongue? I wasn't raised bilingual but I've done significant immersion for Arabic and have studied 3 other languages in addition to English, so I totally understand the rewriting things in your head in the "wrong" order. The worst is words or terms or phrases that don't quite translate and when you try and explain it, it's still not quite right.
Totally get that. I have a very close friend who is a native German speaker and I've noticed the same thing. I think it's definitely not as important in speech because people will get what you're saying even if it's not 100% correct. That's been my frustration with coming back to formal, academic language training. When I lived abroad and spoke to locals, I didn't have to be 100% correct 100% of the time to communicate.