Don't worry too much.
My wife knows about 20+ languages and can pick new ones up fairly easily, though that's mostly written. She can get by in spoken Spanish, Japanese*, and occasionally a little German or French. She did NOT learn any new languages until she was at least in junior high, if not high school. But it's never done her much good.
I speak and write one other language, French, and it's gotten me every job I ever had that wasn't in a factory. In fact, it's the only thing I ever learned in my whole life that directly improved my economic chances vs. those of my peers. In my case, I think that learning early did make a huge difference in my ability to view language more objectively (so as to make learning other languages easy), and could probably pick up a couple more if I invested some time and effort into it (Spanish and Farsi are my first choices).
So, uh, I guess what I'm trying to say is, your mileage may vary.
*She's the only white person I've EVER met who learned Japanese for non-work, non-weeaboo reasons.