I would say that it's not worth the worry, but then you might feel otherwise. The main thing (to me) would be to make sure that there aren't any potential health issues associated with it, and if there are then to beware of them and take preventative measures if possible.
As for whether or not you're asexual, or what your exact orientation might be? Nobody can say for sure except you.
I know that what I'm going to say will be blasphemy to some, but I believe that in some cases asexuality is NOT a lifelong condition, and/or it can be perfectly valid and real even if it IS caused by some other related condition. All asexuality is is a lack of sexual attraction - there are no time limits mentioned - and scientists who study human sexuality can't even decide what sexual attraction IS, so the entire concept is pretty blurry at best.
The line between love and friendship can be just as hard to define. In my opinion, a long term, committed friendship is closer to being true love than an intense, six month sexual fling, and the factors that attract friends to each other are just as real as sexual attraction or romantic attraction.
If you don't feel any desire to have sex with anybody else, and if the idea of never having sex at all seems perfectly okay with you, then I would say that you're probably asexual, no matter what else might be going on, hormonally or otherwise. If any of that changes in the future, it won't invalidate anything at all. It might let you look at things from a different perspective with hindsight, but that's life most of the time anyway.
If there's a "right" person for you, then maybe they're just taking their own sweet time about showing up . . . ? Based on my own experience, I would say that it can take decades, and it seems to happen about the time that you finally give up and decide to focus on staying happily single and eccentric for life. The cosmos seems to take delight in disrupting such innocent and admirable goals.
Of course, your mileage may vary.