More than not "liking" them, He nullifies them, because they're made for hard-hearted people, but hard-heartedness has to do with an unbelieving heart falling away from the living God (Heb 3), so there's no place for them in the New Covenant--and oath-taking was one of those concessions. If it were just Jesus saying it, it would be one thing--it may be open to interpretation--but when you have James echoing the teaching in no uncertain terms ("make no vow AT ALL"), that's a different story.
Just as when James says "not by faith alone", I take him at his word, so, also, when James says "make no vow AT ALL", and I simply take him at his word. Quit being like Martin Luther, brother. LOL!