IIRC, while neanderthal tool technology was (at least for much of their existence) every bit as complex and advanced as contemporary homo sapiens stone tools (and difficult enough to manufacture that they're likely to have needed some form of language to pass the knowledge of how to make them...