In my book (2019 https://www.amazon.com/dp/1688505717) I make the case for why logic is changeable and therefore temporary. The crux of the argument is that the inequality between a lemon and a lime does-not-equal the inequality between a star and a question, which draws the concept of identity into question. This implies that everything changes, including language or how we slice up reality with words. It amounts to the Buddhist maxim ” everything is impermanent” including words and mathematical words/objects.
This is not to endorse nihilism. Language is still very helpful in learning truth, but truth is not something that can be expressed with language. See this blog post: https://questionsarepower.org/2020/03/22/the-fools-song/ Language doesn’t amount to nothing; it is like lunch. You need it to keep your mind going on its path to truth, just like you need lunch to accomplish much of anything in life. You read and think in language so your mind can keep moving. It is very important, even hypnotic. Ultimately, as a delightful art form, it is a means to an end. It is not an end in itself.
I should add that this requires a particular theory of identity: how it is like and different to other things is how it gains its identity. As usual, not a perfect theory. But surely, how we relate an apple to the rest of the world changes. Maybe over a thousand years we decide apples don’t taste good, or are dirty, or whatever else. It is actually easier to see how mathematical objects change, because our taste for them changes them even more than it does an apple.