yes, it's possible. I think it's called formal verification.

https://en.wikipedia.org/wiki/Formal_verification

I can't even begin to understand how it's done. I suspect we need a new programming language that forces you to do it before it compiles to machine code. or an AI that's setup to prove what you code.