Agreeing on the comma-less version. It strikes me that your "too" is being used more as an synonym for "definitely" or "absolutely," rather than for "also," which would alter which rules of punctuation apply. Fwiw!
PS Another example that also occurred to me (overthinking this as I went on my daily walk :0) would be "That baby is too cute!" vs "That baby is, too, cute!" (If there isn't such a thing as a "too" of emphasis versus a "too" of addition, well, there should be!)