[It's probably better to leave it - neither of them really need him going on some kind of dumb tirade that he only half believes.
And besides -
He lets out a little sigh of relief hearing how she responds, anyway.]

Good - good. I do worry, sometimes... I know that the delivery of my jokes can often sound too, ah...
Serious.

I would hate to have a joke miss and harm you, instead.