It's not that the father is afraid of loneliness, it's that the father is afraid of his loneliness.
He still has most of his life left, and he doesn't know if he will live it alone like this.
He knew his father's intentions, so he just smiled.
After all, there will never be a young man like that again.
I think this should be a HE story...?