We try our best, and we do care for him. But it's not the same as actual family being there for him.

Even if your opinion on what you yourself can do.
I understand it's not as straightforward with you two. As long as you try, that should be enough.