When a person asks for forgiveness, it is not because you have not given it. It's because they still feel guilt. When a father asks to be forgiven for all that he has done wrong, it is a sign that he knows his faults are bigger than he can say. In a curious way, it is his way of admitting that he yearns for the connection in the same way you do, but somehow it never appears. There are too many roles that society gives humans that they are not always able to feel as their own. Father is certainly one big one. So just keep the channels open!