Now, imagine a situation: Tyrion is born, Joanna dies but there is no dwarfism. Tyrion is your typical Lannister with golden hair, green eyes, great appearance and with functioning brain. Would Tywin "forgive" him easily, "love him" and put entire Lannister legacy and hope on his shoulder?