The song describes Smith's father walking out on him when he was a young boy — and how that impacted the singer in the long run ...