Perhaps the reason you feel guilty is...

Perhaps the reason you feel guilty is because you are guilty. The answer to your guilt problem is not rationalization or self-justification, but forgiveness. The price of forgiveness is repentance. Without it there is no forgiveness and no relief from the reality of guilt.