Where does guilt come from?

One could say morals.

One could say learning about sin.

Worldly guilt allows one to uphold moral principles.

Godly guilt allows one to seek forgiveness and point towards His glory.

Seeking forgiveness and being restored to a God who loves those who call out Romans 3:21-25.