I have often Heard many times Non-believers using the Bible and quoting the Scriptures (See Below)?

Great question! Christians should never turn a blind eye to another Christian who's living in sin. But, like Jesus, we should remember to be compionate, and forgiving of one another, just as in Christ God also forgave us (Ephesians 4:32).