Could you tell me what this quote means? Mark Twain says it. "A sound heart..."?

"ill-trained conscience" is a reference to Twain's view of the education system. He is telling the listener to follow his heart rather than the whims of societal teaching.