Only Fact Check, Never Explain