If you are broadcasting live, or want to make it seem like you are live, go ahead and leave it. But if I'm doing a pre-recorded segment that is important I'm editing it to make it sound polished and plush.
It's all about the intent.