The reason pedants get on people’s nerves is because language is supposed to be about communication. Of course, you could nitpick what people are saying, but that is just annoying. Try to understand what someone is trying to say, and if you must, only talk about the grammar mistake or misunderstanding afterwards.