If you write down every single point, it can create the impression that you do not understand the subject under discussion enough to identify the key points. It can also simply be irritating or perturbing, as colleagues wonder what you are writing.
If your work usis of good quality, it shouldn't matter. Even so, it can take a long time to correct any first impressions made on your colleagues.
Can you still remember by just writing down single keywords and then reading through them afterwards and reflecting on you just heard? If so, it might be something to try.