I don't know if it's a bad habit, but you may want to write down stuff that pertains to you, or what you could do is what I do, which is bring in an audio recording device (iTouch in my case) and record the conversation, then go back and take notes to what you deem is important at your own convince later that day, or week if need be. 

What I do though is if someone has schematics or concepts that are written down on the whiteboard, I record those so that the audio makes more sense later on.