I don't know if it's a bad habit, but you may want to write down stuff that pertains to you, or what you could do is what I do, which is bring in an audio recording device (iTouch in my case) and record the conversation, then go back and take notes to what I deem is important at your own convince later that day, or week if need be.
What I do though is if someone has schematics or concepts that are written down on the whiteboard, I record those so that the audio makes more sense later on.