I suppose it's just the knowing that someone is there actually in the same space as you? Maybe you could re evaluate mentally the significance of them being there? It sounds as though they aren't there for you emotionally so what purpose do they serve in terms of managing your anxiety?