You are jumping to the worst case scenario when it is probably nothing sinister at all. I had a similar scare and mine was benign. Lumps in breasts are quite common and most times end up to be nothing serious. If your doctor says he doesn't think it is anything to worry about then I am sure he will be right.