Is it low enough down to be in the hair growth area? And do you shave the area? If you shave, perhaps it is an ingrowing hair or infection even?
It's one for a doctor though, although I'm not saying it's anything. It sounds like a cyst but with it reducing, maybe follicle related or even a pimple of some kind.