To get a good summary of the concerns around EDCs (endocrine disrupting chemicals), see this fact sheet put out by the UN Environmental Programme and the World Health Organization.
This short article links to their lengthy report State of the Science of Endocrine Disrupting Chemicals, and to their Summary for Decision Makers.