Good work with the mild soap and the moisturizer; both should help alleviate your chicken skin (formally called keratosis pilaris). But don't you hate it when a problem persists even though you do the right thing to treat it? 

Cold, dry winter air or dry heat indoors may be partly to blame for your worsening condition. Be sure you moisturize damp skin immediately after showering or bathing, says Howard Sobel, MD, director of the New York Institute of Aesthetic Dermatology and Laser Surgery. Read more here: