First, get rid of any product that irritates your skin. Sometimes strong products are fine for a short-term use, but when time passes they can start acting agaisnt you, depending on your skin type.
Once this is done, cleanse. Avoid the extra oil by cleansing properly and removing any buildup or dirt. Choose the right cleanser for your skin type and wash your face properly (luckily, we have a post about that and you can check it our here (LINK)!) and avoid soap or scrubs.