The clubs have until January 4 to answer the charges, relating to the October 27 match.
"Chelsea FC and West Ham United FC have been charged for the behaviour of their supporters," the FA announced on its website.
"The two clubs have been charged...for their alleged failure to ensure that spectators...conducted themselves in an orderly fashion and refrained from threatening and/or violent and/or provocative behaviour."