"He was booed on the course and a spectator threw urine at him. I didn't see it but you could smell it on his jersey. You could think Mark was angry, but he was actually disappointed," team manager Patrick Lefevere told reporters.
The Briton's Omega Pharma-Quick Step team mate Jerome Pineau wrote on Twitter:
Cavendish declined to comment on the incident which occurred a day after he bumped into Dutch rider Tom Veelers, who lost his balance and hit the ground, in the home straight on the 10th stage.
Cavendish was cleared of any wrongdoing by the race commissaries.
Bopanna up to career-best No 5 after stupendous Wimbledon run
Greipel sprints to Tour stage win, Impey takes yellow
Contador down as Kittel wins chaotic Tour start
Indian markets hammered in FII sell-off
PHOTOS: The Tour De France for beginners