Combine the cocoa, sugar, water, and salt in a medium saucepan.
Over medium heat, stir constantly until the mixture boils. Cook, stirring constantly for 1 minute.
Stir in the milk and heat, but do not boil.
Remove from the heat and add vanilla; stir well. Serve immediately.