If the two cups are the same/equal in all regards the spoon makes the difference in heat loss.  Metal spoon is a good conductor, heat conducts up the spoon handle.  Radiant and convection losses occur in the surrounding air.  Metal becomes a “heat sink”.  
Spoon will feel warmer to the touch than a pottery or foam cup that is not a good conductor.