A human solution to the problem of cooperation is the maintenance of informal reputation hierarchies. Reputational information contributes to cooperation by providing guidelines about previous group-beneficial or free-rider behaviour in social dilemma interactions. How reputation information could be credible, however, remains a puzzle. We test two potential safeguards to ensure credibility: (i) reputation is a scarce resource and (ii) it is not earned for direct benefits. We test these solutions in a laboratory experiment in which participants played two-person Prisoner's Dilemma games without partner selection, could observe some other interactions, and could communicate reputational information about possible opponents to each other. Reputational information clearly influenced cooperation decisions. Although cooperation was not sustained at a high level in any of the conditions, the possibility of exchanging third-party information was able to temporarily increase the level of strategic cooperation when reputation was a scarce resource and reputational scores were directly translated into monetary benefits. We found that competition for monetary rewards or unrestricted non-monetary reputational rewards helped the reputation system to be informative. Finally, we found that high reputational scores are reinforced further as they are rewarded with positive messages, and positive gossip was leading to higher reputations.