This basic approach similar to this concept is already used online in a simpler manner that isn’t based on complex calculations. EBay allows shoppers to share their experiences so others can determine whether or not a seller is reliable and able to make good on their products or services. Couch Surfing doesn’t use calculations to report a user’s reputation, but transparency and references from other users are documented and available for review. Spam blockers have also been using this type of “digital reputation” in order to determine whether or not an email is spam.
Credit ratings are a similar concept that might make a good model to start some type of “Good Open Sourcekeeping Seal of Approval.” However; since one source might be a master at one topic or area of expertise, that same contributor could be unreliable in many other subjects, skills or abilities. A digital credibility rating needs to factor those variances in order to calibrate some type of score that fluctuates based on topic, purpose and objective. Registration and authentication would be required. A plug-in or some other type of application would need to track and measure that user’s contributions, collaborations and feedback in order to calculate and post scores.
Rather than being “driven by democracy,” open source sites would qualify and share contributions based on this type of digital reputation. Updates and revisions as well as overrides and objections would be automated and objectively calculated rather than based on popularity, politics or subjectivity.
UPDATE: The New York Times published an editorial the day after this posting regarding ways sites are addressing "trolls" who are abusing anonymity. Two specifics mentioned that are relevant to this topic.
One application used by Disqus allows ...
"users to rate one another’s comments and feed those ratings into a global reputation system called Clout. Moderators can use a commenter’s Clout score to 'help separate top commenters from trolls.'"
The editorial also describes an approach used by Gizmodo.
The technology blog Gizmodo is trying an audition system for new commenters, under which their first few comments would be approved by a moderator or a trusted commenter to ensure quality before anybody else could see them. After a successful audition, commenters can freely post. If over time they impress other trusted commenters with their contributions, they’d be promoted to trusted commenters, too, and their comments would henceforth be featured.
While these approaches focus on just "commenting," it illustrates there are opportunities to utilize this kind of concept to develop and track some type of "digital reputation" system.