October 10, 2005
On Thursday, I jumped in to a bloggic discussion of the tradeoffs between centrally-controlled and peer-to-peer design strategies in distributed systems. (See posts by Randy Picker (with comments from Tim Wu and others), Lior Strahilevitz, me, and Randy Picker again.)
We’ve agreed, I think, that large-scale online services will be designed as distributed systems, and the basic design choice is between a centrally-controlled design, where most of the work is done by machines owned by a single entity, and a peer-to-peer design, where most of the work is done by end users’ machines. Google is a typical centrally-controlled design. BitTorrent is a typical P2P design.
The question in play at this point is when the P2P design strategy has a legitimate justification. Which justifications are “legitimate”? This is a deep question in general, but for our purposes it’s enough to say that improving technical or economic efficiency is a legitimate justification, but frustrating enforcement of copyright is not. Actions that have legitimate justifications may also have harmful side-effects. For now I’ll leave aside the question of how to account for such side-effects, focusing instead on the more basic question of when there is a legitimate justification at all.
Which design is more efficient? Compared to central control, P2P has both disadvantages and advantages. The main disadvantage is that in a P2P design, the computers participating in the system are owned by people who have differing incentives, so they cannot necessarily be trusted to work toward the common good of the system. For example, users may disconnect their machines when they’re not using the system, or they may “leech” off the system by using the services of others but refusing to provide services. It’s generally harder to design a protocol when you don’t trust the participants to play by the protocol’s rules.
On the other hand, P2P designs have three main efficiency advantages. First, they use cheaper resources. Users pay about the same price per unit of computing and storage as a central provider would pay. But the users’ machines a sunk cost — they’re already bought and paid for, and they’re mostly sitting idle. The incremental cost of assigning work to one of these machines is nearly zero. But in a centrally controlled system, new machines must be bought, and reserved for use in providing the service.
Second, P2P deals more efficiently with fluctuations in workload. The traffic in an online system varies a lot, and sometimes unpredictably. If you’re building a centrally-controlled system, you have to make sure that extra resources are available to handle surges in traffic; and that costs money. P2P, on the other hand, has the useful property that whenever you have more users, you have more users’ computers (and network connections) to put to work. The system’s capacity grows automatically whenever more capacity is needed, so you don’t have to pay extra for surge-handling capacity.
Third, P2P allows users to subsidize the cost of running the system, by having their computers do some of the work. In theory, users could subsidize a centrally-controlled system by paying money to the system operator. But in practice, monetary transfers can bring significant transaction costs. It can be cheaper for users to provide the subsidy in the form of computing cycles than in the form of cash. (A full discussion of this transaction cost issue would require more space — maybe I’ll blog about it someday — but it should be clear that P2P can reduce transaction costs at least sometimes.)
Of course, this doesn’t prove that P2P is always better, or that any particular P2P design in use today is motivated only by efficiency considerations. What it does show, I think, is that the relative efficiency of centrally-controlled and P2P designs is a complex and case-specific question, so that P2P designs should not be reflexively labeled as illegitimate.
Originally posted by Edward W. Felten from Freedom to Tinker, remediated by yatta on Oct 10, 2005 at 11:45 PM
|
unmediated.av:
The Weekly Show

drawing from extrastruggle.
We've been having a back channel conversation amongst the trackers at unmediated about how/whether to update the way in which we aggregate, present, and make useable the content on the site, in light of all the various aggregators, digg and its clones, and role model group blog sites that we all consume/use/hate/love. Since we all primarily support open media movements and the freedom of bits and so forth, and with all of us being busy with our primary projects, we are looking for ways to make getting content on the site easier and more streamlined, while making it obvious that we are presenting other sources content. With the availability of open API's for just about any type of media aggegration literally getting past the saturation point, and mashups taking every possible form, we are wondering, is it time to take a step back, or a step forward with how/what we do at umediated? In the course of my surfing today, i found this new site, Boxxet Which just might be the straw that breaks the camel's back in how we all perceive the current mix and match nature of the web as it now stands. What's different about Boxxet from other aggregators and mashups like the newest entry popurls, (which aggregates digg, slashdot, reddit, newsvine, tailrank, and flickr) is that Boxxet is a Website generator. Thats right, just pop in all the urls u want to aggregate (and WHAT from them) choose how u want to format it, plug in the url that u want it to be accessed at... and whammo: Your own site with everyone elses content, and all thats left to do is decide whether googleplex or yahooza is going to be the source of your linklove revenue. And if u have on older domain that u plug this into...well, we all know how the pageranking with search engines work by now. It used to be that u had to have a bit of code knowledge to make all this stuff work. Eyebeam's Re-blog engine which powers this site was not a simple undertaking at the time that Michael Frumin and Michael Migurski put it all together... a half a year before Marc Broadband-mechanicked the term Reblog as his latest buzzword before casting his attention on the ourmedia-meme. (kudo's, kudo's) But now, with the cut and paste mentality of webculture that we at unmediated have helped create, the pace at which people are remixing and repurposing code is accelerating at a rate similar to the curve that we saw with pro-sumer desktop video... almost anyone can do it. I have this sinking feeling in my gut that we will arrive sooner than later at the same existential threshold that the film studios and record labels are squirming under to our joyful cries of "die, dinosaurs, die!". What i am wondering, is how long until my hero of the open-information movement, Cory Doctorow, and the rest of our pals at BB will tolerate re-aggregation and repurposing of his content, (now that he is investing so much more time at the site) before he (or any of one us) screams, "FOUL!" Stewart Butterfield over at Flickr is dealing with this beast at the moment...and i have to admire the dryness with which he states, "I loaded the FlickrCentral pool and firefox got up to using 240mb of ram before dying. So that's not a great user experience, but it's really terrible for Flickr. If it catches on and you don't limit it, we'll have to cut you off :\" Sure, Stewart, blame it on the user experience and firefox. ;) I admire your candor, and personal attention/approach to what has become one of the hottest new BRANDS in Web 2.0 ...that u still have time to be personal and all flickr-fuzzy even after being acquired, but I am sure that your jeans feel like they're fitting a bit tighter all of a sudden. Pretty soon, I expect, a lot of us bell-bottomed infornistas are going to wake up in a similar pair of Jordaches. I'm curious which of us will cut the inseams and sew in another totally different material to keep our style,and which of us will claim that now that we're wearing skintight jeans ("they're really really comfortable...REALLY! You think i should get a pair of Reeboks to go with 'em?"), that the manufacture of bell-bottoms should be forbidden. I point this all out in good humour only to illustrate a point: The times, they are('nt) a changin'>, and Cory just might wake up one day soon in his magic kingdom, and say "Hey, man, where'd all my whuffie go? And he's going to have no choice but to join Walt's pinstripesuits in pushing for copyright extension. It's a pill i hope he (and we) never have to swallow. So i pose the question to our community readers: How do you see unmediated-Are we crossing the boundaries in how we repurpose content? Would you like to see more editorializing? Narrower/Broader scope? Are we a repository of information that you come back to use, or just part of your daily information addiction? Let us know... I, for one, would like to have an idea about what pair of jeans to wear this year ;) michael
Featured Project
Berkeley Conference: Online Video and the Future of Television - Friday, September 30, 2005
This one-day conference brings together archivists, educators, technologists, entrepreneurs, producers, legal experts, and investors to explore the enormous promise offered by the availability of online video and television content. Demonstrations and interactive panel discussions will highlight new video technologies, services, legal issues, and economic models. Participants from diverse – and until now, largely disconnected – specialties will be especially encouraged to interact.
del.icio.us/tag/unmediated
[+]
About unmediated
unmediated is a group blog that tracks the tools, processes,
and ideas being used to decentralize media production and distribution.
|
flickr/tag/
citizenmedia
[+]
|