Thursday, June 11, 2009

clouds and peer-to-peer

We've been asked a few times about the relationship between clouds and peer-to-peer systems, and we wanted to take this opportunity to respond.

Definitions
We differentiate between peer-to-peer (p2p) techniques and p2p systems. The former refers to a set of techniques for building self-organizing distributed systems. These techniques are often useful in building datacenter-scale applications, including datacenter-scale applications that are hosted in the cloud. For instance, Amazon's Dynamo datastore relies on a structured peer-to-peer overlay, as do several other key-value stores.

People often use "P2P" to refer to systems that use these techniques to organize large numbers of cooperating end hosts (peers) such as personal computers and settop boxes. In these systems, most peers necessarily communicate using the Internet, rather than a local area network (LAN). To date, the most successful peer-to-peer applications have been file sharing (e.g., Napster, BitTorrent, eDonkey), communication (Skype). and embarrassing parallel computations, such as SETI@home and BOINC projects.

Limitations
The main appeal of p2p systems is that their resources are often "free", coming from individuals which volunteer their machines' CPUs, storage, and bandwidth. Offsetting this, we see two key limitations of P2P systems.

First, p2p systems lack a centralized administrative entity that owns and controls the peer resources. This makes it hard to ensure high levels of availability and performance. Users are free to disable the peer-to-peer application or reboot their machine, so a great degree of redundancy is required. This makes p2p systems a poor fit for applications requiring reliability, such as web hosting, or other sorts of server applications.

This decentralized control also limits trust. Users can inspect the memory and storage of a running application, meaning that applications cannot safely store confidential information unencrypted on peers. Nor can the application developer count on any particular quantity of resources being dedicated on a machine, or on any particular reliability of storage. These obstacles have made it difficult to monetize p2p services. It should come as no surprise that, so far, the most successful p2p applications have been free, with Skype being a notable exception.

Second, the connectivity between any two peers in the wide area is two or three order of magnitude lower than between two nodes in a datacenter. Residential connectivity in US is typically 1Mbps or less, while in a datacenter a node can often push up to 1Gbps. This makes p2p systems inappropriate for data intensive applications (e.g., data mining, indexing, search), which accounts for a large chunk of the workload in today's datacenters.

Opportunities
Recently, there have been promising efforts to address some of the limitations of p2p systems by building hybrid systems. The most popular examples are data delivery systems, such as Pando and Abcast, where p2p systems are complemented by traditional Content Distribution Systems (CDNs). CDNs are used to ensure availability and performance when the data is not found at peers, or/and peers do not have enough aggregate bandwidth to sustain the demand.

In another development, cable operators and video distributors have started to test with turning the set top boxes into peers. The advantage of settop boxes is that, unlike personal computers, they are always on, and they can be much easily managed remotely. Examples in this category are Vudu, and the European NanoDataCenter effort. However, to date, the applications of choice in the context of these efforts have still remained file sharing and video delivery.

Datacenter clouds and p2p systems are not a substitute for each other. Widely distributed peers may have more aggregate resources, but they lack the reliability and high interconnection bandwidth offered by datacenters. As a result, cloud-hosting and p2p systems complement each other. We expect that in the future more and more applications will span both the cloud and the edge. Examples of such applications are:

  • Data and video delivery. For highly popular content, p2p distribution can eliminate the network bottlenecks by pushing the distribution at the edge. As an example, consider a live event such as the presidential inauguration. With traditional CDNs, every viewer on a local area network would receive an independent stream, which could lead to choking the incoming link. With p2p, only one viewer on the network needs to receive the stream; the stream can be then redistributed to other viewers using p2p techniques.
  • Distributed applications that require a high level of interactivity, such as massive multi player games, video conferences, and IP telephony. To minimize latency, in these applications peers communicate with each other directly, rather than through a central server.
  • Applications that request massive computation per user, such as video editing and real-time translation. Such applications may take advantage of the vast amount of computation resources of the user's machine. Today, virtually every notebook and personal computer has a multi-core processor which are mostly unused. Proposals, such as Google's Native Client aim to tap into these resources.

101 comments:

  1. There was an interesting talk at the HotCloud workshop yesterday on bridging these two ideas to make "volunteer clouds".

    Nebulas: Using Distributed Voluntary Resources to Build Clouds, Abhishek Chandra and Jon Weissman

    Some other interesting talks:
    Hot Cloud 09

    ReplyDelete
    Replies
    1. Thanks combination of suitable and useful information and well-written sentences that will certainly entice your sense.There are so multiple comments here that are really entertaining and conducive to me thanks for sharing a link especially for sharing this blog. Judi Bola

      Delete
  2. Identity management is also a potential significant application for P2P.

    ReplyDelete
    Replies
    1. Thanks for the cool information shared on cloud computing. I am gathering information about it.Useful information has been given about the cloud computing. Thanks for the information.bola tangkas asia, 338a casino

      Delete
  3. In a P2P world a user retains control of their credentials and provides these directly to others as required.

    ReplyDelete
  4. Didn't know about the limitiations of residential connectivity. Interesting stuff.

    ReplyDelete
    Replies
    1. An interesting discussion is worth comment. I think that you should write more on this topic, it might not be a taboo subject but generally people are not enough to speak on such topics. To the next. 338a terbaik

      Delete
  5. I'm curious what the poster meant by "embarrassing parallel computations, such as SETI@home and BOINC projects." They seem successful.

    ReplyDelete
  6. Interesting insights.

    Are those residential comms numbers real? Do they arise because of the distribution of performance (median << mean) or from asynchronous characteristics, or is the US just way behind the rest of the world in residential comms performance?

    Also, surely if the main constraint is bandwidth between peers over the interent, then the p2p apps will tend to migrate to the higher bandwidth hosts?

    ReplyDelete
    Replies
    1. This is the perfect blog for anyone who wants to know about this topic. You know so much its almost hard to argue with you (not that I really would want...HaHa). You definitely put a new spin on a subject thats been written about for years. Great stuff, just great!
      http://acmbet.net/bola-tangkas-baru/, http://arenaliga.com/338a-terbaik/

      Delete
  7. Interesting text. You have a nice blog. Keep it up!

    ReplyDelete
  8. This is a very detailed informational and educational post... I learned a very great deal from this peace... Sometime in the future, the clouds(location somewhere) will be where some parts of our lives are stored...

    __
    ParaSlim
    Acai Optimum

    ReplyDelete
  9. Great information provided. Thanks for that. By the way i had attended a conference previously. Its a Cloud Computing Virtual Conference 2009,Which is the global cloud computing event, covering latest trends and innovations in the world of cloud computing. It is the Annual Virtual Conference on Cloud Computing! It is hosted online March 23-25, 2009.

    ReplyDelete
  10. Excellent Information Shared. Cloud Computing is actually a great thing. I like to learn much about it. It is very important for my field, thats why I have planned to attend the Computing Conference which is going to be hosted online march 2010.

    ReplyDelete
  11. Nice blog,keep sharing with us, I look forward to your content

    www.chillyz.com

    ReplyDelete
  12. File sharing has its legitimate use as well. For example, media students need to transfer and share large files all the time. That is why private P2P based file sharing solutions for legitimate purposes, such as Binfer are gaining popularily. Binfer allows file sharing only with trusted friends and is not based on the torrent protocol. Check it out: http://www.binfer.com

    ReplyDelete
  13. The connectivity between any two peers in the wide area is two or three order of magnitude lower than between two nodes in a datacenter.
    operatore video

    ReplyDelete
  14. Really a very great information shared over here. By the way have you heard about Cloud Computing Virtual Conference 2009. It is the event covering latest trends and innovations and technologies of the Cloud Computing. Cloudslam09 conference is the 1st annual conference on cloud computing.

    ReplyDelete
  15. This comment has been removed by the author.

    ReplyDelete
  16. At the moment I am trying to learn the concept of cloud computing. Your article has provided me with a nice starting insight. I have found this site offering a free trial of services such as FTP server hosting, file sharing plug-ins for blogs, and cloud file storage. You may want to review their services. I, however, will give it a try in order for me to get a stronger and solid grasp of this wonderful concept of cloud computing.

    ReplyDelete
  17. Thanks for sharing.

    Tenax Technologies is a Belarussian software development company delivering complex web solutions. We provide comprehensive Java development of complex internet systems.
    software company

    ReplyDelete
  18. Thank you for such a fantastic blog. Where else could anyone get that kind of info written in such a perfect way? I have a presentation that I am presently working on, and I have been on the look out for such information.
    Antique Shopping Online

    ReplyDelete
  19. This comment has been removed by the author.

    ReplyDelete
  20. just wanna share that a good web hosting is a matter >>> javahostindo web hosting indonesia

    ReplyDelete
  21. In this era of blog ,we easily get nice & updated information for research purposes... I'd definitely appreciate the work of the said blog owner... Thanks!
    seo agency sydney

    ReplyDelete
  22. Excellent instruction this blog gives me and Well differentiate the blog owner between peer-to-peer (p2p) techniques and p2p systems. The former refers to a set of techniques for building self-organizing distributed systems. These techniques are often useful in building datacenter-scale applications, including datacenter-scale applications that are hosted in the cloud.
    Saint-Petersburg Hotels

    ReplyDelete
  23. Apple’s next generation handsets i.e. iphone 4S and iphone 5 will hit the stores this year....The Best Android

    ReplyDelete
  24. This is really great and informational blog with brilliant posts.

    ReplyDelete
  25. Centro Metro This is the perfect blog for anyone who wants to know about this topic. You know so much its almost hard to argue with you (not that I really would want...HaHa). You definitely put a new spin on a subject thats been written about for years. Great stuff, just great!

    ReplyDelete
  26. Such a wonderful post. I got useful info from this post. keep it up and thanks for sharing. :)

    3d ultrasounds | 4d ultrasounds

    ReplyDelete
  27. This is an excellent post I seen thanks to share it. It is really what I wanted to see hope in future you will continue for sharing such a excellent post. ~^- organic supplements -^~

    ReplyDelete
  28. This is such a terrific and useful topic that you’re shared with. I’m satisfied by the way you brought out ideas. Thanks for sharing.
    Best Graphic Design Site

    ReplyDelete
  29. asdadsad sandbnasbdbn
    asdjashjdk sadsadnmnm asnmdm sadkaskd asdasdkskad kata mutiara bahasa inggris dan zodiak terbaru hari ini paling mantab
    Kata Mutiara
    Zodiak Hari Ini
    sdadnhjkqwqw

    ReplyDelete
  30. Interesting post. I have been wondering about this issue, so thanks for posting.

    natural sleep aid | energy supplements | fast energy

    ReplyDelete
  31. Thank you for some other great article. The place else could anyone get that type of information in such a perfect approach of writing? I’ve a presentation subsequent week, and I’m at the search for such info.

    Sepeda Motor Injeksi Irit Harga Terbaik Cuma Honda :: Kata Mutiara :: Kata Bijak Persahabatan :: Kata Gokil :: Klasemen Liga Italia :: SMS Gokil :: Sepeda Motor Injeksi Irit Harga Terbaik Cuma Honda :: Zodiak :: Ramalan Jodoh :: Ramalan Cinta :: Ramalan Bintang :: Kata Mutiara :: Cerita Lucu :: Sepeda Motor Injeksi

    ReplyDelete
  32. I like your blog post. Keep on writing this type of great stuff. I'll make sure to follow up on your blog in the future.
    masters dissertation proposal

    ReplyDelete
  33. Thanks for posting this info. I just want to let you know that I just check out your site and I find it very interesting and informative. I can’t wait to read lots of your posts. Agen Judi Bola Sbobet Ibcbet

    ReplyDelete
  34. Thank you!, Lots of people have to be aware of the impact that’s being made towards the author of this blog.
    Marketing communication strategy | Advertising as profession in Estonia | Advertising professional in Estonia

    ReplyDelete
  35. To create a such kind of article is really amazing,I daily read your blogs and give my announcement for that here this article is too great and so entertaining. Judi Online

    ReplyDelete
  36. At TechTrendsIT we believe that Cloud Application Development Service will drive future technology strategy and help business grow effectively. We suggest and give a strong recommendation to our clients to consider a “cloud first policy” while designing and deploying web application and mobile applications.

    ReplyDelete
  37. Thanks for making the honest effort to discuss this. I feel very sturdy approximately it and wish to read more. If it’s OK, as you achieve more in depth knowledge, could you thoughts including extra articles very similar to this one with more information? It would be extremely useful and helpful for me and my friends. model rambut layer | gaya rambut wanita 2014 | model rambut wanita panjang lurus | cara membuat rambut tidak mengembang | model rambut wanita korea 2014 | model rambut cowok korea

    ReplyDelete
  38. This will likely almost certainly be rather beneficial for many of your job opportunities I want to you should not only with my blog site. Situs OLB365.COM AGEN JUDI BOLA ONLINE, AGEN JUDI CASINO ONLINE INDONESIA TERPERCAYA, Coba Indomasterbola.com Agen Judi Bola, Taruhan Bola Terbaik dan Terpercaya

    ReplyDelete
  39. Toko Alat Bantu Sex Meyediakan berbagai macam alat sex, yang dapat di manfaatkan untuk pria dan wanita dalam mencari kepuasan biologis.
    Alat Bantu Sex Wanita.
    Alat Bantu Sex pria.

    ReplyDelete
  40. Thanks for sharing this valuable post about the cloud and peer to peer.
    MS CRM Dynamics
    Cloud Computing SaaS

    ReplyDelete
  41. How i got my Desired Loan Amount from a Reliable Loan Company

    Am here to share my testimony what a Good trusted loan company did for me. My Names are NILSON WILLAIMS from United states of America and I’m a father of 4 kids and i lost my Job last year November 14th and things where very hard for me and my children,so I was online to seek for a loan and i fall in the hands of scam, i was scam over $6,000.00 dollars, all my access where taken away from me. all hope was lost and i and my kids where sleeping in the street on till one faithful day when i met this friend of my who introduced me to this honest company who helped me get a loan in less that 24 hours which was February 21th 2016 without any Daley, i will forever be grateful to MR MURILO MOORE, you can contact them via email: creditunionagency4@gmail.COM,they did not know am doing this for them, but i just have to do it because a lot of people are out there who are in need off a loan and they have been scammed like me please come to this company and be saved.
    creditunionagency4@gmail.COM
    Thanks.

    ReplyDelete
  42. I lately came accross your weblog site and have been studying along. I believed I would keep my first opinion. I don't know what to say except that I have experienced reading

    alternative vmware

    ReplyDelete
  43. Such a great article you have shared. I really liked this post. It is very informative blog for us. Thanks for sharing the nice and useful post with us.
    MPBSE 12th Result 2018

    ReplyDelete
  44. Nyccc article....It gives very useful information ....Thanx for sharing....
    Cloud Computing Training in Chandiogarh

    ReplyDelete



  45. Nice Blog. Thank you for sharing
    aws training in chennai

    ReplyDelete
  46. This post is really nice and informative. The explanation given is really comprehensive and informative..cloud computing training

    ReplyDelete
  47. Thanks for the great article this is very useful info thanks for the wornderful post,
    java software development company.

    ReplyDelete
  48. Good post. I was searched this topic. Finally I got the information in this blog. Thanks for posting such a nice article.
    Cloud Computing Service Providers
    Software Development Partnership

    ReplyDelete
  49. good article
    Yaaron Studios is one of the rapidly growing editing studios in Hyderabad. We are the best Video Editing services in Hyderabad. We provides best graphic works like logo reveals, corporate presentation Etc. And also we gives the best Outdoor/Indoor shoots and Ad Making services.

    Best video editing services in Hyderabad,ameerpet
    Best Graphic Designing services in Hyderabad,ameerpet­
    Best Ad Making services in Hyderabad,ameerpet­

    ReplyDelete
  50. Agen joker388 atau bandar joker388 merupakan perwakilan dari situs judi ikan online joker123 yang telah ditunjuk dan diberikan kepercayaan penuh untuk membantu member dalam melakukan daftar joker388, deposit account joker388, withdraw joker388, serta membantu member yang sudah memiliki ID tetapi kesulitan saat login ke slot joker388

    ReplyDelete
  51. Spesial untuk Pemula! Berikut Situs Judi Bola Resmi dengan Aman
    idn play poker online

    ReplyDelete
  52. Permisi teman teman semua

    Nonton Film Bioskop & Download Film Sub Indo >> Layarkaca 21, indoxxi, NontonIndo.

    Nonton Drakor & Download Drakor Sub Indo >> Layarkaca 21, indoxxi, NontonIndo.

    Cerita Sex
    Video Sex

    ReplyDelete
  53. - yo , Thank you a lot for making this website . I m into gambling niche and have found this website using search on google . Will be sure to share . I am affiliate and have found your site very informational Many thanks , see ya. :S 토토사이트검증

    ReplyDelete
  54. there are so many funny videos on the internet to watch, i can laugh all day watching funny videos’ 먹튀검증

    ReplyDelete
  55. You created some excellent tips at this time there. I did searching around the topic and discovered most everyone will recognize in your web site. 안전놀이터검증

    ReplyDelete
  56. After 20 years of working with Senior Executives across the world it's interesting to see the mistakes when appointing Senior Executives. There can be many reasons why, but one reason is not understanding the differences of working in a Family Business and a Non-Family Business. I've recently met several Senior Executives who are unhappy with their employment because of this lack of knowledge and understanding and I'm meeting Business owners who didn't realise there was a difference. These Business Owners feel that money and title is enough and stick to the Mantra of "Surely experienced 'C' level Executives can work in any company?" quitmasturbating

    ReplyDelete
  57. หลังคาเมทัลชีทเชียงใหม่ รับทำหลังคาเมทัลชีท หลังคาไวนิล กันสาด ทุกชนิด สำหรับเป็นหลังคาโรงรถ หลังคาหน้าบ้าน ในจังหวัดเชียงใหม่ หลังคาเมทัลชีทเชียงใหม่

    ReplyDelete
  58. 먹튀 can certainly present you with many choices that could lead to dismay. You don't have to let this come about. Just make a decision that you are going to accomplish particular targets in a manageable period of time and you may encounter the results you would like before you realize it. Everything advisable you finish requires a great amount of hard work. This, of course, likewise relates to 먹튀. In this topic, precisely what you can use to advance ahead is not really to work harder, yet to work better. For a further understanding of this specific topic, and much more methods for doing items, visit 먹튀검증. Here you will discover a lot of valuable facts to maneuver you ahead.
    mt-daisuki 먹튀

    ReplyDelete
  59. - yo , Thank you a lot for making this website .

    ALLBET
    Casino Deluxe

    ReplyDelete
  60. A chatbot development services is a product program for reproducing wise discussions with human utilizing rules or man-made brainpower. Clients connect with the Chatbot by means of conversational interface through composed or spoken content. Chatbots can live in informing stages like Slack, Facebook Chatbot app development company and Telegram and fill some needs – requesting items, thinking about climate and dealing with your fund in addition to other things. As a Chatbot companies in India advancement organization our competency let you find happiness in the hereafter by taking care of clients all the more intelligently to accomplish wanted outcome. We can streamline a large portion of your dreary undertakings, for example, voice Bot development services advancement and client service, our Chatbot developer online business advices and so on.

    ReplyDelete
  61. we wanted to take this opportunity to respond.


    AS Casino
    EVO Club

    ReplyDelete
  62. If you want to grow your business, we are providing top qualified MCA Leads in best prices.

    ReplyDelete
  63. Goassignmenthelp is a team of leading professional writers for Assignment Help economics assignment help to students all around the world. Contact us today for the Best Essay Writing Services at a very affordable price. Hire native seasoned experts at very affordable prices. We are the most reliable assignment helpers. We have gained our specialization after spending most of our time making ourselves perfect. We provide 100% plagiarism-free Assignment Writing Services. Our assignment helps developers accounting assignment help are experts in every marketing assignment help subject because of which they provide reliable services all over the world.

    ReplyDelete
  64. This post is genuinely incredible. I really like this post. It is remarkable among different posts that I have read in a long time. You shake for this alright post I have post which you can read to learn more about Audio to Text Converters. After spending couple of hours on research I have come to this article text to speech converter which you can happy read.

    ReplyDelete
  65. After reading your article, we are happy to inform you that it is very good. Your articles are great. Please keep them coming. You can read more about Fake Chat in our profile. If you're interested in some such topics, then visit Fake Whats App Chat Generator. We hope it will be useful to you.

    ReplyDelete
  66. I check out a whole lot of blog articles, but I never heard a subject like this. I Love this subject you made about the blog writer's container checklist I am sharing a very genuine post to read where you can get to know about ROBLOX music. Please refer article RBX codes.

    ReplyDelete
  67. This article discusses Image-based perforated pattern as an innovative way to improve and enhance the conventional perforated pattern that has been used widely in many area including architectural building. By using image-based perforated metal, architects and designer can have limitless idea for their own perforation project. In this article, several design consideration is also discussed in order to create elegant perforated pattern for any perforated metal projects. photobooth

    ReplyDelete
  68. This is the ideal site for anyone interested in learning more about this subject. It's almost impossible to disagree with you because you know so much (not that I really would want...HaHa). You definitely put a fresh spin on a topic that has been discussed for years. Great stuff, all of it!..
    Managex.ae

    ReplyDelete
  69. I think this is one of the most significant information for me.
    And i’m glad reading your article.
    But should remark on some general things, the web site style is perfect,
    wordpress Casino Online
    ufa88kh.blogspot Casino Online
    youtube Casino Online
    កាស៊ីណូអនឡាញ

    ReplyDelete
  70. I explore numerous blog articles, yet this subject stands out uniquely. I genuinely appreciate your take on the blog writer's checklist. Your insights are captivating. As a provider of website development company, we value original perspectives like yours. Looking forward to more captivating content from your platform

    ReplyDelete
  71. Are you ready to embark on a journey into the realm of cloud computing? Look no further than APTRON Solutions in Noida, where we offer a cutting-edge course designed to equip you with the skills needed to thrive in this dynamic industry. As businesses worldwide increasingly adopt cloud-based solutions, the demand for skilled professionals in Cloud Computing Course in Noida. With our comprehensive training program, you'll be prepared to meet this demand head-on and carve out a successful career path.

    ReplyDelete