high_scalability high_scalability-2008 high_scalability-2008-447 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? How is it possible to compete with the big players like Google? Can you just use a CDN and scale efficiently? Would Amazon's cloud services be a viable platform for high-definition video streaming?
sentIndex sentText sentNum sentScore
1 How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . [sent-1, score-0.863]
2 What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? [sent-2, score-0.386]
3 How is it possible to compete with the big players like Google? [sent-3, score-0.574]
4 Would Amazon's cloud services be a viable platform for high-definition video streaming? [sent-5, score-0.667]
wordName wordTfidf (topN-words)
[('sd', 0.366), ('iplayer', 0.344), ('theyoutube', 0.344), ('bbc', 0.307), ('hd', 0.273), ('video', 0.232), ('viable', 0.204), ('players', 0.198), ('compete', 0.195), ('digital', 0.172), ('streaming', 0.15), ('architect', 0.147), ('cdn', 0.143), ('lessons', 0.135), ('efficiently', 0.134), ('delivery', 0.133), ('section', 0.128), ('learned', 0.125), ('consider', 0.121), ('implement', 0.119), ('internet', 0.101), ('platform', 0.099), ('would', 0.094), ('top', 0.094), ('possible', 0.086), ('amazon', 0.079), ('google', 0.077), ('services', 0.072), ('big', 0.064), ('cloud', 0.06), ('scale', 0.051), ('need', 0.043), ('system', 0.037), ('use', 0.032), ('like', 0.031)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 447 high scalability-2008-11-19-High Definition Video Delivery on the Web?
Introduction: How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? How is it possible to compete with the big players like Google? Can you just use a CDN and scale efficiently? Would Amazon's cloud services be a viable platform for high-definition video streaming?
2 0.20209405 908 high scalability-2010-09-28-6 Strategies for Scaling BBC iPlayer
Introduction: The BBC's iPlayer site averages 8 million page views a day for 1.3 million users. Technical Architect Simon Frost describes how they scaled their site in Scaling the BBC iPlayer to handle demand : Use frameworks . Frameworks support component based development which makes it convenient for team development, but can introduce delays that have to be minimized. Zend/PHP is used because it supports components and is easy to recruit for. MySQL is used for program metadata. CouchDB is used for key-value access for fast read/write of user-focused data. Prove architecture before building it . Eliminate guesswork by coming up with alternate architectures and create prototypes to determine which option works best. Balance performance with factors like ease of development. Cache a lot . Data is cached in memcached for a few seconds to minutes. Short cache invalidation periods keep the data up to date for the users, but even these short periods make a huge difference in performance.
3 0.19122326 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
4 0.15033254 576 high scalability-2009-04-21-What CDN would you recommend?
Introduction: Update 10: The Value of CDNs by Mike Axelrod of Google. Google implements a distributed content cache from within large ISPs . This allows them to serve content from the edge of the network and save bandwidth on the ISPs backbone. Update 9: Just Jump: Start using Clouds and CDNs . Bob Buffone gives a really nice and practical tutorial of how to use CloudFront as your CDN. Update 8: Akamai’s Services Become Affordable for Anyone! Blazing Web Site Performance by Distribution Cloud . Distribution Cloud starts at $150 per month for access to the best content distribution network in the world and the leader of Content Distribution Networks. Update 7: Where Amazon’s Data Centers Are Located , Expanding the Cloud: Amazon CloudFront . Why Amazon's CDN Offering Is No Threat To Akamai, Limelight or CDN Pricing . Amazon has launched their CDN with "“low latency, high data transfer speeds, and no commitments.” The perfect relationship for many. The m
5 0.14636511 239 high scalability-2008-02-04-Streaming Video on Amazon EC2?
Introduction: An Amazon EC2 Flash Video Streaming solution has been announced by Wowza Media. What do you think about the future of similar solutions? Is Amazon EC2 and S3 ready for video streaming? I have found threads on their forums related to the performance, scalability and high availability of the hosted streaming solution. How would you make it scalable? Is it really cheaper than traditional hosting? Looking forward to your thoughts!
6 0.1405734 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
7 0.13956106 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
8 0.12588963 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
9 0.12168225 560 high scalability-2009-04-08-Learned lessons from the largest player (Flickr, YouTube, Google, etc)
10 0.11124296 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
11 0.10975716 274 high scalability-2008-03-12-YouTube Architecture
12 0.099064529 382 high scalability-2008-09-09-Content Delivery Networks (CDN) – a comprehensive list of providers
13 0.092807576 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
14 0.090333119 856 high scalability-2010-07-12-Creating Scalable Digital Libraries
15 0.088237949 198 high scalability-2008-01-01-HOW CDN works
16 0.085672416 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
17 0.083086237 903 high scalability-2010-09-17-Hot Scalability Links For Sep 17, 2010
18 0.081670761 422 high scalability-2008-10-17-Scaling Spam Eradication Using Purposeful Games: Die Spammer Die!
19 0.074996836 450 high scalability-2008-11-24-Scalability Perspectives #3: Marc Andreessen – Internet Platforms
20 0.074065186 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
topicId topicWeight
[(0, 0.092), (1, 0.028), (2, 0.006), (3, 0.027), (4, -0.057), (5, -0.093), (6, -0.06), (7, -0.006), (8, 0.044), (9, 0.033), (10, 0.014), (11, -0.061), (12, -0.081), (13, -0.018), (14, 0.013), (15, 0.058), (16, -0.001), (17, 0.03), (18, -0.032), (19, -0.113), (20, -0.018), (21, -0.002), (22, 0.065), (23, 0.034), (24, -0.01), (25, 0.05), (26, 0.038), (27, 0.02), (28, 0.08), (29, 0.087), (30, -0.001), (31, -0.038), (32, 0.031), (33, -0.054), (34, 0.036), (35, -0.001), (36, -0.038), (37, -0.11), (38, 0.056), (39, 0.071), (40, 0.062), (41, -0.004), (42, -0.028), (43, -0.004), (44, 0.045), (45, -0.026), (46, 0.005), (47, 0.008), (48, 0.039), (49, 0.016)]
simIndex simValue blogId blogTitle
same-blog 1 0.96074474 447 high scalability-2008-11-19-High Definition Video Delivery on the Web?
Introduction: How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? How is it possible to compete with the big players like Google? Can you just use a CDN and scale efficiently? Would Amazon's cloud services be a viable platform for high-definition video streaming?
2 0.85416561 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
3 0.84040982 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
Introduction: Limelight says 95% of Mobile Video Views Take Place in First 90 Days and 88.8 percent of views take place in the first 30 days. Since a lot of people are working with video, which is expensive to store and serve, the implication: there's little need to keep your video close to the user or on a CDN after 30 days.
4 0.75767982 239 high scalability-2008-02-04-Streaming Video on Amazon EC2?
Introduction: An Amazon EC2 Flash Video Streaming solution has been announced by Wowza Media. What do you think about the future of similar solutions? Is Amazon EC2 and S3 ready for video streaming? I have found threads on their forums related to the performance, scalability and high availability of the hosted streaming solution. How would you make it scalable? Is it really cheaper than traditional hosting? Looking forward to your thoughts!
5 0.73920822 576 high scalability-2009-04-21-What CDN would you recommend?
Introduction: Update 10: The Value of CDNs by Mike Axelrod of Google. Google implements a distributed content cache from within large ISPs . This allows them to serve content from the edge of the network and save bandwidth on the ISPs backbone. Update 9: Just Jump: Start using Clouds and CDNs . Bob Buffone gives a really nice and practical tutorial of how to use CloudFront as your CDN. Update 8: Akamai’s Services Become Affordable for Anyone! Blazing Web Site Performance by Distribution Cloud . Distribution Cloud starts at $150 per month for access to the best content distribution network in the world and the leader of Content Distribution Networks. Update 7: Where Amazon’s Data Centers Are Located , Expanding the Cloud: Amazon CloudFront . Why Amazon's CDN Offering Is No Threat To Akamai, Limelight or CDN Pricing . Amazon has launched their CDN with "“low latency, high data transfer speeds, and no commitments.” The perfect relationship for many. The m
6 0.68754405 198 high scalability-2008-01-01-HOW CDN works
7 0.68320328 294 high scalability-2008-04-01-How to update video views count effectively?
8 0.68075216 60 high scalability-2007-08-07-Can you profit from the coming Content Delivery Network wars?
9 0.6567865 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
10 0.65350187 39 high scalability-2007-07-30-Product: Akamai
11 0.64259082 123 high scalability-2007-10-15-Olympic Site Architecture
12 0.63050139 1100 high scalability-2011-08-18-Paper: The Akamai Network - 61,000 servers, 1,000 networks, 70 countries
13 0.62986177 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
14 0.62868655 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
15 0.60595989 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
16 0.58497459 274 high scalability-2008-03-12-YouTube Architecture
17 0.58380002 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
18 0.57456589 267 high scalability-2008-03-05-Oprah is the Real Social Network
19 0.53562611 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
topicId topicWeight
[(1, 0.144), (79, 0.134), (85, 0.56)]
simIndex simValue blogId blogTitle
1 0.85819137 59 high scalability-2007-08-04-Try Squid as a Reverse Proxy
Introduction: This scalability strategy is brought to you by Erik Osterman: My recommendations for anyone dealing with explosive growth on a limited budget with lots of cachable content (e.g. content capable of returning valid expiration headers) is employ a reverse proxy as mentioned in this article. In the last week, we had a site get AP'd, triggering 100K unique visitors to a single IIS server in under 5 hours. It took out the IIS server. Placing a single squid infront of the server handled the entire onslaught with a max server load of 0.10 on a modest Intel IV 3Ghz. It's trivial to implement for anyone interested...
same-blog 2 0.85578299 447 high scalability-2008-11-19-High Definition Video Delivery on the Web?
Introduction: How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? How is it possible to compete with the big players like Google? Can you just use a CDN and scale efficiently? Would Amazon's cloud services be a viable platform for high-definition video streaming?
3 0.84885526 1049 high scalability-2011-05-31-Awesome List of Advanced Distributed Systems Papers
Introduction: As part of Dr. Indranil Gupta 's CS 525 Spring 2011 Advanced Distributed Systems class, he has collected an incredible list of resources on distributed systems . His research group is also doing some interesting work. The various topics include: Before there Were Clouds, Cloud Computing, P2P Systems, Basic Distributed Computing Concepts, Sensor Networks, Overlays and DHTs, Cloud Programming, Cloud Scheduling, Key-Value Stores, Storage, Sensor Net Routing, Geo-Distribution, P2P Apps, In-network processing, Epidemics, Probabilistic Membership Protocols, Distributed Monitoring and Management, Publish-Subscribe/CDNs, Measurement Studies, Old Wine: Stale or Vintage?, In Byzantium, Cloud Pricing, Other Industrial Systems, Structure of Networks, Completing the Circle, Green Clouds, Distributed Debugging, Flash!, The Middle or the End?, Availability-Aware Systems, Design Methodologies, Handling Stress, Sources of unreliability in networks, Handling Stress, Selfish algorithms, Securi
4 0.81626731 191 high scalability-2007-12-23-Synchronizing Memcached application
Introduction: I have an application with couple of web servers that uses MemcacheD. How can i synchronize concurrent put to the cache? The value of the entry is list. Atomic append operation could have been helpful, but unfortunately memcahe doesn't support atomic append.
5 0.8000381 143 high scalability-2007-11-06-Product: ChironFS
Introduction: If you are trying to create highly available file systems, especially across data centers, then ChironFS is one potential solution. It's relatively new, so there aren't lots of experience reports, but it looks worth considering. What is ChironFS and how does it work? Adapted from the ChironFS website: The Chiron Filesystem is a Fuse based filesystem that frees you from single points of failure. It's main purpose is to guarantee filesystem availability using replication. But it isn't a RAID implementation. RAID replicates DEVICES not FILESYSTEMS. Why not just use RAID over some network block device? Because it is a block device and if one server mounts that device in RW mode, no other server will be able to mount it in RW mode. Any real network may have many servers and offer a variety of services. Keeping everything running can become a real nightmare!
6 0.79792082 102 high scalability-2007-09-27-Product: Sequoia Database Clustering Technology
7 0.7740047 820 high scalability-2010-05-03-100 Node Hazelcast cluster on Amazon EC2
8 0.74298561 1039 high scalability-2011-05-12-Paper: Mind the Gap: Reconnecting Architecture and OS Research
9 0.73948187 646 high scalability-2009-07-01-Podcast about Facebook's Cassandra Project and the New Wave of Distributed Databases
10 0.67286897 492 high scalability-2009-01-16-Database Sharding for startups
11 0.67122364 1500 high scalability-2013-08-12-100 Curse Free Lessons from Gordon Ramsay on Building Great Software
12 0.65830994 1032 high scalability-2011-05-02-Stack Overflow Makes Slow Pages 100x Faster by Simple SQL Tuning
13 0.6397118 53 high scalability-2007-08-01-Product: MogileFS
14 0.63370091 1577 high scalability-2014-01-13-NYTimes Architecture: No Head, No Master, No Single Point of Failure
15 0.62643701 1239 high scalability-2012-05-04-Stuff The Internet Says On Scalability For May 4, 2012
16 0.61766303 1024 high scalability-2011-04-15-Stuff The Internet Says On Scalability For April 15, 2011
17 0.60910392 118 high scalability-2007-10-09-High Load on production Webservers after Sourcecode sync
18 0.6038481 1164 high scalability-2011-12-27-PlentyOfFish Update - 6 Billion Pageviews and 32 Billion Images a Month
19 0.58910686 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
20 0.56454563 133 high scalability-2007-10-26-How Gravatar scales on WordPress.com hardware