high_scalability high_scalability-2008 high_scalability-2008-198 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: All, I'm just new to this and have a basic understanding how CDN works? My questions are: 1. How does CDN sync data with web servers for video/images? If I have a user to upload a video to my site, will it get stored directly in CDN or it comes to my webserver first and then sync-ed with cache server? 2. How to have only the dynamic video/image delivered through CDN while the rest is served by a webserver? 3. How sync happens and who pays for the bandwidth for sync? I'd appreciate if someone could explain this. Regards, Janakan Rajendran
sentIndex sentText sentNum sentScore
1 All, I'm just new to this and have a basic understanding how CDN works? [sent-1, score-0.261]
2 How does CDN sync data with web servers for video/images? [sent-3, score-0.577]
3 If I have a user to upload a video to my site, will it get stored directly in CDN or it comes to my webserver first and then sync-ed with cache server? [sent-4, score-1.168]
4 How to have only the dynamic video/image delivered through CDN while the rest is served by a webserver? [sent-6, score-0.448]
5 How sync happens and who pays for the bandwidth for sync? [sent-8, score-0.859]
6 I'd appreciate if someone could explain this. [sent-9, score-0.471]
wordName wordTfidf (topN-words)
[('sync', 0.475), ('cdn', 0.465), ('webserver', 0.438), ('rajendran', 0.268), ('pays', 0.194), ('appreciate', 0.184), ('upload', 0.158), ('explain', 0.144), ('served', 0.131), ('delivered', 0.13), ('basic', 0.117), ('understanding', 0.115), ('happens', 0.108), ('questions', 0.105), ('rest', 0.101), ('someone', 0.095), ('video', 0.095), ('directly', 0.092), ('comes', 0.09), ('stored', 0.087), ('dynamic', 0.086), ('bandwidth', 0.082), ('works', 0.069), ('cache', 0.068), ('site', 0.062), ('user', 0.055), ('first', 0.049), ('could', 0.048), ('servers', 0.043), ('server', 0.04), ('web', 0.037), ('get', 0.036), ('new', 0.029), ('data', 0.022)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 198 high scalability-2008-01-01-HOW CDN works
Introduction: All, I'm just new to this and have a basic understanding how CDN works? My questions are: 1. How does CDN sync data with web servers for video/images? If I have a user to upload a video to my site, will it get stored directly in CDN or it comes to my webserver first and then sync-ed with cache server? 2. How to have only the dynamic video/image delivered through CDN while the rest is served by a webserver? 3. How sync happens and who pays for the bandwidth for sync? I'd appreciate if someone could explain this. Regards, Janakan Rajendran
2 0.23194592 1402 high scalability-2013-02-07-Ask HighScalability: Web asset server concept - 3rd party software available?
Introduction: We are serving dynamic (PHP) websites and their assets (JS/CSS/images/videos/binary downloads) via the same apache hosts. The static files are only being used as origins for CDN services used to distribute those files. Yet, in the current development-deploy pipeline, these files are checked into the same version control repositories as the code is. This is what we would like to change, for several reasons (decouple asset deployment from development & developers, lessen size of code repositories, etc.) My idea is to do the following: Set up a media server (cluster) which serves as an API (REST e.g.). You can PUT files to it, and get back the URL the file is available through from the public. In between input and output, the media service deals with everything that's necessary to serve the files: Upload them to the CDN, create the public URL, write the meta data to a (relational?) database, assign a version number... This API can be used by a) the application/website directly to provid
3 0.22083847 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
Introduction: This question is for all the gurus here. Please help this novice x I am starting a video sharing site like YouTube in India. I want to offer the best quality possible, at minimum cost. Nothing new about it, right? :). I have done some research on the dedicated hosting services and CDN services available and I have some basic knowledge on these. Following are my requirements 1) My budget is $500 to $1000 per month for hosting (including CDN if and as applicable). 2) I will need around 500GB of storage and 1TB per month of bandwidth in first 2-3 months and then about 10TB of storage and 5TB per month of bandwidth. And more ... depending on how big it gets (I can afford more when it gets big) 3) 90% of my viewers are in India. Other 10% are in US and UK. Based on the above, could you please answer my following questions? 1) Can I go with just a good dedicated server to start with and get a CDN service later on when the site gets big? Or do you think its wise
4 0.20478125 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
Introduction: CDNs ( content delivery networks ) are the secret shadow super powers behind the web and Dan Rayburn at streamingmedia.com is the go to investigative reporter for quality information on CDNs. Every year Dan has a Content Delivery Summit on all things CDN and those videos are now available . Dan also gives a kind of state of the industry talk where he does something wonderful, he gives real numbers and prices. Dan really knows his stuff and is an excellent speaker, so watch the video, but here’s my gloss on the state of the CDN so far this year: Massive growth . Large customers are expecting 126% growth in video traffic over last year; medium size customers are seeing 48% traffic growth, small sized customer are seeing 73.3% traffic growth. More traffic != More profit . Traffic growth doesn’t lead to more profit because the traffic growth is concentrated in larger customers that can make the best deals. Video takes up the largest amount of traffic on a
5 0.16585161 576 high scalability-2009-04-21-What CDN would you recommend?
Introduction: Update 10: The Value of CDNs by Mike Axelrod of Google. Google implements a distributed content cache from within large ISPs . This allows them to serve content from the edge of the network and save bandwidth on the ISPs backbone. Update 9: Just Jump: Start using Clouds and CDNs . Bob Buffone gives a really nice and practical tutorial of how to use CloudFront as your CDN. Update 8: Akamai’s Services Become Affordable for Anyone! Blazing Web Site Performance by Distribution Cloud . Distribution Cloud starts at $150 per month for access to the best content distribution network in the world and the leader of Content Distribution Networks. Update 7: Where Amazon’s Data Centers Are Located , Expanding the Cloud: Amazon CloudFront . Why Amazon's CDN Offering Is No Threat To Akamai, Limelight or CDN Pricing . Amazon has launched their CDN with "“low latency, high data transfer speeds, and no commitments.” The perfect relationship for many. The m
6 0.16536695 100 high scalability-2007-09-26-Use a CDN to Instantly Improve Your Website's Performance by 20% or More
7 0.16441765 1001 high scalability-2011-03-09-Google and Netflix Strategy: Use Partial Responses to Reduce Request Sizes
8 0.13336951 256 high scalability-2008-02-21-Tracking usage of public resources - throttling accesses per hour
9 0.13301289 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
10 0.12861875 204 high scalability-2008-01-08-Virus Scanning for Uploaded content
11 0.12786859 60 high scalability-2007-08-07-Can you profit from the coming Content Delivery Network wars?
12 0.12402537 382 high scalability-2008-09-09-Content Delivery Networks (CDN) – a comprehensive list of providers
13 0.119086 118 high scalability-2007-10-09-High Load on production Webservers after Sourcecode sync
14 0.11786912 665 high scalability-2009-07-29-Strategy: Let Google and Yahoo Host Your Ajax Library - For Free
15 0.11454332 226 high scalability-2008-01-28-DR-BC for web-DB servers
16 0.10953952 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
17 0.10758574 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
18 0.10655751 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
19 0.10579013 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
20 0.10406618 274 high scalability-2008-03-12-YouTube Architecture
topicId topicWeight
[(0, 0.084), (1, 0.024), (2, -0.032), (3, -0.108), (4, -0.06), (5, -0.075), (6, -0.048), (7, 0.02), (8, 0.002), (9, 0.051), (10, 0.004), (11, -0.089), (12, -0.1), (13, -0.04), (14, 0.042), (15, 0.067), (16, 0.012), (17, 0.059), (18, -0.061), (19, -0.146), (20, -0.07), (21, 0.007), (22, 0.079), (23, 0.029), (24, 0.002), (25, 0.034), (26, 0.057), (27, -0.037), (28, 0.101), (29, 0.054), (30, 0.02), (31, 0.034), (32, 0.014), (33, -0.0), (34, -0.019), (35, -0.016), (36, 0.03), (37, -0.066), (38, 0.023), (39, 0.03), (40, -0.035), (41, 0.027), (42, -0.008), (43, 0.007), (44, -0.004), (45, -0.052), (46, 0.011), (47, 0.056), (48, 0.008), (49, 0.015)]
simIndex simValue blogId blogTitle
same-blog 1 0.96888059 198 high scalability-2008-01-01-HOW CDN works
Introduction: All, I'm just new to this and have a basic understanding how CDN works? My questions are: 1. How does CDN sync data with web servers for video/images? If I have a user to upload a video to my site, will it get stored directly in CDN or it comes to my webserver first and then sync-ed with cache server? 2. How to have only the dynamic video/image delivered through CDN while the rest is served by a webserver? 3. How sync happens and who pays for the bandwidth for sync? I'd appreciate if someone could explain this. Regards, Janakan Rajendran
2 0.83340764 576 high scalability-2009-04-21-What CDN would you recommend?
Introduction: Update 10: The Value of CDNs by Mike Axelrod of Google. Google implements a distributed content cache from within large ISPs . This allows them to serve content from the edge of the network and save bandwidth on the ISPs backbone. Update 9: Just Jump: Start using Clouds and CDNs . Bob Buffone gives a really nice and practical tutorial of how to use CloudFront as your CDN. Update 8: Akamai’s Services Become Affordable for Anyone! Blazing Web Site Performance by Distribution Cloud . Distribution Cloud starts at $150 per month for access to the best content distribution network in the world and the leader of Content Distribution Networks. Update 7: Where Amazon’s Data Centers Are Located , Expanding the Cloud: Amazon CloudFront . Why Amazon's CDN Offering Is No Threat To Akamai, Limelight or CDN Pricing . Amazon has launched their CDN with "“low latency, high data transfer speeds, and no commitments.” The perfect relationship for many. The m
3 0.8195768 39 high scalability-2007-07-30-Product: Akamai
Introduction: Akamai transparently mirrors content (usually media objects such as audio, graphics, animation, video) stored on customer servers. Though the domain name is the same, the IP address points to an Akamai server rather than the customer's server. In addition to image caching, Akamai provides services which accelerate dynamic and personalized content, J2EE-compliant applications, and streaming media.
4 0.79842919 60 high scalability-2007-08-07-Can you profit from the coming Content Delivery Network wars?
Introduction: Playing like the big boys may be getting cheaper. The big boys, like YouTube , farm the serving of their most popular videos to a third party CDN. A lot of people were surprised YouTube didn't serve all their content themselves, but it makes sense. It allows them to keep up with demand without a large hit for infrastructure build out, much like leasing computers instead of buying them. The problem has been CDNs are expensive. Om Malik reports in Akamai & the CDN Price Wars that may be changing. CDN service could be becoming affordable enough that you might consider using them as part of your scaling strategy. Akamai , once the clear leader in the CDN field, is facing strong competition from the likes of Limelight Networks, Level 3, Internap, CDNetworks, Panther Express and EdgeCast Networks. This commoditization may be bad for their stock prices, but it's good for website builders looking for new scaling strategies. EdgeCast, for example, passes on the cost savings when
5 0.79108649 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
6 0.77599913 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
7 0.76591927 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
8 0.75244993 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
9 0.69639391 1402 high scalability-2013-02-07-Ask HighScalability: Web asset server concept - 3rd party software available?
10 0.6649546 100 high scalability-2007-09-26-Use a CDN to Instantly Improve Your Website's Performance by 20% or More
11 0.66108644 274 high scalability-2008-03-12-YouTube Architecture
12 0.65934724 204 high scalability-2008-01-08-Virus Scanning for Uploaded content
13 0.64977056 294 high scalability-2008-04-01-How to update video views count effectively?
14 0.63737255 447 high scalability-2008-11-19-High Definition Video Delivery on the Web?
15 0.61810625 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
16 0.61490089 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
17 0.61285174 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
18 0.61167806 324 high scalability-2008-05-19-UK Based CDN
19 0.61062193 382 high scalability-2008-09-09-Content Delivery Networks (CDN) – a comprehensive list of providers
20 0.58163196 239 high scalability-2008-02-04-Streaming Video on Amazon EC2?
topicId topicWeight
[(2, 0.12), (50, 0.353), (61, 0.345)]
simIndex simValue blogId blogTitle
same-blog 1 0.88570309 198 high scalability-2008-01-01-HOW CDN works
Introduction: All, I'm just new to this and have a basic understanding how CDN works? My questions are: 1. How does CDN sync data with web servers for video/images? If I have a user to upload a video to my site, will it get stored directly in CDN or it comes to my webserver first and then sync-ed with cache server? 2. How to have only the dynamic video/image delivered through CDN while the rest is served by a webserver? 3. How sync happens and who pays for the bandwidth for sync? I'd appreciate if someone could explain this. Regards, Janakan Rajendran
2 0.71711886 549 high scalability-2009-03-26-Performance - When do I start worrying?
Introduction: A common problem of the application designers is to predict when they need to start worrying about the Architectural/System improvements on their application. Do I need to add more resources? If yes, then how long before I am compelled to do so? The question is not only when but also what. Should I plan to implement a true caching layer on top of my application or do I need to shard my database. Do I need to move to a distributed search infrastructure and if yes when ! Essentially we try to find out the functionalities of the application that will become critical over time.
3 0.71675634 1303 high scalability-2012-08-13-Ask HighScalability: Facing scaling issues with news feeds on Redis. Any advice?
Introduction: We just released a social section to our iOS app several days ago and we are already facing scaling issues with the users' news feeds. We're basically using a Fan-out-on-write (push) model for the users' news feeds (posts of people and topics they follow) and we're using Redis for this (backend is Rails on Heroku). However, our current 60,000 news feeds is ballooning our Redis store to almost 1GB in a just a few days (it's growing way too fast for our budget). Currently we're storing the entire news feed for the user (post id, post text, author, icon url, etc) and we cap the entries to 300 per feed. I'm wondering if we need to just store the post IDs of each user feed in Redis and then store the rest of the post information somewhere else? Would love some feedback here. In this case, our iOS app would make an api call to our Rails app to retrieve a user's news feed. Rails app would retrieve news feed list (just post IDs) from Redis, and then Rails app would need to query to g
4 0.70793426 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
Introduction: Limelight says 95% of Mobile Video Views Take Place in First 90 Days and 88.8 percent of views take place in the first 30 days. Since a lot of people are working with video, which is expensive to store and serve, the implication: there's little need to keep your video close to the user or on a CDN after 30 days.
5 0.70451939 208 high scalability-2008-01-11-FTP Sanity: Redundancy, archiving, consolidation.
Introduction: Easy FTP redundancy and consolidation with the Open Source project Generic-FTP. Works with probably any Linux FTP Server (ProFTPD only one tested). Get rid of some single points of failure. A very easy to set up solution using scripts written in PHP. Tested thoroughly in a production environment.
6 0.70198941 746 high scalability-2009-11-26-Kngine Snippet Search New Indexing Technology
7 0.70184809 226 high scalability-2008-01-28-DR-BC for web-DB servers
8 0.69940466 324 high scalability-2008-05-19-UK Based CDN
9 0.69752759 493 high scalability-2009-01-16-Just-In-Time Scalability: Agile Methods to Support Massive Growth (IMVU case study)
10 0.69087857 747 high scalability-2009-11-26-What I'm Thankful For on Thanksgiving
11 0.69055468 930 high scalability-2010-10-28-NoSQL Took Away the Relational Model and Gave Nothing Back
12 0.69013029 793 high scalability-2010-03-10-Saying Yes to NoSQL; Going Steady with Cassandra at Digg
13 0.68862301 173 high scalability-2007-12-05-Easier Production Releases
14 0.68520921 580 high scalability-2009-04-24-INFOSCALE 2009 in June in Hong Kong
15 0.67988265 675 high scalability-2009-08-08-1dbase vs. many and cloud hosting vs. dedicated server(s)?
16 0.67880261 268 high scalability-2008-03-06-Announce: First Meeting of Boston Scalability User Group
17 0.6786412 347 high scalability-2008-07-07-Five Ways to Stop Framework Fixation from Crashing Your Scaling Strategy
18 0.66356432 322 high scalability-2008-05-19-Conference: Infoscale 2008 in Italy (June 4-6)
19 0.65652442 749 high scalability-2009-12-15-The Common Principles Behind the NOSQL Alternatives
20 0.65200365 238 high scalability-2008-02-04-IPS-IDS for heavy content site