high_scalability high_scalability-2007 high_scalability-2007-144 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hi all, a I run a site that after a complete redesign have gotten a lot more traffic. The site provides free flash games, so the biggest traffic share goes to serving flash files (from about 100K and up to several megabytes in size each.) I currently host the entire site on a hosting provider that have no traffic limits. But since they are very cheap (yet have served me very well all the time with at least 99,9% uptime), I don't trust them in allowing me to continue consuming more and more bandwidth. I just guess I'm going to reach some internal limit they have on day, so I'm looking into moving all the flash content over to a content delivery network of some sort. Some recent traffic stats: August: 12 GB September: 22 GB October: 55 GB November: Currently 2,3 GB pr day on average, but it's rising.. I've been looking into Amazon S3, but have not decided on anything yet. So therefor I'm asking if there are any other provides I should consider, that operates withi
sentIndex sentText sentNum sentScore
1 Hi all, a I run a site that after a complete redesign have gotten a lot more traffic. [sent-1, score-0.522]
2 The site provides free flash games, so the biggest traffic share goes to serving flash files (from about 100K and up to several megabytes in size each. [sent-2, score-1.709]
3 ) I currently host the entire site on a hosting provider that have no traffic limits. [sent-3, score-0.794]
4 But since they are very cheap (yet have served me very well all the time with at least 99,9% uptime), I don't trust them in allowing me to continue consuming more and more bandwidth. [sent-4, score-0.778]
5 I just guess I'm going to reach some internal limit they have on day, so I'm looking into moving all the flash content over to a content delivery network of some sort. [sent-5, score-1.248]
6 Some recent traffic stats: August: 12 GB September: 22 GB October: 55 GB November: Currently 2,3 GB pr day on average, but it's rising. [sent-6, score-0.621]
7 I've been looking into Amazon S3, but have not decided on anything yet. [sent-8, score-0.313]
8 So therefor I'm asking if there are any other provides I should consider, that operates within the same price range as Amazon does (or lower)? [sent-9, score-0.821]
wordName wordTfidf (topN-words)
[('flash', 0.34), ('pr', 0.232), ('therefor', 0.232), ('megabytes', 0.214), ('redesign', 0.196), ('traffic', 0.182), ('august', 0.171), ('gotten', 0.171), ('hi', 0.168), ('currently', 0.156), ('site', 0.155), ('consuming', 0.154), ('uptime', 0.145), ('ai', 0.144), ('operates', 0.142), ('asking', 0.138), ('trust', 0.134), ('guess', 0.132), ('content', 0.131), ('provides', 0.123), ('provider', 0.118), ('decided', 0.117), ('looking', 0.117), ('reach', 0.115), ('day', 0.111), ('continue', 0.111), ('stats', 0.109), ('served', 0.108), ('games', 0.108), ('gb', 0.108), ('amazon', 0.107), ('limit', 0.1), ('allowing', 0.098), ('price', 0.097), ('recent', 0.096), ('biggest', 0.096), ('serving', 0.094), ('hosting', 0.094), ('cheap', 0.093), ('internal', 0.092), ('delivery', 0.09), ('range', 0.089), ('host', 0.089), ('lower', 0.088), ('average', 0.086), ('share', 0.085), ('consider', 0.082), ('files', 0.08), ('least', 0.08), ('anything', 0.079)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 144 high scalability-2007-11-07-What CDN would you recommend?
Introduction: Hi all, a I run a site that after a complete redesign have gotten a lot more traffic. The site provides free flash games, so the biggest traffic share goes to serving flash files (from about 100K and up to several megabytes in size each.) I currently host the entire site on a hosting provider that have no traffic limits. But since they are very cheap (yet have served me very well all the time with at least 99,9% uptime), I don't trust them in allowing me to continue consuming more and more bandwidth. I just guess I'm going to reach some internal limit they have on day, so I'm looking into moving all the flash content over to a content delivery network of some sort. Some recent traffic stats: August: 12 GB September: 22 GB October: 55 GB November: Currently 2,3 GB pr day on average, but it's rising.. I've been looking into Amazon S3, but have not decided on anything yet. So therefor I'm asking if there are any other provides I should consider, that operates withi
2 0.18309432 1369 high scalability-2012-12-10-Switch your databases to Flash storage. Now. Or you're doing it wrong.
Introduction: This is a guest post by Brian Bulkowski , CTO and co-founder of Aerospike , a leading clustered NoSQL database, has worked in the area of high performance commodity systems since 1989. Why flash rules for databases The economics of flash memory are staggering. If you’re not using SSD, you are doing it wrong. Not quite true, but close. Some small applications fit entirely in memory – less than 100GB – great for in-memory solutions. There’s a place for rotational drives (HDD) in massive streaming analytics and petabytes of data. But for the vast space between, flash has become the only sensible option. For example, the Samsung 840 costs $180 for 250GB. The speed rating for this drive is rated by the manufacturer at 96,000 random 4K read IOPS, and 61,000 random 4K write IOPS. The Samsung 840 is not alone at this price performance. A 300GB Intel 320 is $450. An OCZ Vertex 4 256GB is $235, with the Intel being rated as slowest, but our internal testing showing
3 0.16221921 54 high scalability-2007-08-02-Multilanguage Website
Introduction: Hi , someone can point me to some good resurce about how to bulid a multilanguage website ? the only resource i have found is this http://www.indiawebdevelopers.com/technology/multilanguage_support.asp thanks! p.s. great site ;)
4 0.14242786 61 high scalability-2007-08-07-What qps should we design for in making a MySpace like site?
Introduction: We are currently building a high traffic portal like myspace. What is the qps that we have to keep in mind and develop the site so that it can be scalable as the traffic grows?
5 0.12702218 382 high scalability-2008-09-09-Content Delivery Networks (CDN) – a comprehensive list of providers
Introduction: We build web applications…and there are plenty of them around. Now, if we hit the jackpot and our application becomes very popular, traffic goes up, and our servers are brought down by the hordes of people coming to our website. What do we do in that situation? Of course, I am not talking here about the kind of traffic Digg, Yahoo Buzz or other social media sites can bring to a website, which is temporary overnight traffic, or a website which uses cloud computing like Amazon EC2 service, MediaTemple Grid Service or Mosso Hosting Cloud service. I am talking about traffic that consistently increases over time as the service achieves success. Google.com, Yahoo.com, Myspace.com, Facebook.com, Plentyoffish.com, Linkedin.com, Youtube.com and others are examples of services which have constant high traffic. Knowing that users want speed from their applications, these services will always use a Content Delivery Network (CDN) to deliver that speed. What is a Content Delivery Ne
6 0.12031963 611 high scalability-2009-05-31-Need help on Site loading & database optimization - URGENT
7 0.11991081 576 high scalability-2009-04-21-What CDN would you recommend?
8 0.1182331 239 high scalability-2008-02-04-Streaming Video on Amazon EC2?
9 0.11201744 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
10 0.1095943 91 high scalability-2007-09-13-Design Preparations for Scaling
11 0.10635635 1207 high scalability-2012-03-12-Google: Taming the Long Latency Tail - When More Machines Equals Worse Results
12 0.10593037 104 high scalability-2007-10-01-SmugMug Found their Perfect Storage Array
13 0.10260948 944 high scalability-2010-11-17-Some Services are More Equal than Others
14 0.10167125 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
15 0.096629873 1102 high scalability-2011-08-22-Strategy: Run a Scalable, Available, and Cheap Static Site on S3 or GitHub
16 0.095165879 44 high scalability-2007-07-30-Product: Photobucket
17 0.094031766 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
18 0.089586012 477 high scalability-2008-12-29-100% on Amazon Web Services: Soocial.com - a lesson of porting your service to Amazon
19 0.087949485 904 high scalability-2010-09-21-Playfish's Social Gaming Architecture - 50 Million Monthly Users and Growing
20 0.086367369 100 high scalability-2007-09-26-Use a CDN to Instantly Improve Your Website's Performance by 20% or More
topicId topicWeight
[(0, 0.136), (1, 0.035), (2, -0.014), (3, -0.061), (4, -0.042), (5, -0.118), (6, -0.009), (7, -0.03), (8, 0.054), (9, 0.028), (10, 0.009), (11, -0.114), (12, -0.02), (13, 0.002), (14, 0.053), (15, 0.012), (16, 0.01), (17, 0.012), (18, -0.029), (19, -0.025), (20, -0.035), (21, 0.01), (22, 0.0), (23, 0.061), (24, -0.003), (25, -0.07), (26, -0.027), (27, -0.116), (28, 0.083), (29, -0.061), (30, 0.096), (31, 0.041), (32, 0.001), (33, -0.008), (34, 0.011), (35, 0.04), (36, 0.1), (37, -0.048), (38, -0.053), (39, 0.064), (40, 0.042), (41, -0.038), (42, 0.04), (43, 0.051), (44, -0.022), (45, -0.015), (46, -0.04), (47, 0.007), (48, -0.008), (49, -0.025)]
simIndex simValue blogId blogTitle
same-blog 1 0.98470151 144 high scalability-2007-11-07-What CDN would you recommend?
Introduction: Hi all, a I run a site that after a complete redesign have gotten a lot more traffic. The site provides free flash games, so the biggest traffic share goes to serving flash files (from about 100K and up to several megabytes in size each.) I currently host the entire site on a hosting provider that have no traffic limits. But since they are very cheap (yet have served me very well all the time with at least 99,9% uptime), I don't trust them in allowing me to continue consuming more and more bandwidth. I just guess I'm going to reach some internal limit they have on day, so I'm looking into moving all the flash content over to a content delivery network of some sort. Some recent traffic stats: August: 12 GB September: 22 GB October: 55 GB November: Currently 2,3 GB pr day on average, but it's rising.. I've been looking into Amazon S3, but have not decided on anything yet. So therefor I'm asking if there are any other provides I should consider, that operates withi
2 0.73075515 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
Introduction: This question is for all the gurus here. Please help this novice x I am starting a video sharing site like YouTube in India. I want to offer the best quality possible, at minimum cost. Nothing new about it, right? :). I have done some research on the dedicated hosting services and CDN services available and I have some basic knowledge on these. Following are my requirements 1) My budget is $500 to $1000 per month for hosting (including CDN if and as applicable). 2) I will need around 500GB of storage and 1TB per month of bandwidth in first 2-3 months and then about 10TB of storage and 5TB per month of bandwidth. And more ... depending on how big it gets (I can afford more when it gets big) 3) 90% of my viewers are in India. Other 10% are in US and UK. Based on the above, could you please answer my following questions? 1) Can I go with just a good dedicated server to start with and get a CDN service later on when the site gets big? Or do you think its wise
3 0.72057748 611 high scalability-2009-05-31-Need help on Site loading & database optimization - URGENT
Introduction: Hi Friends, I need some help in making site access fast. On an average my site has the traffic 2500 hits per day and on 16th May it had 60,000 hits. On this day site was loading very slow even it was getting time out. I also check out the processes running by using "top" command it was indicating mysql was taking too much load. There are around 166 tables (Including PHPBB forum) in my database. All contents on site are displayed by fetching it from database. I have also added indexing to respective tables where it is required. Plain PHP/HTML coding is used. Technology: PHP -- 5.2 MYSQL -- 5.0 Apache -- 2.0 Linux Following is all the server details of my site: CPU : Single Socket Dual Core AMD Opteron 1212HE Memory: 2GB DDR RAM Hard Drive: 250GB SATA Ethernet: 100Mb Primary Ethernet Card (/var/log) # uname -a Linux 2.6.9-67.0.15.ELsmp #1 SMP Tue Apr 22 13:50:33 EDT 2008 i686 athlon i386 GNU/Linux kernel version: 2.6.9-67.0.15.ELsmp (/var/log) # free -m total used
4 0.69144654 61 high scalability-2007-08-07-What qps should we design for in making a MySpace like site?
Introduction: We are currently building a high traffic portal like myspace. What is the qps that we have to keep in mind and develop the site so that it can be scalable as the traffic grows?
5 0.65314293 238 high scalability-2008-02-04-IPS-IDS for heavy content site
Introduction: All, My site would have heavy content (video/pictures). I'm looking for an efficient IPS/IDS solution which would not introduce much of latency. I'm more familiar with Cisco ASA and also familiar with Juniper, Foundry and others. I also came across snort but haven't used it before. I'm more of looking for an appliance (for the ease of configuration,support etc...) Could any one share their thoughts on performane of IPS/IDS from this vendors? Thanks! Janakan Rajendran
6 0.64411819 199 high scalability-2008-01-01-S3 for image storing
7 0.61595172 1289 high scalability-2012-07-23-State of the CDN: More Traffic, Stable Prices, More Products, Profits - Not So Much
8 0.61142278 965 high scalability-2010-12-29-Pinboard.in Architecture - Pay to Play to Keep a System Small
9 0.6069032 632 high scalability-2009-06-15-starting small with growth in mind
10 0.59622687 54 high scalability-2007-08-02-Multilanguage Website
11 0.5751738 159 high scalability-2007-11-18-Reverse Proxy
12 0.57175112 622 high scalability-2009-06-08-Distribution of queries per second
13 0.56974798 276 high scalability-2008-03-15-New Website Design Considerations
14 0.56818193 206 high scalability-2008-01-10-MONO ASP.NET. Will it make the web???
15 0.56682175 287 high scalability-2008-03-24-Advertise
16 0.56673563 834 high scalability-2010-06-01-Web Speed Can Push You Off of Google Search Rankings! What Can You Do?
17 0.55058461 576 high scalability-2009-04-21-What CDN would you recommend?
18 0.54950333 730 high scalability-2009-10-28-GemFire: Solving the hardest problems in data management
19 0.5401606 262 high scalability-2008-02-26-Architecture to Allow High Availability File Upload
20 0.53976613 1102 high scalability-2011-08-22-Strategy: Run a Scalable, Available, and Cheap Static Site on S3 or GitHub
topicId topicWeight
[(1, 0.144), (2, 0.214), (47, 0.291), (61, 0.128), (79, 0.109)]
simIndex simValue blogId blogTitle
1 0.95151138 57 high scalability-2007-08-03-Scaling IMAP and POP3
Introduction: Just thought I'd drop a brief suggestion to anyone building a large mail system. Our solution for scaling mail pickup was to develop a sharded architecture whereby accounts are spread across a cluster of servers, each with imap/pop3 capability. Then we use a cluster of reverse proxies (Perdition) speaking to the backend imap/pop3 servers . The benefit of this approach is you can use simply use round-robin or HA loadbalancing on the perdition servers that end users connect to (e.g. admins can easily move accounts around on the backend storage servers without affecting end users). Perdition manages routing users to the appropriate backend servers and has MySQL support. What we also liked about this approach was that it had no dependency on a distributed or networked filesystem, so less chance of corruption or data consistency issues. When an individual server reaches capacity, we just off load users to a less used server. If any server goes offline, it only affects the fraction of users
2 0.9479506 81 high scalability-2007-09-06-Scaling IMAP and POP3
Introduction: Another scalability strategy brought to you by Erik Osterman: Just thought I'd drop a brief suggestion to anyone building a large mail system. Our solution for scaling mail pickup was to develop a sharded architecture whereby accounts are spread across a cluster of servers, each with imap/pop3 capability. Then we use a cluster of reverse proxies (Perdition) speaking to the backend imap/pop3 servers . The benefit of this approach is you can use simply use round-robin or HA load balancing on the perdition servers that end users connect to (e.g. admins can easily move accounts around on the backend storage servers without affecting end users). Perdition manages routing users to the appropriate backend servers and has MySQL support. What we also liked about this approach was that it had no dependency on a distributed or networked file system, so less chance of corruption or data consistency issues. When an individual server reaches capacity, we just off load users to a less u
3 0.93791103 163 high scalability-2007-11-21-n-phase commit for FS writes, reads stay local
Introduction: I am try i ng to f i nd a L i nux FS that wi l l a l low me to rep l icate a l l wr i tes synchronous l y to n nodes i n a web server c l uster, wh i le keep i ng a l l reads local. It shou l d not require specialized hardware.
4 0.93517977 760 high scalability-2010-01-13-10 Hot Scalability Links for January 13, 2010
Introduction: Has Amazon EC2 become over subscribed? by Alan Williamson. Systemic problems hit AWS as users experience problems across Amazon's infrastructure. It seems the strange attractor of a cloud may be the same as for a shared hosting service. Understanding Infrastructure 2.0 by James Urquhart. We need to take a systems view of our entire infrastructure, and build our automation around the end-to-end architecture of that system . Hey You, Get Off of My Cloud: Exploring Information Leakage in Third-Party Compute Clouds . We show that it is possible to map the internal cloud infrastructure . Hadoop World: Building Data Intensive Apps with Hadoop and EC2 by Pete Skomoroch. Dives into detail about how he built TrendingTopics.org using Hadoop and EC2 . A Crash Course in Modern Hardware by Cliff Click. Yes, your mind will hurt after watching this. And no, you probably don't know what your microprocessor is doing anymore. EVE Scalability Explained by James Harrison. This pos
5 0.93337488 852 high scalability-2010-07-07-Strategy: Recompute Instead of Remember Big Data
Introduction: Professor Lance Fortnow, in his blog post Drowning in Data , says complexity has taught him this lesson: When storage is expensive, it is cheaper to recompute what you've already computed. And that's the world we now live in: Storage is pretty cheap but data acquisition and computation are even cheaper. Jouni, one of the commenters, thinks the opposite is true: storage is cheap, but computation is expensive. When you are dealing with massive data, the size of the data set is very often determined by the amount of computing power available for a certain price . With such data, a linear-time algorithm takes O(1) seconds to finish, while a quadratic-time algorithm requires O(n) seconds. But as computing power increases exponentially over time, the quadratic algorithm gets exponentially slower . For me it's not a matter of which is true, both positions can be true, but what's interesting is to think that storage and computation are in some cases fungible. Your architecture can dec
6 0.92825693 756 high scalability-2009-12-30-Terrastore - Scalable, elastic, consistent document store.
7 0.91404277 1166 high scalability-2011-12-30-Stuff The Internet Says On Scalability For December 30, 2011
8 0.91009802 676 high scalability-2009-08-08-Yahoo!'s PNUTS Database: Too Hot, Too Cold or Just Right?
same-blog 9 0.90566343 144 high scalability-2007-11-07-What CDN would you recommend?
10 0.90010482 1326 high scalability-2012-09-20-How Vimeo Saves 50% on EC2 by Playing a Smarter Game
11 0.8979702 94 high scalability-2007-09-17-Blog: Adding Simplicity by Dan Pritchett
12 0.88457096 550 high scalability-2009-03-30-Ebay history and architecture
13 0.87935263 1062 high scalability-2011-06-15-101 Questions to Ask When Considering a NoSQL Database
14 0.8776772 1054 high scalability-2011-06-06-NoSQL Pain? Learn How to Read-write Scale Without a Complete Re-write
15 0.86383051 1530 high scalability-2013-10-11-Stuff The Internet Says On Scalability For October 11th, 2013
16 0.86242646 708 high scalability-2009-09-17-Infinispan narrows the gap between open source and commercial data caches
17 0.84615296 1440 high scalability-2013-04-15-Scaling Pinterest - From 0 to 10s of Billions of Page Views a Month in Two Years
18 0.82902259 276 high scalability-2008-03-15-New Website Design Considerations
19 0.82597733 358 high scalability-2008-07-26-Sharding the Hibernate Way
20 0.80913448 683 high scalability-2009-08-18-Hardware Architecture Example (geographical level mapping of servers)