high_scalability high_scalability-2009 high_scalability-2009-620 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hi all! So nice to start discussing cool things in this even cooler forum :) I am having a problem .. which i believe is already solved but i would love someone confirming actual experience with the same topic. We are building a client / server architecture, consisting of a web server part and many clients. Transport will be provided as either XML-RPC / SOAP / JSON or all at once. All of the communication has to be encrypted and passed within SSL3. We expect a high load when the application starts (> 2000 concurrent requests). Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. So it's pretty much a matter of 'what-to-do-with-ssl'. I was thinking of hardware - NetApp or a similar application accelerator. Can anyone give examples of a hardware piece that combines: Load balancer / SSL acce
sentIndex sentText sentNum sentScore
1 So nice to start discussing cool things in this even cooler forum :) I am having a problem . [sent-2, score-0.616]
2 which i believe is already solved but i would love someone confirming actual experience with the same topic. [sent-4, score-0.522]
3 We are building a client / server architecture, consisting of a web server part and many clients. [sent-5, score-0.363]
4 Transport will be provided as either XML-RPC / SOAP / JSON or all at once. [sent-6, score-0.197]
5 All of the communication has to be encrypted and passed within SSL3. [sent-7, score-0.407]
6 We expect a high load when the application starts (> 2000 concurrent requests). [sent-8, score-0.392]
7 Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. [sent-9, score-1.979]
8 So it's pretty much a matter of 'what-to-do-with-ssl'. [sent-10, score-0.088]
9 I was thinking of hardware - NetApp or a similar application accelerator. [sent-11, score-0.194]
10 Can anyone give examples of a hardware piece that combines: Load balancer / SSL accelerator? [sent-12, score-0.624]
11 I have also been reading about open source software Load Balancers but i really doubt it would meet the needs. [sent-13, score-0.409]
wordName wordTfidf (topN-words)
[('api', 0.21), ('cooler', 0.204), ('soap', 0.195), ('netapp', 0.181), ('anyone', 0.179), ('accelerator', 0.176), ('ugly', 0.173), ('encrypted', 0.173), ('discussing', 0.173), ('hi', 0.171), ('transferred', 0.171), ('parsing', 0.165), ('consisting', 0.163), ('rpc', 0.16), ('mess', 0.154), ('forum', 0.142), ('doubt', 0.142), ('passed', 0.137), ('xml', 0.131), ('balancers', 0.131), ('combines', 0.129), ('bound', 0.129), ('json', 0.126), ('load', 0.122), ('balancer', 0.119), ('thanks', 0.117), ('solved', 0.117), ('piece', 0.117), ('experience', 0.114), ('hardware', 0.109), ('actual', 0.109), ('ssl', 0.108), ('provided', 0.107), ('mostly', 0.102), ('server', 0.1), ('examples', 0.1), ('things', 0.097), ('concurrent', 0.097), ('communication', 0.097), ('meet', 0.095), ('clients', 0.094), ('believe', 0.094), ('either', 0.09), ('reading', 0.089), ('matter', 0.088), ('love', 0.088), ('expect', 0.088), ('thinking', 0.085), ('starts', 0.085), ('really', 0.083)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 620 high scalability-2009-06-05-SSL RPC API Scalability
Introduction: Hi all! So nice to start discussing cool things in this even cooler forum :) I am having a problem .. which i believe is already solved but i would love someone confirming actual experience with the same topic. We are building a client / server architecture, consisting of a web server part and many clients. Transport will be provided as either XML-RPC / SOAP / JSON or all at once. All of the communication has to be encrypted and passed within SSL3. We expect a high load when the application starts (> 2000 concurrent requests). Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. So it's pretty much a matter of 'what-to-do-with-ssl'. I was thinking of hardware - NetApp or a similar application accelerator. Can anyone give examples of a hardware piece that combines: Load balancer / SSL acce
2 0.14184628 1263 high scalability-2012-06-13-Why My Soap Film is Better than Your Hadoop Cluster
Introduction: The ever amazing slime mold is not the only way to solve complex compute problems without performing calculations. There is another: soap film . Unfortunately for soap film it isn’t nearly as photogenic as slime mold, all we get are boring looking pictures, but the underlying idea is still fascinating and ten times less spooky. As a quick introduction we’ll lean on Long Ouyang, who has really straightforward explanation of how soap film works in Approaching P=NP: Can Soap Bubbles Solve The Steiner Tree Problem In Polynomial . It’s computers, so playing the role of the motivating graph problem we have the Steiner tree problem , which Ouyang explains as: Find the minimum spanning tree for a bunch of vertices, given that you can add additional points. Soap helps solve this problem because: Soap, in water, acts a surfactant, which decreases the surface tension in water. This acts to minimize the surface energy of the liquid. This should minimize surf
3 0.12850313 54 high scalability-2007-08-02-Multilanguage Website
Introduction: Hi , someone can point me to some good resurce about how to bulid a multilanguage website ? the only resource i have found is this http://www.indiawebdevelopers.com/technology/multilanguage_support.asp thanks! p.s. great site ;)
4 0.12764029 90 high scalability-2007-09-12-Technology behind mediatemple grid service
Introduction: Anyone knows what's behind this service? http://www.mediatemple.net/webhosting/gs/ thanks!
5 0.12426671 987 high scalability-2011-02-10-Dispelling the New SSL Myth
Introduction: Warning, this post is a bit vendor FUDy, but SSL is an important topic and it does bring up some issues worth arguing about. Hacker News has a good discussion of the article. Adam Langley started it all with his article Overclocking SSL and has made a rebuttal to the F5 article in Still not computationally expensive . My car is eight years old this year. It has less than 30,000 miles on it. Yes, you heard that right, less than 30,000 miles. I don’t drive my car very often because, well, my commute is a short trip down two flights of stairs. I don’t need to go very far when I do drive it’s only ten miles or so round trip to the grocery store. So from my perspective, gas isn’t really very expensive. I may use a tank of gas a month, which works out to … well, it’s really not even worth mentioning the cost. But for someone who commutes every day – especially someone who commutes a long-distance every day – gas is expensive. It’s a significant expense every month for them and th
6 0.11592037 1646 high scalability-2014-05-12-4 Architecture Issues When Scaling Web Applications: Bottlenecks, Database, CPU, IO
7 0.11425349 177 high scalability-2007-12-08-thesimsonstage.ea.com
9 0.10744563 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
10 0.10588711 516 high scalability-2009-02-19-Heavy upload server scalability
11 0.10120395 86 high scalability-2007-09-09-Clustering Solution
12 0.099850349 878 high scalability-2010-08-12-Strategy: Terminate SSL Connections in Hardware and Reduce Server Count by 40%
13 0.09683764 993 high scalability-2011-02-22-Is Node.js Becoming a Part of the Stack? SimpleGeo Says Yes.
14 0.093905352 375 high scalability-2008-09-01-A Scalability checklist?
15 0.091664687 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
16 0.091128014 427 high scalability-2008-10-22-Server load balancing architectures, Part 2: Application-level load balancing
17 0.090966836 1331 high scalability-2012-10-02-An Epic TripAdvisor Update: Why Not Run on the Cloud? The Grand Experiment.
18 0.090895407 359 high scalability-2008-07-29-Ehcache - A Java Distributed Cache
19 0.090530343 426 high scalability-2008-10-22-Server load balancing architectures, Part 1: Transport-level load balancing
20 0.090468228 199 high scalability-2008-01-01-S3 for image storing
topicId topicWeight
[(0, 0.151), (1, 0.063), (2, -0.015), (3, -0.075), (4, 0.016), (5, -0.053), (6, 0.008), (7, -0.051), (8, -0.035), (9, 0.032), (10, -0.056), (11, 0.005), (12, 0.013), (13, -0.06), (14, 0.038), (15, -0.071), (16, 0.078), (17, 0.028), (18, 0.018), (19, 0.018), (20, 0.0), (21, 0.001), (22, -0.047), (23, -0.043), (24, 0.038), (25, -0.022), (26, 0.069), (27, -0.052), (28, -0.048), (29, 0.016), (30, 0.019), (31, -0.049), (32, -0.002), (33, -0.036), (34, -0.021), (35, 0.076), (36, 0.084), (37, -0.065), (38, -0.014), (39, -0.04), (40, -0.006), (41, 0.064), (42, 0.003), (43, -0.012), (44, 0.019), (45, 0.069), (46, 0.012), (47, 0.103), (48, 0.073), (49, -0.01)]
simIndex simValue blogId blogTitle
same-blog 1 0.95812732 620 high scalability-2009-06-05-SSL RPC API Scalability
Introduction: Hi all! So nice to start discussing cool things in this even cooler forum :) I am having a problem .. which i believe is already solved but i would love someone confirming actual experience with the same topic. We are building a client / server architecture, consisting of a web server part and many clients. Transport will be provided as either XML-RPC / SOAP / JSON or all at once. All of the communication has to be encrypted and passed within SSL3. We expect a high load when the application starts (> 2000 concurrent requests). Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. So it's pretty much a matter of 'what-to-do-with-ssl'. I was thinking of hardware - NetApp or a similar application accelerator. Can anyone give examples of a hardware piece that combines: Load balancer / SSL acce
2 0.72808802 426 high scalability-2008-10-22-Server load balancing architectures, Part 1: Transport-level load balancing
Introduction: Server farms achieve high scalability and high availability through server load balancing, a technique that makes the server farm appear to clients as a single server. In this two-part article, Gregor Roth explores server load balancing architectures, with a focus on open source solutions. Part 1 covers server load balancing basics and discusses the pros and cons of transport-level server load balancing. The barrier to entry for many Internet companies is low. Anyone with a good idea can develop a small application, purchase a domain name, and set up a few PC-based servers to handle incoming traffic. The initial investment is small, so the start-up risk is minimal. But a successful low-cost infrastructure can become a serious problem quickly. A single server that handles all the incoming requests may not have the capacity to handle high traffic volumes once the business becomes popular. In such a situations companies often start to scale up: they upgrade the existing infrastruc
3 0.7171464 532 high scalability-2009-03-11-Sharding and Connection Pools
Introduction: Hi we are looking at sharding our existing Java/Oracle based application. We are looking to make the app servers able to process requests for multiple (any?) shard. The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. I was wondering if anyone else has dealt with this issue and how you resolved it? Thanks, Scott
4 0.68981457 118 high scalability-2007-10-09-High Load on production Webservers after Sourcecode sync
Introduction: Hi everybody :) We have a bunch of webservers (about 14 at th i s time) running Apache. As app l ication framework we're using PHP with the APC Cache insta l led to improve performance. For load ba l ancing we're using a Big F5 system with dynamic ratio (SNMP driven) To sync new/updated sourcecode we're using subversion to "automaticly" update these servers w i th our latest software relases. After updating the new source to these production servers the load of the mashines is ra i sing to hell. While updating the servers, they are sti l l in "production", serving webpages to the users. Otherwise the process of updating wou l d take ages. Most of the time we're only updating in the morning hours while less users are online, because of the above issue. My guess is, that the load is raising that h i gh, because APC needs to recompile a bunch of new f i les each time. Before and while compi l ing the performance simply is "bad". My goal would be t
5 0.68046933 1260 high scalability-2012-06-07-Case Study on Scaling PaaS infrastructure
Introduction: In his blog post, Scaling WSO2 Stratos , Srinath Perera explains the scaling architecture of the WSO2 Stratos Platform as a Service (PaaS) infrastructure. It is explained as a series of solutions where every solution adds a new concept to solve a specific problem found in the earlier solution. Overall, WSO2 Stratos uses a combination of intelligent Load balancing and lazy loading to scale up the architecture. More details about Stratos can be found from the paper WSO2 Stratos: An Industrial Stack to Support Cloud Computing . Problem Stratos is multi-tenanted . In other words, there are many tenants. Each tenant generally represents an organization and isolated from other tenants, where each tenant has his own users, resources, and permissions. Stratos supports multiple PaaS services. Each PaaS service is actually a WSO2 Products (e.g. AS, BPS, ESB etc.) offered as a service. Using those services, tenants may deploy their own Web Services, Mediation logic, Workflows, a
6 0.67355716 59 high scalability-2007-08-04-Try Squid as a Reverse Proxy
7 0.66440624 78 high scalability-2007-09-01-2 tier switch selection for colocation
8 0.65419984 117 high scalability-2007-10-08-Paper: Understanding and Building High Availability-Load Balanced Clusters
9 0.64975911 227 high scalability-2008-01-28-Howto setup GFS-GNBD
10 0.6487633 251 high scalability-2008-02-18-How to deal with an I-O bottleneck to disk?
11 0.6473043 262 high scalability-2008-02-26-Architecture to Allow High Availability File Upload
12 0.64020592 256 high scalability-2008-02-21-Tracking usage of public resources - throttling accesses per hour
13 0.63723522 516 high scalability-2009-02-19-Heavy upload server scalability
14 0.6361419 177 high scalability-2007-12-08-thesimsonstage.ea.com
15 0.63389885 229 high scalability-2008-01-29-Building scalable storage into application - Instead of MogileFS OpenAFS etc.
16 0.63297111 111 high scalability-2007-10-04-Number of load balanced servers
17 0.6319862 878 high scalability-2010-08-12-Strategy: Terminate SSL Connections in Hardware and Reduce Server Count by 40%
18 0.62904477 283 high scalability-2008-03-18-Shared filesystem on EC2
19 0.62662542 140 high scalability-2007-11-02-How WordPress.com Tracks 300 Servers Handling 10 Million Pageviews
20 0.62445736 509 high scalability-2009-02-05-Product: HAProxy - The Reliable, High Performance TCP-HTTP Load Balancer
topicId topicWeight
[(1, 0.035), (2, 0.303), (10, 0.062), (37, 0.198), (61, 0.109), (79, 0.192)]
simIndex simValue blogId blogTitle
1 0.92119354 103 high scalability-2007-09-28-Kosmos File System (KFS) is a New High End Google File System Option
Introduction: There's a new clustered file system on the spindle: Kosmos File System (KFS) . Thanks to Rich Skrenta for turning me on to KFS and I think his blog post says it all. KFS is an open source project written in C++ by search startup Kosmix . The team members have a good pedigree so there's a better than average chance this software will be worth considering. After you stop trying to turn KFS into "Kentucky Fried File System" in your mind, take a look at KFS' intriguing feature set: Incremental scalability: New chunkserver nodes can be added as storage needs increase; the system automatically adapts to the new nodes. Availability: Replication is used to provide availability due to chunk server failures. Typically, files are replicated 3-way. Per file degree of replication: The degree of replication is configurable on a per file basis, with a max. limit of 64. Re-replication: Whenever the degree of replication for a file drops below the configured amount (
2 0.91965306 965 high scalability-2010-12-29-Pinboard.in Architecture - Pay to Play to Keep a System Small
Introduction: How do you keep a system small enough, while still being successful, that a simple scale-up strategy becomes the preferred architecture? StackOverflow , for example, could stick with a tool chain they were comfortable with because they had a natural brake on how fast they could grow: there are only so many programmers in the world. If this doesn't work for you, here's another natural braking strategy to consider: charge for your service . Paul Houle summarized this nicely as: avoid scaling problems by building a service that's profitable at a small scale . This interesting point, one I hadn't properly considered before, was brought up by Maciej Ceglowski, co-founder of Pinboard.in , in an interview with Leo Laporte and Amber MacArthur on their their net@night show. Pinboard is a lean, mean, pay for bookmarking machine, a timely replacement for the nearly departed Delicious. And as a self professed anti-social bookmarking site, it emphasizes speed over socializing . Maciej
3 0.91404557 1379 high scalability-2012-12-31-Designing for Resiliency will be so 2013
Introduction: A big part of engineering for a quality experience is bringing in the long tail . An improbable severe failure can ruin your experience of a site, even if your average experience is quite good. That's where building for resilience comes in. Resiliency used to be outside the realm of possibility for the common system. It was simply too complex and too expensive. An evolution has been underway, making 2013 possibly the first time resiliency is truly on the table as a standard part of system architectures. We are getting the clouds, we are getting the tools, and prices are almost low enough. Even Netflix, real leaders in the resiliency architecture game, took some heat for relying completely on Amazon's ELB and not having a backup load balancing system, leading to a prolonged Christmas Eve failure . Adrian Cockcroft, Cloud Architect at Netflix, said they've investigated creating their own load balancing service, but that "we try not to invest in undifferentiated heavy lifting.
same-blog 4 0.91216534 620 high scalability-2009-06-05-SSL RPC API Scalability
Introduction: Hi all! So nice to start discussing cool things in this even cooler forum :) I am having a problem .. which i believe is already solved but i would love someone confirming actual experience with the same topic. We are building a client / server architecture, consisting of a web server part and many clients. Transport will be provided as either XML-RPC / SOAP / JSON or all at once. All of the communication has to be encrypted and passed within SSL3. We expect a high load when the application starts (> 2000 concurrent requests). Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. So it's pretty much a matter of 'what-to-do-with-ssl'. I was thinking of hardware - NetApp or a similar application accelerator. Can anyone give examples of a hardware piece that combines: Load balancer / SSL acce
5 0.90153635 1415 high scalability-2013-03-04-7 Life Saving Scalability Defenses Against Load Monster Attacks
Introduction: We talked about 42 Monster Problems That Attack As Loads Increase . Here are a few ways you can defend yourself, secrets revealed by scaling masters across the ages. Note that these are low level programming level moves, not large architecture type strategies. Use Resources Proportional To a Fixed Limit This is probably the most important rule for achieving scalability within an application. What it means: Find the resource that has a fixed limit that you know you can support. For example, a guarantee to handle a certain number of objects in memory. So if we always use resources proportional to the number of objects it is likely we can prevent resource exhaustion. Devise ways of tying what you need to do to the individual resources. Some examples: Keep a list of purchase orders with line items over $20 (or whatever). Do not keep a list of the line items because the number of items can be much larger than the number of purchase orders. You have kept the resource usage
6 0.88862914 1029 high scalability-2011-04-25-The Big List of Articles on the Amazon Outage
7 0.88467306 1366 high scalability-2012-12-03-Resiliency is the New Normal - A Deep Look at What It Means and How to Build It
8 0.87551862 1033 high scalability-2011-05-02-The Updated Big List of Articles on the Amazon Outage
9 0.87009966 311 high scalability-2008-04-29-Strategy: Sample to Reduce Data Set
10 0.86871201 862 high scalability-2010-07-20-Strategy: Consider When a Service Starts Billing in Your Algorithm Cost
11 0.86756229 1418 high scalability-2013-03-06-Low Level Scalability Solutions - The Aggregation Collection
12 0.86261398 780 high scalability-2010-02-19-Twitter’s Plan to Analyze 100 Billion Tweets
13 0.86141557 526 high scalability-2009-03-05-Strategy: In Cloud Computing Systematically Drive Load to the CPU
14 0.85906345 1266 high scalability-2012-06-18-Google on Latency Tolerant Systems: Making a Predictable Whole Out of Unpredictable Parts
15 0.85853261 1133 high scalability-2011-10-27-Strategy: Survive a Comet Strike in the East With Reserved Instances in the West
16 0.85764039 1017 high scalability-2011-04-06-Netflix: Run Consistency Checkers All the time to Fixup Transactions
17 0.85677725 230 high scalability-2008-01-29-Speed up (Oracle) database code with result caching
19 0.85399282 1491 high scalability-2013-07-15-Ask HS: What's Wrong with Twitter, Why Isn't One Machine Enough?
20 0.85376579 717 high scalability-2009-10-07-How to Avoid the Top 5 Scale-Out Pitfalls