high_scalability high_scalability-2009 high_scalability-2009-532 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hi we are looking at sharding our existing Java/Oracle based application. We are looking to make the app servers able to process requests for multiple (any?) shard. The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. I was wondering if anyone else has dealt with this issue and how you resolved it? Thanks, Scott
sentIndex sentText sentNum sentScore
1 Hi we are looking at sharding our existing Java/Oracle based application. [sent-1, score-0.49]
2 We are looking to make the app servers able to process requests for multiple (any? [sent-2, score-0.919]
3 The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. [sent-4, score-1.77]
4 Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. [sent-5, score-1.828]
5 I was wondering if anyone else has dealt with this issue and how you resolved it? [sent-6, score-1.115]
wordName wordTfidf (topN-words)
[('concern', 0.463), ('app', 0.28), ('resolved', 0.261), ('dealt', 0.257), ('hi', 0.251), ('additionally', 0.247), ('consumed', 0.232), ('pools', 0.195), ('wondering', 0.185), ('looking', 0.174), ('issue', 0.151), ('connection', 0.149), ('coming', 0.149), ('sharding', 0.142), ('anyone', 0.131), ('else', 0.13), ('connections', 0.129), ('particular', 0.126), ('various', 0.119), ('existing', 0.113), ('physical', 0.113), ('amount', 0.108), ('servers', 0.105), ('come', 0.099), ('talk', 0.096), ('requests', 0.093), ('many', 0.093), ('able', 0.079), ('process', 0.074), ('memory', 0.071), ('multiple', 0.069), ('based', 0.061), ('may', 0.061), ('server', 0.049), ('would', 0.047), ('make', 0.045), ('database', 0.045), ('one', 0.033)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 532 high scalability-2009-03-11-Sharding and Connection Pools
Introduction: Hi we are looking at sharding our existing Java/Oracle based application. We are looking to make the app servers able to process requests for multiple (any?) shard. The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. I was wondering if anyone else has dealt with this issue and how you resolved it? Thanks, Scott
2 0.18826258 54 high scalability-2007-08-02-Multilanguage Website
Introduction: Hi , someone can point me to some good resurce about how to bulid a multilanguage website ? the only resource i have found is this http://www.indiawebdevelopers.com/technology/multilanguage_support.asp thanks! p.s. great site ;)
3 0.12937991 91 high scalability-2007-09-13-Design Preparations for Scaling
Introduction: Hi there, what do you think is crucial in the code designing of a scalable site? How does one prepare for webfarms and clusters (e.g. in PHP)? Thanks, Stephan
4 0.12109037 78 high scalability-2007-09-01-2 tier switch selection for colocation
Introduction: Hi, I am i nterested in some exper i enced adv i ce for choosing switches for a colocated 2-t i er arch i tecture. I have the hardware chosen for the webservers, app servers, and db servers, but need some adv i ce on the network sw i tch in between: colocation port -> firewa l l(load balancer) -> 2+ web servers (app servers) -> gigabit sw i tch -> DB server(possib l y cluster for future expansion) the quest i on is that I am just starting out, i wonder which rackmount g i gabit sw i tch to select for the private LAN between the app server -> DB servers. Do I need managed for that? Cisco switches are the best, but they are the most expensive...I am looking at poss i bly using Dell/Netgear gigab i t switches. Thanks for any input
5 0.11571358 262 high scalability-2008-02-26-Architecture to Allow High Availability File Upload
Introduction: Hi, I was wondering if anyone has found any information on how to architect a system to support high availability file uploads. My scenario: I have an Apache server proxying requests to a bunch of Tomcat Java application servers. When I need to upgrade my site, I stop and upgrade each of the Tomcat servers one at a time. This seems to work well as Apache automatically routes subsequent requests for the stopped app server to the remaining app servers that are up. The problem is that if a user is uploading a file when the app server is stopped, the upload fails and the user has to upload the file again. This is problematic as uploading files is an integral feature of the site and it's frustrating for the users to have to restart their uploads every time I upgrade the site (which I want to be able to do frequently). Has anyone seen any information on how this can be done or have ideas on how this can be architected? I imagine sites like Flickr must have a solution to this problem
6 0.10890231 605 high scalability-2009-05-22-Distributed content system with bandwidth balancing
7 0.098665975 199 high scalability-2008-01-01-S3 for image storing
8 0.09806224 672 high scalability-2009-08-06-An Unorthodox Approach to Database Design : The Coming of the Shard
9 0.09786924 1333 high scalability-2012-10-04-LinkedIn Moved from Rails to Node: 27 Servers Cut and Up to 20x Faster
10 0.094937652 301 high scalability-2008-04-08-Google AppEngine - A First Look
11 0.09130314 640 high scalability-2009-06-28-Google Voice Architecture
12 0.09097033 856 high scalability-2010-07-12-Creating Scalable Digital Libraries
13 0.090451062 8 high scalability-2007-07-12-Should I use LAMP or Windows?
14 0.090324916 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
15 0.090110898 251 high scalability-2008-02-18-How to deal with an I-O bottleneck to disk?
16 0.089644372 51 high scalability-2007-07-31-Book: Scalable Internet Architectures
17 0.087007195 1303 high scalability-2012-08-13-Ask HighScalability: Facing scaling issues with news feeds on Redis. Any advice?
18 0.084679849 620 high scalability-2009-06-05-SSL RPC API Scalability
19 0.084596589 517 high scalability-2009-02-21-Google AppEngine - A Second Look
20 0.082575195 435 high scalability-2008-10-30-The case for functional decomposition
topicId topicWeight
[(0, 0.113), (1, 0.04), (2, -0.01), (3, -0.071), (4, 0.015), (5, -0.028), (6, 0.026), (7, -0.011), (8, -0.008), (9, 0.006), (10, -0.034), (11, -0.019), (12, -0.019), (13, 0.011), (14, 0.03), (15, -0.037), (16, 0.001), (17, -0.006), (18, 0.027), (19, 0.016), (20, 0.014), (21, -0.046), (22, -0.027), (23, -0.025), (24, 0.053), (25, -0.003), (26, 0.082), (27, -0.085), (28, -0.027), (29, 0.002), (30, 0.009), (31, -0.074), (32, -0.009), (33, -0.023), (34, 0.003), (35, 0.085), (36, 0.095), (37, -0.05), (38, -0.05), (39, 0.045), (40, 0.104), (41, 0.076), (42, -0.013), (43, -0.026), (44, 0.066), (45, 0.001), (46, 0.0), (47, 0.085), (48, 0.002), (49, 0.052)]
simIndex simValue blogId blogTitle
same-blog 1 0.94906878 532 high scalability-2009-03-11-Sharding and Connection Pools
Introduction: Hi we are looking at sharding our existing Java/Oracle based application. We are looking to make the app servers able to process requests for multiple (any?) shard. The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. I was wondering if anyone else has dealt with this issue and how you resolved it? Thanks, Scott
2 0.73940557 78 high scalability-2007-09-01-2 tier switch selection for colocation
Introduction: Hi, I am i nterested in some exper i enced adv i ce for choosing switches for a colocated 2-t i er arch i tecture. I have the hardware chosen for the webservers, app servers, and db servers, but need some adv i ce on the network sw i tch in between: colocation port -> firewa l l(load balancer) -> 2+ web servers (app servers) -> gigabit sw i tch -> DB server(possib l y cluster for future expansion) the quest i on is that I am just starting out, i wonder which rackmount g i gabit sw i tch to select for the private LAN between the app server -> DB servers. Do I need managed for that? Cisco switches are the best, but they are the most expensive...I am looking at poss i bly using Dell/Netgear gigab i t switches. Thanks for any input
3 0.67570192 177 high scalability-2007-12-08-thesimsonstage.ea.com
Introduction: Cou l d anyone make an overv i ew of thesimsonstage.ea.com arch i tecture, i.e. some stats, w i ch techno l ogy thay use, how they imp l ement karaoke f l ash-based p l ayer, wh i ch med i a server they use, how many bandw i d t h does it need, etc. Any informat i on wi l l be he l pful. Thanks.
4 0.67362404 256 high scalability-2008-02-21-Tracking usage of public resources - throttling accesses per hour
Introduction: Hi, We have an application that allows the user to define a publicly available resource with an ID. The ID can then be accessed via an HTTP call, passing the ID. While we're not a picture site, thinking of a resource like a picture may help understand what is going on. We need to be able to stop access to the resource if it is accessed 'x' times in an hour, regardless of who is requesting it. We see two options - go to the database for each request to see if the # of returned in the last hour is within the limit. - keep a counter in each of the application servers and sync the counters every few minutes or # of requests to determine if we've passed the limit. The sync point would be the database. Going to the database (and updating it!) each time we get a request isn't very attractive. We also have a load balanced farm of servers, so we know 'x' is going to have to be a soft limit if we count in the app serevrs. (We know there will be a period of time between s
5 0.67022401 620 high scalability-2009-06-05-SSL RPC API Scalability
Introduction: Hi all! So nice to start discussing cool things in this even cooler forum :) I am having a problem .. which i believe is already solved but i would love someone confirming actual experience with the same topic. We are building a client / server architecture, consisting of a web server part and many clients. Transport will be provided as either XML-RPC / SOAP / JSON or all at once. All of the communication has to be encrypted and passed within SSL3. We expect a high load when the application starts (> 2000 concurrent requests). Combine this with xml parsing for the rpc api, things really look ugly :) So it's a big mess :) It will not be that much database bound behind the api - mostly files will be transferred from the server to the clients and simple api for control. So it's pretty much a matter of 'what-to-do-with-ssl'. I was thinking of hardware - NetApp or a similar application accelerator. Can anyone give examples of a hardware piece that combines: Load balancer / SSL acce
6 0.63102973 262 high scalability-2008-02-26-Architecture to Allow High Availability File Upload
7 0.61709672 704 high scalability-2009-09-13-How is Berkely DB fare against other Key-Value Database
8 0.61612177 338 high scalability-2008-06-02-Total Cost of Ownership for different web development frameworks
9 0.6052475 435 high scalability-2008-10-30-The case for functional decomposition
10 0.60223299 199 high scalability-2008-01-01-S3 for image storing
11 0.58317077 1579 high scalability-2014-01-14-SharePoint VPS solution
13 0.57747602 226 high scalability-2008-01-28-DR-BC for web-DB servers
14 0.57607216 685 high scalability-2009-08-20-Dependency Injection and AOP frameworks for .NET
15 0.57482296 251 high scalability-2008-02-18-How to deal with an I-O bottleneck to disk?
16 0.56852674 99 high scalability-2007-09-23-HA for switches
17 0.56835926 140 high scalability-2007-11-02-How WordPress.com Tracks 300 Servers Handling 10 Million Pageviews
18 0.56542957 90 high scalability-2007-09-12-Technology behind mediatemple grid service
19 0.56058717 598 high scalability-2009-05-12-P2P server technology?
20 0.55734122 683 high scalability-2009-08-18-Hardware Architecture Example (geographical level mapping of servers)
topicId topicWeight
[(1, 0.085), (2, 0.246), (61, 0.115), (79, 0.136), (92, 0.266)]
simIndex simValue blogId blogTitle
1 0.94644618 839 high scalability-2010-06-09-Paper: Propagation Networks: A Flexible and Expressive Substrate for Computation
Introduction: Alexey Radul in his fascinating 174 page dissertation Propagation Networks: A Flexible and Expressive Substrate for Computation , offers to help us break free of the tyranny of linear time by arranging computation as a network of autonomous but interconnected machines . We can do this by organizing computation as a network of interconnected machines of some kind, each of which is free to run when it pleases, propagating information around the network as proves possible. The consequence of this freedom is that the structure of the aggregate does not impose an order of time. The abstract from his thesis is : In this dissertation I propose a shift in the foundations of computation. Modern programming systems are not expressive enough. The traditional image of a single computer that has global effects on a large memory is too restrictive. The propagation paradigm replaces this with computing by networks of local, independent, stateless machines interconnected with stateful storage
2 0.92477572 1636 high scalability-2014-04-23-Here's a 1300 Year Old Solution to Resilience - Rebuild, Rebuild, Rebuild
Introduction: How is it possible that a wooden Shinto shrine built in the 7th century is still standing? The answer depends on how you answer this philosophical head scratcher: With nearly every cell in your body continually being replaced, are you still the same person? The Ise Grand Shrine has been in continuous existence for over 1300 years because every twenty years an exact replica has been rebuilt on an adjacent footprint. The former temple is then dismantled. Now that's resilience. If you want something to last make it a living part of a culture. It's not so much the building that is remade, what is rebuilt and passed down from generation to generation is the meme that the shrine is important and worth preserving. The rest is an unfolding of that imperative. You can see echoes of this same process in Open Source projects like Linux and the libraries and frameworks that get themselves reconstructed in each new environment. The patterns of recurrence in software are the result of Darw
3 0.90884447 352 high scalability-2008-07-18-Robert Scoble's Rules for Successfully Scaling Startups
Introduction: Robert Scoble in an often poignant FriendFeed thread commiserating PodTech's unfortunate end, shared what he learned about creating a successful startup. Here's a summary of a Robert's rules and why Machiavelli just may agree with them: Have a story. Have everyone on board with that story. If anyone goes off of that story, make sure they get on board immediately or fire them. Make sure people are judged by the revenues they bring in. Those that bring in revenues should get to run the place. People who don't bring in revenues should get fewer and fewer responsibilities, not more and more. Work ONLY for a leader who will make the tough decisions. Build a place where excellence is expected, allowed, and is enabled. Fire idiots quickly. If your engineering team can't give a media team good measurements, the entire company is in trouble. Only things that are measured ever get improved. When your stars aren't listened to the company is in trouble. Getting rid of t
same-blog 4 0.87162107 532 high scalability-2009-03-11-Sharding and Connection Pools
Introduction: Hi we are looking at sharding our existing Java/Oracle based application. We are looking to make the app servers able to process requests for multiple (any?) shard. The concern that has come up is the amount of memory that would be consumed by having so many connection pools on one app server. Additionally there is concern about having so many physical connections to the database server coming from all the various app servers that may talk to that particular shard. I was wondering if anyone else has dealt with this issue and how you resolved it? Thanks, Scott
5 0.84990752 1234 high scalability-2012-04-26-Akaros - an open source operating system for manycore architectures
Introduction: If you are interested in future foward OS designs then you might find Akaros worth a look. It's an operating system designed for many-core architectures and large-scale SMP systems, with the goals of: Providing better support for parallel and high-performance applications Scaling the operating system to a large number of cores A more indepth explanation of the motiviation behind Akaros can be found in Improving Per-Node Efficiency in the Datacenter with NewOS Abstractions by Barret Rhoden, Kevin Klues, David Zhu, and Eric Brewer. The abstract: We believe datacenters can benefit from more focus on per-node efficiency, performance, and predictability, versus the more common focus so far on scalability to a large number of nodes. Improving per-node efficiency decreases costs and fault recovery because fewer nodes are required for the same amount of work. We believe that the use of complex, general-purpose operating systems is a key contributing factor to these inefficiencies
6 0.836775 885 high scalability-2010-08-23-Building a Scalable Key-Value Database: Project Hydracus
7 0.79237264 850 high scalability-2010-06-30-Paper: GraphLab: A New Framework For Parallel Machine Learning
8 0.77979106 157 high scalability-2007-11-16-Product: lbpool - Load Balancing JDBC Pool
9 0.77743787 357 high scalability-2008-07-26-Google's Paxos Made Live – An Engineering Perspective
10 0.77032971 988 high scalability-2011-02-11-Stuff The Internet Says On Scalability For February 11, 2011
11 0.75777161 169 high scalability-2007-12-01-many website, one setup, many databases
12 0.75707853 528 high scalability-2009-03-06-Product: Lightcloud - Key-Value Database
13 0.75699091 928 high scalability-2010-10-26-Scaling DISQUS to 75 Million Comments and 17,000 RPS
14 0.75206608 595 high scalability-2009-05-08-Publish-subscribe model does not scale?
15 0.75031346 717 high scalability-2009-10-07-How to Avoid the Top 5 Scale-Out Pitfalls
16 0.75001067 628 high scalability-2009-06-13-Neo4j - a Graph Database that Kicks Buttox
17 0.74867034 1242 high scalability-2012-05-09-Cell Architectures
18 0.74863851 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
19 0.74842119 1017 high scalability-2011-04-06-Netflix: Run Consistency Checkers All the time to Fixup Transactions
20 0.74807143 1438 high scalability-2013-04-10-Check Yourself Before You Wreck Yourself - Avocado's 5 Early Stages of Architecture Evolution