high_scalability high_scalability-2008 high_scalability-2008-346 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hi, Generating unique ids is a common requirements in many projects. Generally, this responsibility is given to Database layer. By using sequences or some other technique. This is a problem for horizontal scalability. What are the Guid generation schemes used in high scalable web sites generally? I have seen use java's SecureRandom class to generate Guid. What are the other methods generally used? Thanks Unmesh
sentIndex sentText sentNum sentScore
1 Hi, Generating unique ids is a common requirements in many projects. [sent-1, score-0.672]
2 What are the Guid generation schemes used in high scalable web sites generally? [sent-5, score-0.842]
3 I have seen use java's SecureRandom class to generate Guid. [sent-6, score-0.515]
wordName wordTfidf (topN-words)
[('generally', 0.501), ('guid', 0.385), ('sequences', 0.343), ('schemes', 0.266), ('ids', 0.237), ('responsibility', 0.223), ('methods', 0.204), ('horizontal', 0.191), ('generate', 0.177), ('class', 0.164), ('generation', 0.154), ('requirements', 0.146), ('seen', 0.138), ('unique', 0.131), ('sites', 0.125), ('given', 0.118), ('used', 0.116), ('common', 0.106), ('java', 0.103), ('scalable', 0.074), ('problem', 0.073), ('high', 0.057), ('many', 0.052), ('web', 0.05), ('database', 0.05), ('using', 0.038), ('use', 0.036)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 346 high scalability-2008-06-28-ID generation schemes
Introduction: Hi, Generating unique ids is a common requirements in many projects. Generally, this responsibility is given to Database layer. By using sequences or some other technique. This is a problem for horizontal scalability. What are the Guid generation schemes used in high scalable web sites generally? I have seen use java's SecureRandom class to generate Guid. What are the other methods generally used? Thanks Unmesh
2 0.16678427 606 high scalability-2009-05-25-non-sequential, unique identifier, strategy question
Introduction: (Please bare with me, I'm a new, passionate, confident and terrified programmer :D ) Background: I'm pre-launch and 1 year into the development of my application. My target is to be able to eventually handle millions of registered users with 5-10% of them concurrent. Up to this point I've used auto-increment to assign unique identifiers to rows. I am now considering switching to a non-sequential strategy. Oh, I'm using the LAMP configuration. My reasons for avoiding auto-increment: 1. Complicates replication when scaling horizontally. Risk of collision is significant (when running multiple masters). Note: I've read the other entries in this forum that relate to ID generation and there have been some great suggestions -- including a strategy that uses auto-increment in a way that avoids this pitfall... That said, I'm still nervous about it. 2. Potential bottleneck when retrieving/assigning IDs -- IDs assigned at the database. My reasons for being nervous about
3 0.12382729 565 high scalability-2009-04-13-Benchmark for keeping data in browser in AJAX projects
Introduction: Hi, We are using AJAX and see a lot of opportunity to keep session state on client browser with javascript objects. Is there any benchmark about how much data you can generally keep in javascript objects in browser? Thanks, Unmesh
Introduction: If you stayed up all night watching the life reaffirming Curiosity landing on Mars , then this paper, High-Performance Concurrency Control Mechanisms for Main-Memory Databases , has nothing to do with that at all, but it is an excellent look at how to use optimistic MVCC schemes to reduce lock overhead on in-memory datastructures: A database system optimized for in-memory storage can support much higher transaction rates than current systems. However, standard concurrency control methods used today do not scale to the high transaction rates achievable by such systems. In this paper we introduce two efficient concurrency control methods specifically designed for main-memory databases. Both use multiversioning to isolate read-only transactions from updates but differ in how atomicity is ensured: one is optimistic and one is pessimistic. To avoid expensive context switching, transactions never block during normal processing but they may have to wait before commit to ensure corr
5 0.092538863 202 high scalability-2008-01-06-Email Architecture
Introduction: I would like to know email architecture used by large ISPs.. or even used by google. Can someone point me to some sites?? Thanks..
6 0.090572834 145 high scalability-2007-11-08-ID generator
7 0.090000756 574 high scalability-2009-04-20-Some things about Memcached from a Twitter software developer
8 0.084756978 459 high scalability-2008-12-03-Java World Interview on Scalability and Other Java Scalability Secrets
9 0.076900981 500 high scalability-2009-01-22-Heterogeneous vs. Homogeneous System Architectures
10 0.075737551 736 high scalability-2009-11-04-Damn, Which Database do I Use Now?
11 0.069132097 1123 high scalability-2011-09-23-The Real News is Not that Facebook Serves Up 1 Trillion Pages a Month…
12 0.06668251 1311 high scalability-2012-08-24-Stuff The Internet Says On Scalability For August 24, 2012
13 0.06571357 58 high scalability-2007-08-04-Product: Cacti
14 0.065180138 392 high scalability-2008-09-24-Building a Scalable Architecture for Web Apps
15 0.065148167 1472 high scalability-2013-06-07-Stuff The Internet Says On Scalability For June 7, 2013
16 0.064171791 927 high scalability-2010-10-26-Marrying memcached and NoSQL
17 0.063437447 157 high scalability-2007-11-16-Product: lbpool - Load Balancing JDBC Pool
18 0.062618226 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star
19 0.059997987 561 high scalability-2009-04-08-N+1+caching is ok?
20 0.058388632 1205 high scalability-2012-03-07-Scale Indefinitely on S3 With These Secrets of the S3 Masters
topicId topicWeight
[(0, 0.077), (1, 0.02), (2, -0.008), (3, -0.042), (4, 0.022), (5, 0.021), (6, -0.007), (7, -0.016), (8, -0.014), (9, 0.029), (10, -0.004), (11, 0.037), (12, -0.012), (13, 0.008), (14, -0.006), (15, -0.038), (16, 0.013), (17, -0.016), (18, 0.039), (19, 0.001), (20, -0.03), (21, -0.017), (22, -0.005), (23, -0.039), (24, -0.034), (25, -0.048), (26, 0.015), (27, -0.013), (28, 0.031), (29, -0.008), (30, -0.005), (31, -0.016), (32, 0.021), (33, -0.065), (34, -0.04), (35, -0.029), (36, -0.024), (37, 0.015), (38, -0.023), (39, -0.043), (40, 0.015), (41, 0.041), (42, -0.031), (43, 0.029), (44, 0.01), (45, -0.029), (46, -0.008), (47, -0.028), (48, -0.024), (49, -0.033)]
simIndex simValue blogId blogTitle
same-blog 1 0.94991899 346 high scalability-2008-06-28-ID generation schemes
Introduction: Hi, Generating unique ids is a common requirements in many projects. Generally, this responsibility is given to Database layer. By using sequences or some other technique. This is a problem for horizontal scalability. What are the Guid generation schemes used in high scalable web sites generally? I have seen use java's SecureRandom class to generate Guid. What are the other methods generally used? Thanks Unmesh
2 0.67120135 82 high scalability-2007-09-06-Why doesn't anyone use j2ee?
Introduction: From a reader: > Was reading through your very interesting/useful site. >Most of the architectures are non j2ee-Does that mean that >there aren't enough websites that are scalable(with youtube > like userbase) built with j2ee tech-would like to know if there > are any and their architecture as >well. eBay uses Java, but in a very pragmatic way. They use servlets, an application server, the JDK, and they do the rest themselves. They skip JSP, entity beans, and JMS. When you need to scale putting all your eggs in one basket is a risky strategy. Why use JSP when you can do better? When use entity beans when you can do better? Use servlets because they are a very effective way of handling http requests. Use Java because it is fast, runs everywhere, and has a boat load of libraries you can use to build your build your custom system. Probably the major reason J2EE is absentee is simply LAMP. LAMP is just so incredibly functional for most 2-tier shared nothing site
3 0.62962699 10 high scalability-2007-07-15-Book: Building Scalable Web Sites
Introduction: Building, scaling, and optimizing the next generation of web applications. Learn the tricks of the trade so you can build and architect applications that scale quickly--without all the high-priced headaches and service-level agreements associated with enterprise app servers and proprietary programming and database products. Culled from the experience of the Flickr.com lead developer, Building Scalable Web Sites offers techniques for creating fast sites that your visitors will find a pleasure to use. Creating popular sites requires much more than fast hardware with lots of memory and hard drive space. It requires thinking about how to grow over time, how to make the same resources accessible to audiences with different expectations, and how to have a team of developers work on a site without creating new problems for visitors and for each other. Presenting information to visitors from all over the world * Integrating email with your web applications * Planning hardware purch
4 0.6198343 131 high scalability-2007-10-25-Should JSPs be avoided for high scalability?
Introduction: I just heard about some web sites where Velocity templates are used to render HTML instead of using JSPs and all the processing in performed in servlets. Can JSPs cause issue with scalability? Thanks, Unmesh
5 0.60653251 434 high scalability-2008-10-30-Olio Web2.0 Toolkit - Evaluate Web Technologies and Tools
Introduction: How do you evaluate and decide which web technologies (and there are myriads out there) to use for your new web application, which one potentially gives you the best performance, which one will likely give you the shortest time-to-market? The Apache incubator project Olio might help. Olio is a is an open source web 2.0 toolkit to help evaluate the suitability, functionality and performance of web technologies. Olio defines an example web2.0 application (an events site somewhat like yahoo.com/upcoming) and provides three initial implementations : PHP, Java EE and RubyOnRails (ROR). The toolkit also defines ways to drive load against the application in order to measure performance. Apache Olio could be used to Understand how to use various web 2.0 technologies such as AJAX, memcached, mogileFS etc. Use the code in the application to understand the subtle complexities involved and how to get around issues with these technologies. Evaluate the differences in the three imp
6 0.58416164 232 high scalability-2008-01-29-When things aren't scalable
7 0.57359767 684 high scalability-2009-08-18-Real World Web: Performance & Scalability
8 0.57034016 1258 high scalability-2012-06-05-Thesis: Concurrent Programming for Scalable Web Architectures
9 0.56874555 31 high scalability-2007-07-26-Product: Symfony a Web Framework
10 0.56861734 392 high scalability-2008-09-24-Building a Scalable Architecture for Web Apps
11 0.55753779 122 high scalability-2007-10-14-Product: The Spread Toolkit
12 0.5529511 71 high scalability-2007-08-22-Profiling WEB applications
13 0.54657197 202 high scalability-2008-01-06-Email Architecture
14 0.54563302 97 high scalability-2007-09-18-Session management in highly scalable web sites
15 0.54241705 459 high scalability-2008-12-03-Java World Interview on Scalability and Other Java Scalability Secrets
16 0.53935838 501 high scalability-2009-01-25-Where do I start?
17 0.5367794 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star
18 0.52818906 695 high scalability-2009-09-06-Some Hot Links
19 0.52565062 606 high scalability-2009-05-25-non-sequential, unique identifier, strategy question
20 0.52508575 584 high scalability-2009-04-27-Some Questions from a newbie
topicId topicWeight
[(1, 0.14), (2, 0.244), (25, 0.309), (61, 0.125)]
simIndex simValue blogId blogTitle
1 0.91639078 246 high scalability-2008-02-12-Search the tags across all post
Introduction: Let suppose i have table which stored tags .Now user can enter keywords and i have to search through all the records in table and find post which contain tags entered by user .user can enter more than 1 keywords. What strategy ,technique i use to search fast .There maybe more than millions records and many users are firing same query. Thanks
2 0.82467711 203 high scalability-2008-01-07-How Ruby on Rails Survived a 550k Pageview Digging
Introduction: Shanti Braford details how his Ruby on Rails based website survived a 24 hour 550,000+ pageview digg attack. His post cleanly lays out all the juicy setup details, so there's not much I can add. Hosting costs $370 a month for 1 web server, 1 database server, and sufficient bandwidth. The site is built on RoR, nginx, MySQL, and 7 mongrel servers. He thinks Rails 2.0 has improved performance and credits database avoidance and fragment caching for much of the performance boost. Keep in mind his system is relatively static, but it's a very interesting and useful experience report.
3 0.80008495 412 high scalability-2008-10-14-Sun N1 Grid Engine Software and the Tokyo Institute of Technology Super Computer Grid
Introduction: One of the world's leading technical institutes, the Tokyo Institute of Technology (Tokyo Tech) created the fastest supercomputer in Asia, and one of the largest outside of the United States. Using Sun x64 servers and data servers deployed in a grid architecture, Tokyo Tech built a cost-effective, flexible supercomputer that meets the demands of compute- and data-intensive applications. Built in just 35 days, the TSUBAME grid includes hundreds of systems incorporating thousands of processor cores and terabytes of memory, and delivers 47.38 trillion1 floating-point operations per second (TeraFLOPS) of sustained LINPACK benchmark performance and 1.1 petabyte of storage to users running common off-the-shelf applications. Based on the deployment architecture, the grid is expected to reach 100 TeraFLOPS in the future. This Sun BluePrints article provides an overview of the Tokyo Tech grid, named TSUBAME. The third in a series of Sun BluePrints articles on the TSUBAME grid, this document pro
Introduction: One of the world's leading technical institutes, the Tokyo Institute of Technology (Tokyo Tech) created the fastest supercomputer in Asia, and one of the largest outside of the United States. Using Sun x64 servers and data servers deployed in a grid architecture, Tokyo Tech built a cost-effective, flexible supercomputer that meets the demands of compute and data-intensive applications. Built in just 35 days, the TSUBAME grid includes hundreds of systems incorporating thousands of processor cores and terabytes of memory, and delivers 47.38 trillion floating-point operations per second (TeraFLOPS) of sustained LINPACK benchmark performance and 1.1 petabyte of storage to users running common off-the-shelf applications. Based on the deployment architecture, the grid is expected to reach 100 TeraFLOPS in the future. This article provides an overview of the Tokyo Tech grid, named TSUBAME. The first in a series of Sun BluePrints articles on the TSUBAME grid, this document discusses the re
5 0.77807051 253 high scalability-2008-02-19-Building a email communication system
Introduction: hi, the website i work for is looking to build a email system that can handle a fair few emails (up to a hundred thousand a day). These comprise emails like registration emails, newsletters, lots of user triggered emails and overnight emails. At present we queue them in SQL and feed them into an smtp server on one of our web servers when the queue drops below a certain level. this has caused our mail system to crash as well as hammer our DB server (shared!!!). We have got an architecture of what we want to build but thought there might be something we could buy off the shelf that allowed us to keep templated emails, lists of recipients, schedule sends etc and report on it. We can't find anything What do big websites like amazon etc use or people a little smaller but who still send loads of mail (flickr, ebuyer, or other ecommerce sites) Cheers tarqs
6 0.77113736 770 high scalability-2010-02-03-NoSQL Means Never Having to Store Blobs Again
7 0.76552433 408 high scalability-2008-10-10-Useful Corporate Blogs that Talk About Scalability
8 0.75166273 992 high scalability-2011-02-18-Stuff The Internet Says On Scalability For February 18, 2011
same-blog 9 0.7510705 346 high scalability-2008-06-28-ID generation schemes
10 0.73683035 805 high scalability-2010-04-06-Strategy: Make it Really Fast vs Do the Work Up Front
11 0.73048645 870 high scalability-2010-08-02-7 Scaling Strategies Facebook Used to Grow to 500 Million Users
12 0.72497076 1607 high scalability-2014-03-07-Stuff The Internet Says On Scalability For March 7th, 2014
13 0.72093242 1214 high scalability-2012-03-23-Stuff The Internet Says On Scalability For March 23, 2012
14 0.70871711 545 high scalability-2009-03-19-Product: Redis - Not Just Another Key-Value Store
15 0.70730722 987 high scalability-2011-02-10-Dispelling the New SSL Myth
16 0.69847405 379 high scalability-2008-09-04-Database question for upcoming project
17 0.69714022 877 high scalability-2010-08-12-Designing Web Applications for Scalability
18 0.6890133 685 high scalability-2009-08-20-Dependency Injection and AOP frameworks for .NET
19 0.68751884 754 high scalability-2009-12-22-Incremental deployment
20 0.68730497 64 high scalability-2007-08-10-How do we make a large real-time search engine?