high_scalability high_scalability-2007 knowledge-graph by maker-knowledge-mining

high_scalability 2007 knowledge graph

similar blogs computed by tfidf model

similar blogs computed by lsi model

similar blogs computed by lda model

blogs list:

1 high scalability-2007-12-31-Product: collectd

Introduction: From http://directory.fsf.org/project/collectd/ : 'collectd' is a small daemon which collects system information every 10 seconds and writes the results in an RRD-file. The statistics gathered include: CPU and memory usage, system load, network latency (ping), network interface traffic, and system temperatures (using lm-sensors), and disk usage. 'collectd' is not a script; it is written in C for performance and portability. It stays in the memory so there is no need to start up a heavy interpreter every time new values should be logged. From the collectd website: Collectd gathers information about the system it is running on and stores this information. The information can then be used to do find current performance bottlenecks (i. e. performance analysis) and predict future system load (i. e. capacity planning). Or if you just want pretty graphs of your private server and are fed up with some homegrown solution you're at the right place, too ;). While collectd can do a l

2 high scalability-2007-12-30-MySQL clustering strategies and comparisions

Introduction: Compare: 1. MySQL Clustering(ndb-cluster stogare) 2. MySQL / GFS-GNBD/ HA 3. MySQL / DRBD /HA 4. MySQL Write Master / Multiple MySQL Read Slaves 5. Standalone MySQL Servers(Functionally seperated)

3 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half

Introduction: Update 2: Summize Computes Computing Resources for a Startup . Lots of nice graphs showing Amazon is hard to beat for small machines and become less cost efficient for well used larger machines. Long term storage costs may eat your saving away. And out of cloud bandwidth costs are high. Update: via ProductionScale , a nice Digital Web article on how to setup S3 to store media files and how Blue Origin was able to handle 3.5 million requests and 758 GBs in bandwidth in a single day for very little $$$. Also a Right Scale article on Network performance within Amazon EC2 and to Amazon S3 . 75MB/s between EC2 instances, 10.2MB/s between EC2 and S3 for download, 6.9MB/s upload. Now that Amazon's S3 (storage service) is out of beta and EC2 (elastic compute cloud) has added new instance types (the class of machine you can rent) with more CPU and more RAM, I thought it would be interesting to take a look out how their pricing stacks up. The quick conclusion: the m

4 high scalability-2007-12-26-Golden rule of web caching

Introduction: Effective content caching is one of the key features of scalable web sites. Although there are several out-of-the-box options for caching with modern web technologies, a custom built cache still provides the best performance.

5 high scalability-2007-12-26-Finding an excellent LAMP developer

Introduction: Hi... I have this idea to start a really great and scalable website, and I am building it! So far I'm doing everything myself - coding, networking, architecture planning, everything. I haven't even gotten into the legal aspects yet....... It would be MUCH easier if I had a technical person to handle that end of the operation. I'm a good coder, but like Bill Gates at Harvard for Math, I'm not the very best. I'd like to FIND that very best person available, to handle the technical aspects. For worse or better, I don't presently know somebody who fits this bill. I've posted a bazillion ads on Craig's List, with no really qualified responses. I've put out feelers among my own network, same result. Not sure what else I can do. Shoestring budget, so it's sweat equity in the beginning. That can actually be a plus, as it forces people to focus. Any ideas about what else I can do, to attract the right person? Thanks Jason

6 high scalability-2007-12-25-IBMer Says LAMP Can't Scale

Introduction: A very entertaining and somewhat educational article on IBM Poopheads say LAMP Users Need to "grow up" . The physical three tier architecture turns out to be the root of all evil and shared nothing architectures brings simplicity and light. In the comments Simon Willison makes an insightful comment on why fine grained caching works for personalized pages and proxy's don't: Great post, but I have to disagree with you on the finely grained caching part. If you look at big LAMP deployments such as Flickr, LiveJournal and Facebook the common technology component that enables them to scale is memcached - a tool for finely grained caching. That's not to say that they aren't doing shared-nothing, it's just that memcached is critical for helping the database layer scale. LiveJournal serves around 50% of its page views "permission controlled" (friends only) so an HTTP proxy on the front end isn't the right solution - but memcached reduces their database hits by 90%.

7 high scalability-2007-12-23-Synchronizing Memcached application

Introduction: I have an application with couple of web servers that uses MemcacheD. How can i synchronize concurrent put to the cache? The value of the entry is list. Atomic append operation could have been helpful, but unfortunately memcahe doesn't support atomic append.

8 high scalability-2007-12-22-This was a porn-spam post

Introduction: Seems as though anonymous users can edit old posts w/o any authentication. This post was loaded with spam/porn links. Now it is not. /anonymous

9 high scalability-2007-12-21-Strategy: Limit Result Sets

Introduction: Release It! author Michael Nygard tells a tale of two web sites , both brought low by unexpectedly huge unbounded results sets that slowed down their sites to the speed of a Christmas checkout line. I've committed this error more than a few times. During testing the results sets are often small, so you don't see problems. Or when a product is new you don't have a lot of data so everything is fine, until some magic line is crossed and you get that dreaded 2AM fix it call. My most embarrassing bug of this type caused a rather spectacular failure at a customer site as the variance in response times was out of spec and this kicked in penalty clauses. What happened was the customer had a larger network than we could even test (customers always get the good stuff). I took a lock and went to get all the data. Because the result set was so much larger in their larger system I took the lock for many more milliseconds than I should have. Unknown to me a chunk of code on the criti

10 high scalability-2007-12-19-How can I learn to scale my project?

Introduction: This is a question asked on the ycombinator list and there are some good responses. I gave a quick response, but I particularly like neilk's knock out of the park insightful answer: Read Cal Henderson's book. (I'd add in Theo's book and Release It! too) The center of your design should be the data store, not a process. You transition the data store from state to state, securely and reliably, in small increments. Avoid globals and session state. The more "pure" your function is, the easier it will be to cache or partition. Don't make your data store too smart. Calculations and renderings should happen in a separate, asynchronous process. The data store should be able to handle lots of concurrent connections. Minimize locking. (Read about optimistic locking). Protect your algorithm from the implementation of the data store, with a helper class or module or whatever. But don't (DO NOT) try to build a framework for any conceivable query. Just the ones your algorithm needs. V

11 high scalability-2007-12-14-The Current Pros and Cons List for SimpleDB

Introduction: Not surprisingly opinions on SimpleDB vary from it sucks, don't take my database, to it will change the world, who needs a database anyway? From a quick survey of the blogosphere , here's where SimpleDB stands at the moment: SimpleDB Cons No SLA. We don't know how reliable it will be, how fast it will be, or how consistent the performance will be. Consistency constraints are relaxed. Reading data immediately after a write may not reflect the latest updates. To programmers used to transactions, this may be surprising, but many people think this is one of the tradeoffs that needs to be made to scale. Database is a core competency. If you don't control your database you can't out compete your competition. When your database is out of your control you can't guarantee it will work properly. You can't create the proper indexes and other optimizations. No join or IN operator. You'll need to do multiple client side calls to simulate joins, which will be slow. No

12 high scalability-2007-12-13-un-article: the setup behind microsoft.com

Introduction: On the blogs.technet.com article on microsoft.com's infrastructure: The article reads like a blatant ad for it's own products, and is light on the technical side. The juicy bits are here, so you know what the fuss is about: Cytrix Netscaler (= loadbalancer with various optimizations) W2K8 + IIS7 and antivirus software on the webservers 650GB/day ISS log files 8-9GBit/s (unknown if CDN's are included) Simple network filtering: stateless access lists blocking unwanted ports on the routers/switches (hence the debated "no firewalls" claim). Note that this information may not reflect present reality very well; the spokesman appears to be reciting others words.

13 high scalability-2007-12-13-Is premature scalation a real disease?

Introduction: Update 3: InfoQ's Big Architecture Up Front - A Case of Premature Scalaculation? twines several different threads on the topic together into a fine noose. Update 2: Kevin says the biggest problems he sees with startups is they need to scale their backend (no, the other one). Update: My bad. It's hard to sell scalability so just forget it. The premise of Startups and The Problem Of Premature Scalaculation and Donâ€™t scale: 99.999% uptime is for Wal-Mart is that you shouldn't spend precious limited resources worrying about scaling before you've first implemented the functionality that will make you successful enough to have scaling problems in the first place. It's kind of an embodied life force model of system creation. Energy is scarce so any parasites siphoning off energy must be hunted down and destroyed so the body has its best chance of survival. Is this really how it works? If I ever believed this I certainly don't believe it anymore. The world has c

14 high scalability-2007-12-13-Amazon SimpleDB - Scalable Cloud Database

Introduction: Amazon has announced the limited beta of Amazon SimpleDB - a simple web services interface to create and store multiple data sets, query your data easily, and return the results. Together with the Simple Storage Service (S3), Elastic Compute Cloud (EC2) and other web services Amazon offers a complete utility computing platform. SimpleDB was the missing piece of AWS - the scalable structured database. Check out my blog entry: http://innowave.blogspot.com/2007/12/amazon-simpledb-scalable-cloud-database.html I was waiting for this one :-) Geekr

15 high scalability-2007-12-12-Report from OpenSocial Meetup at Google

Introduction: Update: Facebook pulls a Microsoft and embraces and extends by opening their platform to other social sites like Bebo. Very smart and unexpected. More info at Facebook to let other sites access platform code . This month's regular Facebook Meetup was held at Google and the topic of the day was OpenSocial . For those of you with real lives, OpenSocial "provides a common set of APIs for social applications across multiple websites." Over 200 excited people, hoping to do very exciting things, and dreaming of making an exciting pile of money, watched an OpenSocial presentation put on by a couple of appropriately knowledgeable evangelists. I could feel my social graph being more successfully monetized with each passing minute. Normally the meetings are much smaller, but Google puts on a very nice spread, so I think people may have showed up to dine :-) Or they could have showed up to learn why and how they should code to the new uber social API. By the looks of the full pl

16 high scalability-2007-12-12-Oracle Can Do Read-Write Splitting Too

Introduction: People sometimes wonder why Oracle isn't mentioned on this site more. Maybe it will now as Michael Nygard reports Oracle 11g now does read/write splitting with their Active Data Guard product. Average replication latency was 1 second and it's accomplished with standard Oracle JDBC drivers. They see a 250% increase in transactions per service for read-write service. And a 110% improvement in tps for read-only service was found. You see a change in hardware architecture with the new setup. They now recommend using a primary and multiple standby servers, a single controller per server, and a single set of disks in RAID1. Previously the recommendation was to have a primary and secondary server with two controllers per server and a set of mirrored disks per controller. The changes increase performance, availability, and hardware utilization. They also have a useful looking best practices document for High Availability called Maximum Availability Architecture (MAA) .

17 high scalability-2007-12-11-Hosting and CDN for startup video sharing site

Introduction: This question is for all the gurus here. Please help this novice x I am starting a video sharing site like YouTube in India. I want to offer the best quality possible, at minimum cost. Nothing new about it, right? :). I have done some research on the dedicated hosting services and CDN services available and I have some basic knowledge on these. Following are my requirements 1) My budget is $500 to $1000 per month for hosting (including CDN if and as applicable). 2) I will need around 500GB of storage and 1TB per month of bandwidth in first 2-3 months and then about 10TB of storage and 5TB per month of bandwidth. And more ... depending on how big it gets (I can afford more when it gets big) 3) 90% of my viewers are in India. Other 10% are in US and UK. Based on the above, could you please answer my following questions? 1) Can I go with just a good dedicated server to start with and get a CDN service later on when the site gets big? Or do you think its wise

18 high scalability-2007-12-10-Scalability Developer Competition Launched by GigaSpaces - $25k in prizes

Introduction: Today GigaSpaces launched the OpenSpaces Developer Challenge , which will award $25,000 in prizes to developers who build the most unique and innovative applications or plug-ins for the OpenSpaces Framework . OpenSpaces is an open source development solution from GigaSpaces for building linearly scalable software applications. It is widely used in a variety of industries, such as Wall Street trading applications, telecommunications platforms and online gaming. The Challenge is designed to encourage innovation around OpenSpaces and support the developer community. Prizes ranging from $1,000 to $10,000 will be awarded to those who submit the most promising applications that were built using OpenSpaces, or plug-ins, and other components that extend OpenSpaces in pioneering ways. The OpenSpaces development framework is designed to simply and dynamically scale out a software application across many computers -- also referred to as "cloud computing." It is unique in that it

19 high scalability-2007-12-10-Future of EJB3 !! ??

Introduction: What i s the future of EJB3 i n the i ndustry , g i ven the current trends ? There are a l ot of arguments regard i ng EJB3 be i ng heavy we i ghted ..... A l so, what cou l d be the a l ternat i ves of EJB3 ? How about the sca l abi l ity, pers i stence, performance and other factors ?

20 high scalability-2007-12-10-1 Master, N Slaves

Introduction: Hello all, Reading the site you can note that "1 Master for writes, N Slaves for reads" scheme is used offen. How is this implemented? Who decides where writes and reads go? Something in application level or specific database proxies, like Slony-I? Thanks.

21 high scalability-2007-12-08-thesimsonstage.ea.com

22 high scalability-2007-12-07-Synchronizing databases in different geographic locations

23 high scalability-2007-12-05-how to: Load Balancing with iis

24 high scalability-2007-12-05-Product: Tugela Cache

25 high scalability-2007-12-05-Easier Production Releases

26 high scalability-2007-12-02-nginx: high performance smpt-pop-imap proxy

27 high scalability-2007-12-02-a8cjdbc - update verision 1.3

28 high scalability-2007-12-02-Database-Clustering: a8cjdbc - update: version 1.3

29 high scalability-2007-12-01-many website, one setup, many databases

30 high scalability-2007-11-30-Strategy: Efficiently Geo-referencing IPs

31 high scalability-2007-11-27-Starting a website from scratch - what technologies should I use?

32 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory