high_scalability high_scalability-2010 high_scalability-2010-794 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: It looks like I'll have the chance to interview someone tomorrow from Justin.tv about their architecture, which is pretty exciting given their leadership role in live broadcasting. They get 30 million uniques a month, can handle 1 million simultaneous broadcasts and hope to grow another magnitude in the near future. That must take some doing. Here's your opportunity, especially if you think my questions suck, to ask your own sucky questions :-) What would you like to know about Justin.tv?
sentIndex sentText sentNum sentScore
1 It looks like I'll have the chance to interview someone tomorrow from Justin. [sent-1, score-0.855]
2 tv about their architecture, which is pretty exciting given their leadership role in live broadcasting. [sent-2, score-0.889]
3 They get 30 million uniques a month, can handle 1 million simultaneous broadcasts and hope to grow another magnitude in the near future. [sent-3, score-1.937]
4 Here's your opportunity, especially if you think my questions suck, to ask your own sucky questions :-) What would you like to know about Justin. [sent-5, score-1.357]
wordName wordTfidf (topN-words)
[('sucky', 0.361), ('broadcasts', 0.339), ('uniques', 0.294), ('tomorrow', 0.256), ('questions', 0.255), ('leadership', 0.246), ('suck', 0.219), ('simultaneous', 0.193), ('exciting', 0.173), ('magnitude', 0.166), ('near', 0.161), ('million', 0.156), ('interview', 0.154), ('opportunity', 0.153), ('hope', 0.152), ('chance', 0.152), ('role', 0.152), ('ask', 0.142), ('month', 0.133), ('grow', 0.12), ('looks', 0.117), ('someone', 0.115), ('pretty', 0.114), ('especially', 0.112), ('given', 0.104), ('live', 0.1), ('must', 0.085), ('another', 0.079), ('handle', 0.078), ('think', 0.064), ('architecture', 0.062), ('like', 0.061), ('know', 0.06), ('take', 0.053), ('would', 0.047), ('get', 0.043)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 794 high scalability-2010-03-11-What would you like to ask Justin.tv?
Introduction: It looks like I'll have the chance to interview someone tomorrow from Justin.tv about their architecture, which is pretty exciting given their leadership role in live broadcasting. They get 30 million uniques a month, can handle 1 million simultaneous broadcasts and hope to grow another magnitude in the near future. That must take some doing. Here's your opportunity, especially if you think my questions suck, to ask your own sucky questions :-) What would you like to know about Justin.tv?
2 0.08902514 202 high scalability-2008-01-06-Email Architecture
Introduction: I would like to know email architecture used by large ISPs.. or even used by google. Can someone point me to some sites?? Thanks..
3 0.081108697 277 high scalability-2008-03-16-Do you have any questions for the Elastra CEO?
Introduction: It looks like in the near future I'll have a chance to interview the Elastra CEO. Elastra provides standard databases--MySQL, EnterpriseDB and PostgreSQL-- on top of EC2 and S3. They are selling aggressive pricing, expandable and contactable database resource usage in response to demand, and a simple management and operations interface to well known databases deployed in a cloud. Elastra could be an important option for developers looking for a more traditional cloudy database. I was wondering if you guys had any suggestions for questions you would like answered? What would you like to know about their service? What are you looking for in a cloudy database? What would stop you from adopting it or what would make you decide to adopt it? Any ideas you have would help a lot and will probably be better than anything I have.
4 0.07119789 638 high scalability-2009-06-26-PlentyOfFish Architecture
Introduction: Update 5 : PlentyOfFish Update - 6 Billion Pageviews And 32 Billion Images A Month Update 4 : Jeff Atwood costs out Markus' scale up approach against a scale out approach and finds scale up wanting. The discussion in the comments is as interesting as the article. My guess is Markus doesn't want to rewrite his software to work across a scale out cluster so even if it's more expensive scale up works better for his needs. Update 3 : POF now has 200 million images and serves 10,000 images served per second. They'll be moving to a 250,000 IOPS RamSan to handle the load. Also upgraded to a core database machine with 512 GB of RAM, 32 CPU’s, SQLServer 2008 and Windows 2008. Update 2 : This seems to be a POF Peer1 love fest infomercial . It's pretty content free, but the production values are high. Lots of quirky sounds and fish swimming on the screen. Update : by Facebook standards Read/WriteWeb says POF is worth a cool one billion dollars . It helps to talk like Dr. Evil whe
5 0.071041681 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
6 0.071041681 260 high scalability-2008-02-25-Architecture Template Advice Needed
7 0.071034148 67 high scalability-2007-08-17-What is the best hosting option?
8 0.07071653 1361 high scalability-2012-11-22-Gone Fishin': PlentyOfFish Architecture
9 0.067130432 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
10 0.066984333 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
11 0.065511294 1388 high scalability-2013-01-16-What if Cars Were Rented Like We Hire Programmers?
12 0.064516291 123 high scalability-2007-10-15-Olympic Site Architecture
13 0.064431474 590 high scalability-2009-05-06-Art of Distributed
14 0.064216256 1368 high scalability-2012-12-07-Stuff The Internet Says On Scalability For December 7, 2012
15 0.063029259 1353 high scalability-2012-11-01-Cost Analysis: TripAdvisor and Pinterest costs on the AWS cloud
16 0.062333222 111 high scalability-2007-10-04-Number of load balanced servers
17 0.060705535 1131 high scalability-2011-10-24-StackExchange Architecture Updates - Running Smoothly, Amazon 4x More Expensive
18 0.060413271 1438 high scalability-2013-04-10-Check Yourself Before You Wreck Yourself - Avocado's 5 Early Stages of Architecture Evolution
19 0.058815274 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
20 0.058782678 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
topicId topicWeight
[(0, 0.08), (1, 0.033), (2, 0.0), (3, -0.015), (4, 0.015), (5, -0.049), (6, -0.053), (7, 0.031), (8, 0.019), (9, -0.019), (10, -0.02), (11, 0.015), (12, 0.002), (13, 0.025), (14, 0.015), (15, 0.016), (16, -0.007), (17, 0.025), (18, -0.027), (19, 0.022), (20, -0.013), (21, -0.015), (22, -0.022), (23, -0.064), (24, 0.012), (25, -0.044), (26, 0.028), (27, 0.014), (28, -0.01), (29, 0.04), (30, -0.002), (31, 0.017), (32, -0.017), (33, -0.002), (34, -0.007), (35, -0.005), (36, 0.004), (37, 0.007), (38, 0.047), (39, 0.012), (40, -0.005), (41, 0.03), (42, 0.014), (43, 0.03), (44, -0.012), (45, -0.04), (46, -0.001), (47, 0.024), (48, 0.005), (49, -0.006)]
simIndex simValue blogId blogTitle
same-blog 1 0.97129375 794 high scalability-2010-03-11-What would you like to ask Justin.tv?
Introduction: It looks like I'll have the chance to interview someone tomorrow from Justin.tv about their architecture, which is pretty exciting given their leadership role in live broadcasting. They get 30 million uniques a month, can handle 1 million simultaneous broadcasts and hope to grow another magnitude in the near future. That must take some doing. Here's your opportunity, especially if you think my questions suck, to ask your own sucky questions :-) What would you like to know about Justin.tv?
Introduction: You know your product is doing well when most of your early blog posts deal with the status of the waiting list of hundreds of thousands of users eagerly waiting to download your product. That's the enviable position Mailbox , a free mobile email management app, found themselves early in their release cycle. Hasn't email been done already? Apparently not. Mailbox scaled to one million users in a paltry six weeks with a team of about 14 people . As of April they were delivering over 100 million messages per day . How did they do it? Mailbox engineering lead, Sean Beausoleil , gave an informative interview on readwrite.com on how Mailbox planned to scale... Gather signals early . A pre-release launch video helped generate interest, but it also allowed them to gauge early interest before even releasing. From the overwhelming response they knew they would need to have to scale and scale quickly. Have something unique . The average person might not think a mailbox app
3 0.67501456 107 high scalability-2007-10-02-Some Real Financial Numbers for Your Startup
Introduction: If you are a startup you may find useful Guy Kawasaki's post Financial Models for Underachievers: Two Years of the Real Numbers of a Startup . Part of any business plan are the projected guestimates. They are guestimates because everyone keeps these numbers hidden like a Swiss bank account. But not Redfin . They've bravely shared their initial cost projections, their actual numbers from real life, and the lessons they've learned from the discrepancy between the two... You can find their model estimates and actuals for Rent, Per Employee, Per Month (model: $250, actual: $336); Initial Per-Employee Equipment Cost; Monthly Benefits, Per-Employee; Annual Payroll Tax; Quarterly Bonus Payout, as a % of the Total Possible; Annual Payroll Increase for Existing Employees; All-Company Meeting Cost, Per-Meeting, Per-Employee; Annual Accounting Costs, and a few more. There is also a great lessons section: Focus on headcount; Plan slow, run fast; Run top-down sanity-checks; Fo
4 0.66406471 193 high scalability-2007-12-26-Finding an excellent LAMP developer
Introduction: Hi... I have this idea to start a really great and scalable website, and I am building it! So far I'm doing everything myself - coding, networking, architecture planning, everything. I haven't even gotten into the legal aspects yet....... It would be MUCH easier if I had a technical person to handle that end of the operation. I'm a good coder, but like Bill Gates at Harvard for Math, I'm not the very best. I'd like to FIND that very best person available, to handle the technical aspects. For worse or better, I don't presently know somebody who fits this bill. I've posted a bazillion ads on Craig's List, with no really qualified responses. I've put out feelers among my own network, same result. Not sure what else I can do. Shoestring budget, so it's sweat equity in the beginning. That can actually be a plus, as it forces people to focus. Any ideas about what else I can do, to attract the right person? Thanks Jason
5 0.64741302 1388 high scalability-2013-01-16-What if Cars Were Rented Like We Hire Programmers?
Introduction: Imagine if you will that car rental agencies rented cars like programmers are hired at many software companies... Agency : So sorry you had to wait in the reception area for an hour. Nobody knew you were coming to today. I finally found 8 people to interview before we can rent you a car. If we like you you may have to come in for another round of interviews tomorrow because our manager isn't in today. I didn't have a chance to read your application, so I'll just start with a question. What car do you drive today? Applicant : I drive a 2008 Subaru. Agency : That's a shame. We don't have a Subaru to rent you. Applicant : That's OK. Any car will do. Agency : No, we can only take on clients who know how to drive the cars we stock. We find it's safer that way. There are so many little differences between cars, we just don't want to take a chance. Applicant : I have a drivers license. I know how to drive. I've been driving all kinds of cars for 15 years, I am sure I can adapt.
6 0.64451295 1027 high scalability-2011-04-20-Packet Pushers: How to Build a Low Cost Data Center
7 0.63430661 1361 high scalability-2012-11-22-Gone Fishin': PlentyOfFish Architecture
8 0.63174307 638 high scalability-2009-06-26-PlentyOfFish Architecture
9 0.62714702 1432 high scalability-2013-04-01-Khan Academy Checkbook Scaling to 6 Million Users a Month on GAE
10 0.6267221 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
11 0.62224162 185 high scalability-2007-12-13-Is premature scalation a real disease?
12 0.61688381 67 high scalability-2007-08-17-What is the best hosting option?
14 0.6059832 1298 high scalability-2012-08-05-Ask MemSQL: Anything you want to know about MemSQL?
15 0.6039753 551 high scalability-2009-03-30-Lavabit Architecture - Creating a Scalable Email Service
16 0.60335284 76 high scalability-2007-08-29-Skype Failed the Boot Scalability Test: Is P2P fundamentally flawed?
17 0.60065341 1602 high scalability-2014-02-26-The WhatsApp Architecture Facebook Bought For $19 Billion
18 0.5992412 840 high scalability-2010-06-10-The Four Meta Secrets of Scaling at Facebook
19 0.59910703 1108 high scalability-2011-08-31-Pud is the Anti-Stack - Windows, CFML, Dropbox, Xeround, JungleDisk, ELB
20 0.59892297 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
topicId topicWeight
[(1, 0.071), (2, 0.271), (6, 0.34), (79, 0.165)]
simIndex simValue blogId blogTitle
1 0.87110364 104 high scalability-2007-10-01-SmugMug Found their Perfect Storage Array
Introduction: SmugMug's CEO & Chief Geek Don MacAskill smugly (hard to resist) gushes over finally finding, after a long and arduous quest, their "best bang-for-the-buck storage array." It's the Dell MD300 . His in-depth explanation of why he prefers the MD3000 should help anyone with their own painful storage deliberations. His key points are: The price is right; DAS via SAS, 15 spindles at 15K rpm each, 512MB of mirrored battery-backed write cache; You can disable read caching; You can disable read-ahead prefetching; The stripe sizes are configurable up to 512KB; The controller ignores host-based flush commands by default; They support an ‘Enhanced JBOD’ mode. His reasoning for the desirability each option is astute and he even gives you the configuration options for carrying out the configuration. This is not your average CEO. Don also speculates that a three tier system using flash (system RAM + flash storage + RAID disks) is a possible future direction. Unfortunately, flash
2 0.85791004 529 high scalability-2009-03-10-Paper: Consensus Protocols: Paxos
Introduction: Update: Barbara Liskov’s Turing Award, and Byzantine Fault Tolerance . Henry Robinson has created an excellent series of articles on consensus protocols. We already covered his 2 Phase Commit article and he also has a 3 Phase Commit article showing how to handle 2PC under single node failures. But that is not enough! 3PC works well under node failures, but fails for network failures. So another consensus mechanism is needed that handles both network and node failures. And that's Paxos . Paxos correctly handles both types of failures, but it does this by becoming inaccessible if too many components fail. This is the "liveness" property of protocols. Paxos waits until the faults are fixed. Read queries can be handled, but updates will be blocked until the protocol thinks it can make forward progress. The liveness of Paxos is primarily dependent on network stability. In a distributed heterogeneous environment you are at risk of losing the ability to make updates. Users hate t
same-blog 3 0.85419142 794 high scalability-2010-03-11-What would you like to ask Justin.tv?
Introduction: It looks like I'll have the chance to interview someone tomorrow from Justin.tv about their architecture, which is pretty exciting given their leadership role in live broadcasting. They get 30 million uniques a month, can handle 1 million simultaneous broadcasts and hope to grow another magnitude in the near future. That must take some doing. Here's your opportunity, especially if you think my questions suck, to ask your own sucky questions :-) What would you like to know about Justin.tv?
4 0.81634057 213 high scalability-2008-01-15-Does Sun Buying MySQL Change Your Scaling Strategy?
Introduction: Sun is buying MySQL for $1 billion. The MySQL team has worked long and hard so I don't begrudge them their pay day. Strike while the iron is offering a lot of cash I say. And I have nothing against Sun. Yet I can't help but think this changes the mental calculation of what database to use. When Oracle acquired Innobase a new independent storage engine was needed for MySQL. How is this different? Does this change your thinking any? Would Martha say it's a good thing? Like Luke I've searched my feelings, but the force is not with me and I don't really know how I feel about it.
5 0.77710402 710 high scalability-2009-09-20-PaxosLease: Diskless Paxos for Leases
Introduction: PaxosLease is a distributed algorithm for lease negotiation. It is based on Paxos, but does not require disk writes or clock synchrony. PaxosLease is used for master lease negotation in the open-source Keyspace replicated key-value store.
6 0.77401811 832 high scalability-2010-05-31-Scalable federated security with Kerberos
7 0.73625672 1423 high scalability-2013-03-13-Iron.io Moved From Ruby to Go: 28 Servers Cut and Colossal Clusterf**ks Prevented
8 0.72307032 93 high scalability-2007-09-16-What software runs on this site?
9 0.67732704 627 high scalability-2009-06-11-Yahoo! Distribution of Hadoop
10 0.67532444 719 high scalability-2009-10-09-Have you collectl'd yet? If not, maybe collectl-utils will make it easier to do so
11 0.67357492 946 high scalability-2010-11-22-Strategy: Google Sends Canary Requests into the Data Mine
12 0.6715734 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
13 0.66954792 230 high scalability-2008-01-29-Speed up (Oracle) database code with result caching
14 0.66819859 601 high scalability-2009-05-17-Product: Hadoop
15 0.6661799 111 high scalability-2007-10-04-Number of load balanced servers
16 0.66489357 166 high scalability-2007-11-27-Solving the Client Side API Scalability Problem with a Little Game Theory
17 0.66458005 1286 high scalability-2012-07-18-Strategy: Kill Off Multi-tenant Instances with High CPU Stolen Time
18 0.66282994 1143 high scalability-2011-11-16-Google+ Infrastructure Update - the JavaScript Story
19 0.66141629 17 high scalability-2007-07-16-Paper: Guide to Cost-effective Database Scale-Out using MySQL
20 0.66089231 1266 high scalability-2012-06-18-Google on Latency Tolerant Systems: Making a Predictable Whole Out of Unpredictable Parts