high_scalability high_scalability-2014 high_scalability-2014-1645 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hey, it's HighScalability time: NASA captures Guatemala volcano erupting from space 40,000 exabytes : from now until 2020, the digital universe will about double every two years; $650,000 : amount raised by the MaydayPAC in one week. Quotable Quotes: @BenedictEvans : Masayoshi Son: $20m initial investment in Alibaba, current stake worth $58bn. @iamdevloper : I sneezed earlier and Siri compiled it to valid Perl. @cdixon : "There is not enough competition in the last mile market to allow a true market to function" @PatrickMcFadin : Get ready for some serious server density. AMD is working on K12, brand-new x86 and ARM cores. This plus 8T SSD? With age comes changing priorities. Facebook is now 10 and has grown up . They are no longer moving fast and breaking things. They are now into the stability thing. Letting developers know they are a stable platform. The play is to get all that beautiful data from developers by bei
sentIndex sentText sentNum sentScore
1 The play is to get all that beautiful data from developers by being the platform for the Internet. [sent-12, score-0.082]
2 On which an ad platform is built like a castle protecting a river valley. [sent-13, score-0.082]
3 They also bought into Akka and the whole Reactive platform idea. [sent-30, score-0.082]
4 "Based on the compute node resource usage metrics during the serial VM packing test: Docker LXC CPU growth is approximately 26x lower than KVM. [sent-36, score-0.133]
5 On this surface this indicates a 26x density potential increase from a CPU point of view using docker LXC vs a traditional hypervisor. [sent-37, score-0.53]
6 Docker LXC memory growth is approximately 3x lower than KVM. [sent-38, score-0.133]
7 On the surface this indicates a 3x density potential increase from a memory point of view using docker LXC vs a traditional hypervisor. [sent-39, score-0.53]
8 Searching 20 GB/sec: Systems Engineering Before Algorithms : This article describes how we met that challenge using an “old school”, brute-force approach, by eliminating layers and avoiding complex data structures. [sent-49, score-0.068]
9 lya Grigorik writes an epic article trying to explain it all: Minimum Viable Block Chain : The combination of all of the above rules and infrastructure provides a decentralized, peer-to-peer block chain for achieving distributed consensus of ordering of signed transactions. [sent-53, score-0.508]
10 Another epic article, this time on why we can't give great Internet. [sent-57, score-0.079]
11 Microsoft as a viable platform for startups. [sent-70, score-0.15]
12 The C++ framework, showing double performance, showed a 134 ms maximum latency. [sent-94, score-0.124]
13 Instead, I will show you how to support 2,000 concurrent connections on a static site by tuning Linux (Ubuntu 14. [sent-99, score-0.135]
14 Armed with a $20 a month DigitalOcean droplet, I was able to maintain 2,000 concurrent connections and 1,900 hits per second on this blog. [sent-103, score-0.135]
15 I'll reuse Bill Smith's excellent comment: This is a good talk on databases, the CAP theorem, and some techniques for validating (or invalidating) vendor claims about availability and consistency under network partition. [sent-106, score-0.147]
16 This backfired on our application servers that were trying to reach the queueing servers for major or minor jobs with no luck. [sent-114, score-0.082]
17 The queue with the problems was the one sending minor notifications, such as when a user joins a team. [sent-116, score-0.082]
18 : There has been, however, no consensus on how to tell if a given physical system is acting as a computer or not; leading to confusion over novel computational devices, and even claims that every physical event is a computation. [sent-120, score-0.448]
19 In this paper we introduce a formal framework that can be used to determine whether or not a physical system is performing a computation. [sent-121, score-0.113]
20 We demonstrate how the abstract computational level interacts with the physical device level, drawing the comparison with the use of mathematical models to represent physical objects in experimental science. [sent-122, score-0.284]
wordName wordTfidf (topN-words)
[('lxc', 0.306), ('docker', 0.288), ('gnu', 0.173), ('grep', 0.159), ('chain', 0.145), ('geomesa', 0.135), ('discussionon', 0.135), ('physical', 0.113), ('newrelic', 0.102), ('claims', 0.087), ('assembly', 0.087), ('reboot', 0.086), ('indicates', 0.085), ('platform', 0.082), ('minor', 0.082), ('surface', 0.08), ('block', 0.08), ('epic', 0.079), ('consensus', 0.077), ('density', 0.077), ('approximately', 0.073), ('byte', 0.073), ('concurrent', 0.071), ('delete', 0.069), ('viable', 0.068), ('article', 0.068), ('notifications', 0.066), ('connections', 0.064), ('ms', 0.063), ('screaming', 0.061), ('invalidating', 0.061), ('kim', 0.061), ('ingenious', 0.061), ('unbeatable', 0.061), ('reverence', 0.061), ('bizspark', 0.061), ('mouthful', 0.061), ('ode', 0.061), ('alibaba', 0.061), ('siri', 0.061), ('emptying', 0.061), ('papertrail', 0.061), ('sensu', 0.061), ('digitalocean', 0.061), ('outperformed', 0.061), ('double', 0.061), ('growth', 0.06), ('good', 0.06), ('explain', 0.059), ('computational', 0.058)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000005 1645 high scalability-2014-05-09-Stuff The Internet Says On Scalability For May 9th, 2014
Introduction: Hey, it's HighScalability time: NASA captures Guatemala volcano erupting from space 40,000 exabytes : from now until 2020, the digital universe will about double every two years; $650,000 : amount raised by the MaydayPAC in one week. Quotable Quotes: @BenedictEvans : Masayoshi Son: $20m initial investment in Alibaba, current stake worth $58bn. @iamdevloper : I sneezed earlier and Siri compiled it to valid Perl. @cdixon : "There is not enough competition in the last mile market to allow a true market to function" @PatrickMcFadin : Get ready for some serious server density. AMD is working on K12, brand-new x86 and ARM cores. This plus 8T SSD? With age comes changing priorities. Facebook is now 10 and has grown up . They are no longer moving fast and breaking things. They are now into the stability thing. Letting developers know they are a stable platform. The play is to get all that beautiful data from developers by bei
Introduction: All in all this is still my favorite post and I still think it's an accurate vision of a future. Not everyone agrees, but I guess we'll see..."But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but c
Introduction: "But it is not complicated. [There's] just a lot of it." \--Richard Feynmanon how the immense variety of the world arises from simple rules.Contents:Have We Reached the End of Scaling?Applications Become Black Boxes Using Markets to Scale and Control CostsLet's Welcome our Neo-Feudal OverlordsThe Economic Argument for the Ambient CloudWhat Will Kill the Cloud?The Amazing Collective Compute Power of the Ambient CloudUsing the Ambient Cloud as an Application RuntimeApplications as Virtual StatesConclusionWe have not yet begun to scale. The world is still fundamentally disconnected and for all our wisdom we are still in the earliest days of learning how to build truly large planet-scaling applications.Today 350 million users on Facebook is a lot of users and five million followers on Twitter is a lot of followers. This may seem like a lot now, but consider we have no planet wide applications yet. None.Tomorrow the numbers foreshadow a newCambrian explosionof connectivity that will look as
4 0.11350606 1637 high scalability-2014-04-25-Stuff The Internet Says On Scalability For April 25th, 2014
Introduction: Hey, it's HighScalability time: New World Record BASE jumping from World's Tallest Building. #crazy 30 billion : total Pinterest pins; 500,000,000 : What'sApp users (700 million photos and 100 million videos every single day); 1 billion : Facebook active users on phones and tablets. Quotable Quotes: @jimplush : Google spent 2.3 billion on infrastructure in Q1. Remember that when you say you want to be "the Google of something" Clay Shirky: I think one of the things that happened to the P2P market for infrastructure is that users preference for predictable pricing vs resource-sensitive pricing is so overwhelming that they will overpay to anyone who can promise flat prices. And because the logic of centralization vs decentralization is so price sensitive, I don't think there is any logical reason to assume a broadly stable class of apps, separate from c
5 0.11237136 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
Introduction: It remains that, from the same principles, I now demonstrate the frame of the System of the World. -- Isaac Newton The practice of IT reminds me a lot of the practice of science before Isaac Newton. Aristotelianism was dead, but there was nothing to replace it. Then Newton came along, created a scientific revolution with his System of the World . And everything changed. That was New System of the World number one. New System of the World number two was written about by the incomparable Neal Stephenson in his incredible Baroque Cycle series. It explores the singular creation of a new way of organizing society grounded in new modes of thought in business, religion, politics, and science. Our modern world emerged Enlightened as it could from this roiling cauldron of forces. In IT we may have had a Leonardo da Vinci or even a Galileo, but we’ve never had our Newton. Maybe we don't need a towering genius to make everything clear? For years startups, like the frenetically inventive
6 0.11144838 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
10 0.10935805 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
11 0.10905932 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
12 0.10897735 1630 high scalability-2014-04-11-Stuff The Internet Says On Scalability For April 11th, 2014
13 0.10881398 1479 high scalability-2013-06-21-Stuff The Internet Says On Scalability For June 21, 2013
14 0.10856348 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
15 0.10812602 1502 high scalability-2013-08-16-Stuff The Internet Says On Scalability For August 16, 2013
16 0.10810532 1564 high scalability-2013-12-13-Stuff The Internet Says On Scalability For December 13th, 2013
19 0.1062905 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
20 0.10590199 96 high scalability-2007-09-18-Amazon Architecture
topicId topicWeight
[(0, 0.244), (1, 0.09), (2, 0.009), (3, 0.022), (4, -0.01), (5, -0.018), (6, -0.019), (7, 0.051), (8, 0.002), (9, 0.023), (10, -0.017), (11, -0.019), (12, 0.048), (13, -0.009), (14, -0.029), (15, 0.001), (16, 0.052), (17, -0.023), (18, -0.045), (19, -0.003), (20, 0.009), (21, -0.001), (22, -0.024), (23, 0.001), (24, -0.02), (25, 0.016), (26, 0.0), (27, -0.036), (28, -0.009), (29, -0.011), (30, -0.006), (31, 0.002), (32, -0.034), (33, 0.024), (34, -0.01), (35, -0.03), (36, -0.018), (37, -0.001), (38, -0.014), (39, -0.001), (40, 0.027), (41, 0.0), (42, 0.027), (43, 0.009), (44, 0.028), (45, 0.015), (46, 0.024), (47, 0.02), (48, -0.039), (49, -0.006)]
simIndex simValue blogId blogTitle
same-blog 1 0.95728153 1645 high scalability-2014-05-09-Stuff The Internet Says On Scalability For May 9th, 2014
Introduction: Hey, it's HighScalability time: NASA captures Guatemala volcano erupting from space 40,000 exabytes : from now until 2020, the digital universe will about double every two years; $650,000 : amount raised by the MaydayPAC in one week. Quotable Quotes: @BenedictEvans : Masayoshi Son: $20m initial investment in Alibaba, current stake worth $58bn. @iamdevloper : I sneezed earlier and Siri compiled it to valid Perl. @cdixon : "There is not enough competition in the last mile market to allow a true market to function" @PatrickMcFadin : Get ready for some serious server density. AMD is working on K12, brand-new x86 and ARM cores. This plus 8T SSD? With age comes changing priorities. Facebook is now 10 and has grown up . They are no longer moving fast and breaking things. They are now into the stability thing. Letting developers know they are a stable platform. The play is to get all that beautiful data from developers by bei
2 0.87488037 1451 high scalability-2013-05-03-Stuff The Internet Says On Scalability For May 3, 2013
Introduction: Hey, it's HighScalability time: ( Giant Hurricane on Saturn , here's one in New Orleans ) 1,966,080 cores : Time Warp synchronization protocol using up to 7.8M MPI tasks on 1,966,080 cores of the {Sequoia} Blue Gene/Q supercomputer system. 33 trillion events processed in 65 seconds yielding a peak event-rate in excess of 504 billion events/second using 120 racks of Sequoia. Quotable Quotes: Thad Starner : the longer accessing a device exceeds 2s, the more its actually usage would decrease exponentially. Thus, he made a claim that wrist watch interface always sitting on one's wrist ready to use should be more successful than mobile phones which have to pulled out of the pocket. @joedevon : We came for scalability but we stayed for agility #NoSQL @jahmailay : "Our user base is exploding. I really wish we spent more time on scalability instead of features customers don't use." - Everybody, always. @bsletten : I don’t think it is a
3 0.87472409 1523 high scalability-2013-09-27-Stuff The Internet Says On Scalability For September 27, 2013
Introduction: Hey, it's HighScalability time: ( The WINLAB at Rutgers, with software defined radios tied into GENI. ) 384 cores & 32TB of RAM : Oracle's SPARC M6 Quotable Quotes: @jennyinc : 2003: "I replaced you with a set of very small shell scripts." 2013: "I replaced your scripts with a six-figure enterprise DevOps platform." @tomdale : OH: “Redis is so fast, why don’t we replace RAM with Redis?” @petrillic : OH "Promises/futures are the one-night stands of architectural constructs" nice #strangeloop @TwitterEng : "Java and Scala let Twitter readily share and modify its enormous codebase across a team of hundreds of developers." Lots of juicy numbers revealed at Structure:Europe : Netflix streams 114,000 years of video every month; Custom build Netflix boxes for its content-delivery network that contain between 100 and 150 terabytes of stor
4 0.87187672 1378 high scalability-2012-12-28-Stuff The Internet Says On Scalability For December 28, 2012
Introduction: It's HighScalability time: 306 items per second: Orders on Amazon Quotable Quotes: @hackofalltrades : When positive change is only viewed through its scalability, bad things happen. @faizanj : Is it time for #Netflix to move to a hybrid cloud architecture similar to Zynga zCloud? @adrianco : we try not to invest in undifferentiated heavy lifting @qui_oui : "scalability": a word that makes me think of how likely you are to have the ability to grow scales. @Ninad_M : The question is, is #antifragile conceptually opposite of #bigdata @pbailis : Batch your disk/network IO, kernel interrupts, customer package shipments -> delay arrival but increase efficiency @Carnage4Life : One lesson that is hard for people to learn. Knowing that something occurred is different from knowing why it occurred The best tech documentation both informs about the technology and teaches the wider context in which it plays a part. That fits the 400+ page
5 0.87035441 1572 high scalability-2014-01-03-Stuff The Internet Says On Scalability For January 3rd, 2014
Introduction: Hey, it's HighScalability time, can you handle the truth? Should software architectures include parasites ? They increase diversity and complexity in the food web. 10 Million : classic hockey stick growth pattern for GitHub repositories Quotable Quotes: Seymour Cray : A supercomputer is a device for turning compute-bound problems into IO-bound problems. Robert Sapolsky : And why is self-organization so beautiful to my atheistic self? Because if complex, adaptive systems don’t require a blue print, they don’t require a blue print maker. If they don’t require lightning bolts, they don’t require Someone hurtling lightning bolts. @swardley : Asked for a history of PaaS? From memory, public launch - Zimki ('06), BungeeLabs ('06), Heroku ('07), GAE ('08), CloudFoundry ('11) ... @neil_conway : If you're designing scalable systems, you should understand backpressure and build mechanisms to support it. Scott Aaronson ...the
6 0.86520362 1071 high scalability-2011-07-01-Stuff The Internet Says On Scalability For July 1, 2011
7 0.8619464 1621 high scalability-2014-03-28-Stuff The Internet Says On Scalability For March 28th, 2014
8 0.85521525 1375 high scalability-2012-12-21-Stuff The Internet Says On Scalability For December 21, 2012
9 0.84972328 1247 high scalability-2012-05-18-Stuff The Internet Says On Scalability For May 18, 2012
10 0.8474685 1600 high scalability-2014-02-21-Stuff The Internet Says On Scalability For February 21st, 2014
11 0.84685695 1190 high scalability-2012-02-10-Stuff The Internet Says On Scalability For February 10, 2012
12 0.84623247 1506 high scalability-2013-08-23-Stuff The Internet Says On Scalability For August 23, 2013
13 0.84612733 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
14 0.84594518 1559 high scalability-2013-12-06-Stuff The Internet Says On Scalability For December 6th, 2013
15 0.84457487 1455 high scalability-2013-05-10-Stuff The Internet Says On Scalability For May 10, 2013
16 0.84353995 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
17 0.83830136 1490 high scalability-2013-07-12-Stuff The Internet Says On Scalability For July 12, 2013
18 0.83827072 1339 high scalability-2012-10-12-Stuff The Internet Says On Scalability For October 12, 2012
19 0.83554691 1443 high scalability-2013-04-19-Stuff The Internet Says On Scalability For April 19, 2013
20 0.8349874 1231 high scalability-2012-04-20-Stuff The Internet Says On Scalability For April 20, 2012
topicId topicWeight
[(1, 0.133), (2, 0.164), (10, 0.057), (22, 0.161), (26, 0.016), (40, 0.04), (43, 0.017), (47, 0.019), (61, 0.081), (73, 0.025), (77, 0.03), (79, 0.103), (85, 0.039), (94, 0.047)]
simIndex simValue blogId blogTitle
Introduction: The story of driving the golden spike to symbolize the completion of the transcontinental railroad is famous in the US. What is not so well known is the story of how it also foreshadowed changes to come as an early version of both the Internet and the Internet of Things. But that was 1869, how can that possibly be? Telegraph as Internet First, let's establish the telegraph and cable systems was an early version of an Internet. As railroad tracks were being laid a transcontental telegraph system was also being constructed. Telegraph lines were installed parallel to the tracks making instant communication available across the continent, faster than any horse could ride. With the transalantic cable system information could quickly span continents in minutes: The miles of American telegraph grew from 40 in 1846 to 12,000 in 1850 to 23,000 in 1852. In Europe it increased from 2,000 in 1849 to 110,000 in 1869. The cost of sending 10 words was $1.55 in 1850, $1 in 1870, 40
same-blog 2 0.90279233 1645 high scalability-2014-05-09-Stuff The Internet Says On Scalability For May 9th, 2014
Introduction: Hey, it's HighScalability time: NASA captures Guatemala volcano erupting from space 40,000 exabytes : from now until 2020, the digital universe will about double every two years; $650,000 : amount raised by the MaydayPAC in one week. Quotable Quotes: @BenedictEvans : Masayoshi Son: $20m initial investment in Alibaba, current stake worth $58bn. @iamdevloper : I sneezed earlier and Siri compiled it to valid Perl. @cdixon : "There is not enough competition in the last mile market to allow a true market to function" @PatrickMcFadin : Get ready for some serious server density. AMD is working on K12, brand-new x86 and ARM cores. This plus 8T SSD? With age comes changing priorities. Facebook is now 10 and has grown up . They are no longer moving fast and breaking things. They are now into the stability thing. Letting developers know they are a stable platform. The play is to get all that beautiful data from developers by bei
3 0.88664168 1543 high scalability-2013-11-05-10 Things You Should Know About AWS
Introduction: Authored by Chris Fregly : Former Netflix Streaming Platform Engineer, AWS Certified Solution Architect and Purveyor of fluxcapacitor.com. Ahead of the upcoming 2nd annual re:Invent conference, inspired by Simone Brunozzi’s recent presentation at an AWS Meetup in San Francisco, and collected from a few of my recent Fluxcapacitor.com consulting engagements, I’ve compiled a list of 10 useful time and clock-tick saving tips about AWS. 1) Query AWS resource metadata Can’t remember the EBS-Optimized IO throughput of your c1.xlarge cluster? How about the size limit of an S3 object on a single PUT? awsnow.info is the answer to all of your AWS-resource metadata questions. Interested in integrating awsnow.info with your application? You’re in luck. There’s now a REST API , as well! Note: These are default soft limits and will vary by account. 2) Tame your S3 buckets Delete an entire S3 bucket with a single CLI command:
4 0.87748051 1090 high scalability-2011-08-01-Peecho Architecture - scalability on a shoestring
Introduction: This is a guest post by Marcel Panse and Sander Nagtegaal from Peecho . Although architecture descriptions are an interesting read, the problems that start-ups face are hardly ever addressed. We would like to change that, so here is our architecture story. Introducing a start-up The Amsterdam-based company Peecho offers print-as-a-service. Our embeddable print button allows you to sell your digital content as professionally printed products, like photo books, magazines or canvases - straight from your own website. There is an API, too. Printcloud is the system that powers the print button. It exists in the cloud only, growing when needed and becoming smaller if it can. The system takes in print orders, magically transforms tough data into print-ready files and routes the orders to the production facility that is closest to the intended recipient. To preserve the environment, Peecho's philosophy is to facilitate global ordering, but to aim for local production on
5 0.8745833 1621 high scalability-2014-03-28-Stuff The Internet Says On Scalability For March 28th, 2014
Introduction: Hey, it's HighScalability time: Looks like a multiverse , if you can keep it. Quotable Quotes: @abt_programming : "I am a Unix Creationist. I believe the world was created on January 1, 1970 and as prophesized, will end on January 19, 2038" - @teropa @demisbellot : Cloud prices are hitting attractive price points, one more 40-50% drop and there'd be little reason to go it alone. @scott4arrows : Dentist "Do you floss regularly?" Me "Do you back up your computer data regularly?" @avestal : "I Kickstarted the Oculus Rift, what do I get?" You get a lesson in how capitalism works. @mtabini : “$20 charger that cost $2 to make.” Not pictured here: the $14 you pay for the 10,000 charger iterations that never made it to production. @strlen : "I built the original assembler in JS, because it's what I prefer to use when I need to get down to bare metal." - Adm. Grace Hopper tedchs : I'd like to propose a new rule for Hacker News: only if you have b
6 0.86418897 774 high scalability-2010-02-08-How FarmVille Scales to Harvest 75 Million Players a Month
7 0.86098969 301 high scalability-2008-04-08-Google AppEngine - A First Look
8 0.85962647 179 high scalability-2007-12-10-Future of EJB3 !! ??
9 0.85665202 491 high scalability-2009-01-13-Product: Gearman - Open Source Message Queuing System
10 0.84065002 434 high scalability-2008-10-30-Olio Web2.0 Toolkit - Evaluate Web Technologies and Tools
11 0.84012455 706 high scalability-2009-09-16-The VeriScale Architecture - Elasticity and efficiency for private clouds
12 0.83857363 1508 high scalability-2013-08-28-Sean Hull's 20 Biggest Bottlenecks that Reduce and Slow Down Scalability
13 0.83458501 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012
14 0.83279359 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
15 0.83225757 980 high scalability-2011-01-28-Stuff The Internet Says On Scalability For January 28, 2011
16 0.83213806 1028 high scalability-2011-04-22-Stuff The Internet Says On Scalability For April 22, 2011
17 0.83164454 1642 high scalability-2014-05-02-Stuff The Internet Says On Scalability For May 2nd, 2014
18 0.83071381 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
19 0.83061546 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
20 0.83011192 498 high scalability-2009-01-20-Product: Amazon's SimpleDB