high_scalability high_scalability-2008 high_scalability-2008-329 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely?
sentIndex sentText sentNum sentScore
1 This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. [sent-1, score-2.245]
2 I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? [sent-2, score-1.778]
3 As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely? [sent-3, score-1.647]
wordName wordTfidf (topN-words)
[('nix', 0.302), ('gang', 0.261), ('administering', 0.255), ('remotely', 0.228), ('securely', 0.222), ('explanations', 0.222), ('understand', 0.207), ('ports', 0.207), ('ssh', 0.195), ('geographically', 0.176), ('administration', 0.169), ('designs', 0.166), ('website', 0.166), ('failed', 0.161), ('organizations', 0.161), ('secure', 0.156), ('diverse', 0.155), ('helping', 0.151), ('groups', 0.142), ('interest', 0.137), ('remote', 0.136), ('windows', 0.135), ('hacker', 0.13), ('imagine', 0.121), ('successful', 0.118), ('go', 0.114), ('love', 0.113), ('avoid', 0.112), ('seen', 0.109), ('network', 0.103), ('manage', 0.094), ('creating', 0.093), ('resource', 0.093), ('actually', 0.089), ('done', 0.083), ('allows', 0.082), ('best', 0.065), ('open', 0.063), ('scalable', 0.058), ('great', 0.058), ('one', 0.057), ('big', 0.056), ('architecture', 0.055), ('people', 0.054), ('servers', 0.046), ('systems', 0.046), ('server', 0.043), ('web', 0.039)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 329 high scalability-2008-05-27-Secure Remote Administration for Large-Scale Networks
Introduction: This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely?
2 0.15800001 385 high scalability-2008-09-16-Product: Func - Fedora Unified Network Controller
Introduction: Func is used to manage a large network using bash or Python scripts. It targets easy and simple remote scripting and one-off tasks over SSH by creating a secure (SSL certifications) XMLRPC API for communication. Any kind of application can be written on top of it. Other configuration management tools specialize in mass configuration. They say here's what the machine should look like and keep it that way. Func allows you to program your cluster. If you've ever tried to securely remote script a gang of machines using SSH keys you know what a total nightmare that can be. Some example commands: Using the command line: func "*.example.org" call yumcmd update Using the Pthon API: import func.overlord.client as fc client = fc.Client("*.example.org;*.example.com") client.yumcmd.update() client.service.start("acme-server") print client.hardware.info() Func may certainly overlap in functionality with other tools like Puppet and cfengine, but as programmers we always need more than one
3 0.14160007 167 high scalability-2007-11-27-Starting a website from scratch - what technologies should I use?
Introduction: Hi, if you were to design your own highly scalable website from scratch, what technologies would you use? Based on Web 2.0 popularity, LAMP seems to be high in the running. But would you tack on CakePHP? Drupal? or build your framework/CMS from scratch? What version of Linux runs best for a scalable website? Would you consider Windows and .NET? Java? Or do you want to throw a brick at me for even suggesting such heresies? Would you prefer Postgres, Tomcat, Perl, Python, or any of that other *NIX fancy stuff...why or why not? Please forget for the moment, "use what you know" argument. I am pretty versatile, and can look for an expert in whatever platform I choose. So all skills being equal, I'm looking for the best community support, the fastest development time and most importantly, the best scaling approach. Let's say, for fun, that I'm planning for the website to have as many messages going back & forth as an eBay. Definitely building this on a
4 0.093043156 433 high scalability-2008-10-29-CTL - Distributed Control Dispatching Framework
Introduction: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. What does CTL do? CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. What are CTL's features? CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remot
5 0.092210725 461 high scalability-2008-12-05-Sprinkle - Provisioning Tool to Build Remote Servers
Introduction: At 37 Signals Joshua Sierles describes how 37 Signals uses Sprinkle to configure their servers within EC2. Sprinkle defines a domain specific meta-language for describing and processing the installation of software . You can find an interesting discussion of Sprinkle's creation story by the creator himself, Marcus Crafter, in Sprinkle Some Powder! . Marcus divides provisioning tools into two categories: Task Based - the tool issues a list of commands to run on the remote system, either remotely via a network connection or smart client. Policy/state Based - the tool determines what needs to be run on the remote system by examining its current and final state. Sprinkle combines both models together in a chocolate-in-my-peanut-butter approach using normal Ruby code as the DSL (domain specific language) to declaratively describe remote system configurations. 37 Signals likes the use of Ruby as the DSL because it makes learning a separate syntax unnecessary. I've successfu
6 0.088533722 54 high scalability-2007-08-02-Multilanguage Website
7 0.083580069 222 high scalability-2008-01-25-Application Database and DAL Architecture
9 0.075671196 458 high scalability-2008-12-01-Web Consolidation on the Sun Fire T1000 using Solaris Containers
10 0.07376451 1288 high scalability-2012-07-23-Ask HighScalability: How Do I Build My MegaUpload + Itunes + YouTube Startup?
11 0.073110446 27 high scalability-2007-07-25-Product: 3 PAR REMOTE COPY
12 0.070951611 598 high scalability-2009-05-12-P2P server technology?
14 0.069516458 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
15 0.068221338 570 high scalability-2009-04-15-Implementing large scale web analytics
16 0.067838304 121 high scalability-2007-10-14-Newbie in scalability design issues
topicId topicWeight
[(0, 0.106), (1, 0.002), (2, 0.012), (3, -0.013), (4, -0.005), (5, -0.037), (6, -0.014), (7, -0.003), (8, -0.018), (9, 0.04), (10, -0.04), (11, 0.015), (12, -0.014), (13, -0.038), (14, 0.035), (15, -0.039), (16, 0.048), (17, 0.007), (18, -0.041), (19, 0.021), (20, 0.019), (21, -0.013), (22, -0.019), (23, -0.01), (24, -0.038), (25, -0.006), (26, -0.007), (27, -0.026), (28, -0.027), (29, -0.038), (30, 0.01), (31, -0.031), (32, 0.021), (33, -0.024), (34, -0.016), (35, 0.007), (36, 0.039), (37, 0.008), (38, -0.02), (39, 0.044), (40, -0.028), (41, 0.007), (42, -0.057), (43, -0.02), (44, -0.016), (45, 0.002), (46, -0.047), (47, -0.034), (48, -0.01), (49, 0.04)]
simIndex simValue blogId blogTitle
same-blog 1 0.94952166 329 high scalability-2008-05-27-Secure Remote Administration for Large-Scale Networks
Introduction: This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely?
2 0.65875894 686 high scalability-2009-08-20-VMware to bridge a DMZ.
Introduction: Hey guys, There is a renewed push at my organization to deploy vmware...everywhere. I am rather excited as I know we have a lot of waste when it comes to resources. What has pricked my ears up however, is the notion of using this technology in our very busy public facing DMZ's. Today we get lots of spikes of traffic and we are coping very well. 40x HP blades, apache/php/perl/tomcat/ all in HA behind HA F5's and HA Checkpoint FW's. (20 servers in 2 datacentres). The idea is, we virtualise these machines, including the firewalls onto hosts vmware clusters that span the public interface to our internal networks. This is something that has gone against the #1 rule I have ever lived by while working on the inet. No airgaps from the unknown to the known! I am interested in feedback on this scenario. From a resource perspective, our resource requirements in the DMZ will be lowered over time due to business change and we still have a lot of head room in our capacity. Do you think t
3 0.63327849 429 high scalability-2008-10-25-Product: Puppet the Automated Administration System
Introduction: Update: Digg on their choice and use of Puppet . They chose puppet over cfengine, and bcfg2 because they liked Puppet's resource abstraction layer (RAL), the ability to implement configuration management incrementally, support for bundles, and the overall design philosophy. Puppet implements a declarative (what not how) configuration language for automating common administration tasks. It's the system every large site writes for themselves and it's already made for you! Ilike was able to "easily" scale from 0 to hundreds of servers using Puppet. I can't believe I've never seen this before. It looks really cool. What is Puppet and how can it help you scale your website operations? From the Puppet website: Puppet has been developed to help the sysadmin community move to building and sharing mature tools that avoid the duplication of everyone solving the same problem. It does so in two ways: * It provides a powerful framework to simplify the majority of the technical tasks t
4 0.62186265 385 high scalability-2008-09-16-Product: Func - Fedora Unified Network Controller
Introduction: Func is used to manage a large network using bash or Python scripts. It targets easy and simple remote scripting and one-off tasks over SSH by creating a secure (SSL certifications) XMLRPC API for communication. Any kind of application can be written on top of it. Other configuration management tools specialize in mass configuration. They say here's what the machine should look like and keep it that way. Func allows you to program your cluster. If you've ever tried to securely remote script a gang of machines using SSH keys you know what a total nightmare that can be. Some example commands: Using the command line: func "*.example.org" call yumcmd update Using the Pthon API: import func.overlord.client as fc client = fc.Client("*.example.org;*.example.com") client.yumcmd.update() client.service.start("acme-server") print client.hardware.info() Func may certainly overlap in functionality with other tools like Puppet and cfengine, but as programmers we always need more than one
5 0.61426479 146 high scalability-2007-11-08-scaling drupal - an open-source infrastructure for high-traffic drupal sites
Introduction: the authors of drupal have paid considerable attention to performance and scalability. consequently even a default install running on modest hardware can easily handle the demands a small website. if you are lucky, eventually the time comes when you need to service more users than your system can handle. at some point, you'll start looking at your hardware and network deployment. read more .
6 0.61408997 262 high scalability-2008-02-26-Architecture to Allow High Availability File Upload
7 0.61183095 1 high scalability-2007-07-06-Start Here
9 0.60700506 1288 high scalability-2012-07-23-Ask HighScalability: How Do I Build My MegaUpload + Itunes + YouTube Startup?
10 0.60262477 228 high scalability-2008-01-28-Product: ISPMan Centralized ISP Management System
11 0.59732133 488 high scalability-2009-01-08-file synchronization solutions
12 0.59166646 167 high scalability-2007-11-27-Starting a website from scratch - what technologies should I use?
13 0.58347774 321 high scalability-2008-05-17-WebSphere Commerce High Availability and Performance Configurations
14 0.57581019 232 high scalability-2008-01-29-When things aren't scalable
15 0.57450795 484 high scalability-2009-01-05-Lessons Learned at 208K: Towards Debugging Millions of Cores
16 0.57448494 8 high scalability-2007-07-12-Should I use LAMP or Windows?
17 0.56748605 158 high scalability-2007-11-17-Can How Bees Solve their Load Balancing Problems Help Build More Scalable Websites?
18 0.56638014 1356 high scalability-2012-11-07-Gone Fishin': 10 Ways to Take your Site from One to One Million Users by Kevin Rose
19 0.56276417 1014 high scalability-2011-03-31-8 Lessons We Can Learn from the MySpace Incident - Balance, Vision, Fearlessness
20 0.56255782 466 high scalability-2008-12-16-Facebook is Hiring
topicId topicWeight
[(1, 0.284), (37, 0.437), (61, 0.145)]
simIndex simValue blogId blogTitle
1 0.84911984 316 high scalability-2008-05-05-Put the web server on a diet and increase scalability
Introduction: Misusing HTTP sessions is probably the number one obstacle to building scalable web sites today. Here are some tips how to consume HTTP sessions responsibly.
same-blog 2 0.79564416 329 high scalability-2008-05-27-Secure Remote Administration for Large-Scale Networks
Introduction: This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely?
3 0.77486682 1033 high scalability-2011-05-02-The Updated Big List of Articles on the Amazon Outage
Introduction: Since The Big List Of Articles On The Amazon Outage was published we've a had few updates that people might not have seen. Amazon of course released their Summary of the Amazon EC2 and Amazon RDS Service Disruption in the US East Region . Netlix shared their Lessons Learned from the AWS Outage as did Heroku ( How Heroku Survived the Amazon Outage ), Smug Mug ( How SmugMug survived the Amazonpocalypse ), and SimpleGeo ( How SimpleGeo Stayed Up During the AWS Downtime ). The curious thing from my perspective is the general lack of response to Amazon's explanation. I expected more discussion. There's been almost none that I've seen. My guess is very few people understand what Amazon was talking about enough to comment whereas almost everyone feels qualified to talk about the event itself. Lesson for crisis handlers : deep dive post-mortems that are timely, long, honestish, and highly technical are the most effective means of staunching the downward spiral of media attention.
Introduction: Who's Hiring? BioWare Austin is looking for a Performance Test Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin . BioWare Austin is looking for a Contract Build Engineer for our Austin team. To apply, please visit http://www.bioware.com/careers/austin . deviantART is looking for Network and Systems Operations Engineer. Please apply here . Aconex is looking for a Systems Engineer in San Bruno. Please apply here . Hadapt brings high-performance SQL to Hadoop, and is looking for a systems engineer to join this fast-growing company. Please apply at http://www.hadapt.com/jobs . MathWorks Looking for Multiple, Full-time Scaling Experts. Apply now: http://matlab.my/lVmunb Fun and Informative Events Surge 2011: The Scalability and Performance Conference. Surge is a chance to identify emerging trends and meet the architects behind established technologies. Early Bird Registration . Join our webinar as we introduce
5 0.69117051 1029 high scalability-2011-04-25-The Big List of Articles on the Amazon Outage
Introduction: Please see The Updated Big List Of Articles On The Amazon Outage for a new improved list. So many great articles have been written on the Amazon Outage. Some aim at being helpful, some chastise developers for being so stupid, some chastise Amazon for being so incompetent, some talk about the pain they and their companies have experienced, and some even predict the downfall of the cloud. Still others say we have seen a sea change in future of the cloud, a prediction that's hard to disagree with, though the shape of the change remains...cloudy. I'll try to keep this list update as more information comes out. There will be a lot for developers to consider going forward. If there's a resource you think should be added, just let me know. Amazon's Explanation of What Happened Summary of the Amazon EC2 and Amazon RDS Service Disruption in the US East Region Hackers News thread on AWS Service Disruption Post Mortem Quite Funny Commentary on the Summary Experiences f
13 0.57484818 891 high scalability-2010-09-01-Scale-out vs Scale-up
20 0.55082637 11 high scalability-2007-07-15-Coyote Point Load Balancing Systems