high_scalability high_scalability-2008 high_scalability-2008-433 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. What does CTL do? CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. What are CTL's features? CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remot
sentIndex sentText sentNum sentScore
1 CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . [sent-1, score-1.235]
2 From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. [sent-2, score-1.235]
3 CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. [sent-4, score-0.396]
4 Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. [sent-5, score-0.431]
5 CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remote actions? [sent-7, score-0.674]
6 CTL dispatches actions to remote controllers with network transparency (over SSH), parallelism, and error handling already built in. [sent-8, score-0.457]
7 * Comes with pre-built utilities - CTL comes with pre-built utilities so you don't have to script actions like file distribution or process and port checking. [sent-9, score-0.519]
8 * Define your own automation using the tools/languages you already know - New controller modules are defined in XML and your scripting can be done in multiple scripting languages (Perl, Python, etc. [sent-10, score-0.5]
9 * Cross platform administration - CTL is Java-based, works on *nix and Windows. [sent-12, score-0.087]
wordName wordTfidf (topN-words)
[('ctl', 0.823), ('nix', 0.156), ('dispatching', 0.149), ('scripting', 0.144), ('actions', 0.133), ('modules', 0.124), ('reusable', 0.124), ('utilities', 0.12), ('execute', 0.115), ('fashion', 0.098), ('administration', 0.087), ('dispatches', 0.083), ('mentioning', 0.083), ('scripts', 0.08), ('control', 0.08), ('distributed', 0.076), ('break', 0.075), ('transparency', 0.074), ('enables', 0.072), ('endlessly', 0.072), ('remote', 0.07), ('invoke', 0.067), ('toolbox', 0.066), ('modifying', 0.063), ('tired', 0.062), ('management', 0.057), ('controllers', 0.055), ('processes', 0.055), ('framework', 0.054), ('helps', 0.051), ('ssh', 0.05), ('comes', 0.05), ('shell', 0.049), ('procedures', 0.049), ('port', 0.048), ('script', 0.048), ('automate', 0.047), ('highlights', 0.046), ('controller', 0.046), ('loop', 0.046), ('provisioning', 0.046), ('efforts', 0.044), ('xml', 0.043), ('puppet', 0.043), ('sophisticated', 0.043), ('already', 0.042), ('define', 0.041), ('parallelism', 0.04), ('mix', 0.039), ('leverage', 0.039)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 433 high scalability-2008-10-29-CTL - Distributed Control Dispatching Framework
Introduction: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. What does CTL do? CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. What are CTL's features? CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remot
2 0.10789014 75 high scalability-2007-08-28-Google Utilities : An online google guide,tools and Utilities.
Introduction: An online google guide,tools and Utilities to use with the Google search engine.Free google tools and utilities.
3 0.093043156 329 high scalability-2008-05-27-Secure Remote Administration for Large-Scale Networks
Introduction: This website has been a great resource for helping me to understand the successful (and failed) scalable network designs from organizations that have actually done it, but I haven't seen any explicite explanations about secure remote administration of these systems. I understand that the *nix people love to SSH, and the windows gang has their RDP, but how does one go about creating a network architecture that both allows one to manage their systems and does its best to avoid hacker interest? As I imagine, no big website will have the SSH/RDP/FTP ports open on the web server, so how is it that they go about remotely administering their geographically diverse groups of servers securely?
4 0.078016967 461 high scalability-2008-12-05-Sprinkle - Provisioning Tool to Build Remote Servers
Introduction: At 37 Signals Joshua Sierles describes how 37 Signals uses Sprinkle to configure their servers within EC2. Sprinkle defines a domain specific meta-language for describing and processing the installation of software . You can find an interesting discussion of Sprinkle's creation story by the creator himself, Marcus Crafter, in Sprinkle Some Powder! . Marcus divides provisioning tools into two categories: Task Based - the tool issues a list of commands to run on the remote system, either remotely via a network connection or smart client. Policy/state Based - the tool determines what needs to be run on the remote system by examining its current and final state. Sprinkle combines both models together in a chocolate-in-my-peanut-butter approach using normal Ruby code as the DSL (domain specific language) to declaratively describe remote system configurations. 37 Signals likes the use of Ruby as the DSL because it makes learning a separate syntax unnecessary. I've successfu
5 0.06536445 429 high scalability-2008-10-25-Product: Puppet the Automated Administration System
Introduction: Update: Digg on their choice and use of Puppet . They chose puppet over cfengine, and bcfg2 because they liked Puppet's resource abstraction layer (RAL), the ability to implement configuration management incrementally, support for bundles, and the overall design philosophy. Puppet implements a declarative (what not how) configuration language for automating common administration tasks. It's the system every large site writes for themselves and it's already made for you! Ilike was able to "easily" scale from 0 to hundreds of servers using Puppet. I can't believe I've never seen this before. It looks really cool. What is Puppet and how can it help you scale your website operations? From the Puppet website: Puppet has been developed to help the sysadmin community move to building and sharing mature tools that avoid the duplication of everyone solving the same problem. It does so in two ways: * It provides a powerful framework to simplify the majority of the technical tasks t
6 0.057489965 167 high scalability-2007-11-27-Starting a website from scratch - what technologies should I use?
7 0.056717161 385 high scalability-2008-09-16-Product: Func - Fedora Unified Network Controller
8 0.052531745 724 high scalability-2009-10-19-Drupal's Scalability Makeover - You give up some control and you get back scalability
9 0.047062371 255 high scalability-2008-02-21-Product: Capistrano - Automate Remote Tasks Via SSH
11 0.045777246 414 high scalability-2008-10-15-Hadoop - A Primer
12 0.045709863 376 high scalability-2008-09-03-MapReduce framework Disco
13 0.044822697 295 high scalability-2008-04-02-Product: Supervisor - Monitor and Control Your Processes
14 0.044284392 80 high scalability-2007-09-06-Product: Perdition Mail Retrieval Proxy
15 0.041019171 1003 high scalability-2011-03-14-6 Lessons from Dropbox - One Million Files Saved Every 15 minutes
16 0.039349645 1429 high scalability-2013-03-25-AppBackplane - A Framework for Supporting Multiple Application Architectures
17 0.038204126 933 high scalability-2010-11-01-Hot Trend: Move Behavior to Data for a New Interactive Application Architecture
18 0.038110796 881 high scalability-2010-08-16-Scaling an AWS infrastructure - Tools and Patterns
19 0.037792347 219 high scalability-2008-01-21-Product: Hyperic
20 0.037246134 27 high scalability-2007-07-25-Product: 3 PAR REMOTE COPY
topicId topicWeight
[(0, 0.061), (1, 0.006), (2, -0.0), (3, 0.008), (4, 0.011), (5, 0.01), (6, 0.028), (7, -0.007), (8, -0.02), (9, 0.021), (10, -0.009), (11, 0.022), (12, 0.016), (13, -0.051), (14, 0.011), (15, -0.027), (16, -0.01), (17, -0.01), (18, -0.003), (19, -0.01), (20, 0.011), (21, -0.007), (22, -0.012), (23, 0.009), (24, 0.002), (25, 0.012), (26, 0.012), (27, -0.014), (28, -0.03), (29, 0.003), (30, -0.02), (31, -0.002), (32, -0.004), (33, 0.002), (34, -0.015), (35, -0.021), (36, 0.014), (37, -0.013), (38, -0.005), (39, 0.06), (40, -0.013), (41, -0.017), (42, -0.006), (43, 0.027), (44, -0.028), (45, 0.005), (46, -0.033), (47, -0.026), (48, -0.001), (49, 0.014)]
simIndex simValue blogId blogTitle
same-blog 1 0.93768126 433 high scalability-2008-10-29-CTL - Distributed Control Dispatching Framework
Introduction: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. What does CTL do? CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. What are CTL's features? CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remot
2 0.75365555 461 high scalability-2008-12-05-Sprinkle - Provisioning Tool to Build Remote Servers
Introduction: At 37 Signals Joshua Sierles describes how 37 Signals uses Sprinkle to configure their servers within EC2. Sprinkle defines a domain specific meta-language for describing and processing the installation of software . You can find an interesting discussion of Sprinkle's creation story by the creator himself, Marcus Crafter, in Sprinkle Some Powder! . Marcus divides provisioning tools into two categories: Task Based - the tool issues a list of commands to run on the remote system, either remotely via a network connection or smart client. Policy/state Based - the tool determines what needs to be run on the remote system by examining its current and final state. Sprinkle combines both models together in a chocolate-in-my-peanut-butter approach using normal Ruby code as the DSL (domain specific language) to declaratively describe remote system configurations. 37 Signals likes the use of Ruby as the DSL because it makes learning a separate syntax unnecessary. I've successfu
3 0.7468549 385 high scalability-2008-09-16-Product: Func - Fedora Unified Network Controller
Introduction: Func is used to manage a large network using bash or Python scripts. It targets easy and simple remote scripting and one-off tasks over SSH by creating a secure (SSL certifications) XMLRPC API for communication. Any kind of application can be written on top of it. Other configuration management tools specialize in mass configuration. They say here's what the machine should look like and keep it that way. Func allows you to program your cluster. If you've ever tried to securely remote script a gang of machines using SSH keys you know what a total nightmare that can be. Some example commands: Using the command line: func "*.example.org" call yumcmd update Using the Pthon API: import func.overlord.client as fc client = fc.Client("*.example.org;*.example.com") client.yumcmd.update() client.service.start("acme-server") print client.hardware.info() Func may certainly overlap in functionality with other tools like Puppet and cfengine, but as programmers we always need more than one
4 0.73694086 161 high scalability-2007-11-20-Product: SmartFrog a Distributed Configuration and Deployment Framework
Introduction: From Wikipedia : SmartFrog is an open-source software framework, written in Java, that manages the configuration, deployment and coordination of a software system broken into components. These components may be distributed across several network hosts. The configuration of components is described using a domain-specific language, whose syntax resembles that of Java. It is a prototype-based object-oriented language, and may thus be compared to Self. The framework is used internally in a variety of HP products. Also, it is being used by HP Labs partners like CERN. Related Articles Distributed Testing with SmartFrog Puppet the Automated Administration System
5 0.72265732 255 high scalability-2008-02-21-Product: Capistrano - Automate Remote Tasks Via SSH
Introduction: Update: Deployment with Capistrano by Charles Max Wood. Nice simple step-by-step for using Capistrano for deployment. From their website: Simply put, Capistrano is a tool for automating tasks on one or more remote servers. It executes commands in parallel on all targeted machines, and provides a mechanism for rolling back changes across multiple machines. It is ideal for anyone doing any kind of system administration, either professionally or incidentally. * Great for automating tasks via SSH on remote servers, like software installation, application deployment, configuration management, ad hoc server monitoring, and more. * Ideal for system administrators, whether professional or incidental. * Easy to customize. Its configuration files use the Ruby programming language syntax, but you don't need to know Ruby to do most things with Capistrano. * Easy to extend. Capistrano is written in the Ruby programming language, and may be extended easily by writing additional Ruby mod
7 0.70463109 263 high scalability-2008-02-27-Product: System Imager - Automate Deployment and Installs
8 0.65375435 484 high scalability-2009-01-05-Lessons Learned at 208K: Towards Debugging Millions of Cores
9 0.65150726 429 high scalability-2008-10-25-Product: Puppet the Automated Administration System
10 0.63703305 326 high scalability-2008-05-25-Product: Condor - Compute Intensive Workload Management
11 0.63310814 1446 high scalability-2013-04-25-Paper: Making reliable distributed systems in the presence of software errors
13 0.6285966 1469 high scalability-2013-06-03-GOV.UK - Not Your Father's Stack
14 0.61216295 219 high scalability-2008-01-21-Product: Hyperic
15 0.61096901 272 high scalability-2008-03-08-Product: FAI - Fully Automatic Installation
16 0.60841632 1408 high scalability-2013-02-19-Puppet monitoring: how to monitor the success or failure of Puppet runs
17 0.6017285 1531 high scalability-2013-10-13-AIDA: Badoo’s journey into Continuous Integration
18 0.59568095 295 high scalability-2008-04-02-Product: Supervisor - Monitor and Control Your Processes
19 0.58550459 228 high scalability-2008-01-28-Product: ISPMan Centralized ISP Management System
20 0.57706052 13 high scalability-2007-07-15-Lustre cluster file system
topicId topicWeight
[(1, 0.116), (2, 0.181), (30, 0.035), (37, 0.04), (56, 0.043), (57, 0.282), (61, 0.088), (79, 0.062), (85, 0.012)]
simIndex simValue blogId blogTitle
1 0.93674278 159 high scalability-2007-11-18-Reverse Proxy
Introduction: Hi, I saw an year ago that Netapp sold netcache to blu-coat, my site is a heavy NetCache user and we cached 83% of our site. We tested with Blue-coat and F5 WA and we are not getting same performce as NetCache. Any of you guys have the same issue? or somebody knows another product can handle much traffic? Thanks Rodrigo
same-blog 2 0.86938083 433 high scalability-2008-10-29-CTL - Distributed Control Dispatching Framework
Introduction: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network . From their website: CTL is a flexible distributed control dispatching framework that enables you to break management processes into reusable control modules and execute them in distributed fashion over the network. What does CTL do? CTL helps you leverage your current scripts and tools to easily automate any kind of distributed systems management or application provisioning task. Its good for simplifiying large-scale scripting efforts or as another tool in your toolbox that helps you speed through your daily mix of ad-hoc administration tasks. What are CTL's features? CTL has many features, but the general highlights are: * Execute sophisticated procedures in distributed environments - Aren't you tired of writing and then endlessly modifying scripts that loop over nodes and invoke remot
3 0.84108013 1144 high scalability-2011-11-17-Five Misconceptions on Cloud Portability
Introduction: The term "cloud portability" is often considered a synonym for "Cloud API portability," which implies a series of misconceptions. If we break away from dogma, we can find that what we really looking for in cloud portability is Application portability between clouds which can be a vastly simpler requirement, as we can achieve application portability without settling on a common Cloud API. In this post i'll be covering five common misconceptions people have WRT to cloud portability. Cloud portability = Cloud API portability . API portability is easy; cloud API portability is not. The main incentive for Cloud Portability is - Avoiding Vendor lock-in .Cloud portability is more about business agility than it is about vendor lock-in. Cloud portability isn’t for startups . Every startup that is expecting rapid growth should re-examine their deployments and plan for cloud portability rather than wait to be forced to make the switch when you are least prepared to do so.
4 0.83892035 968 high scalability-2011-01-04-Map-Reduce With Ruby Using Hadoop
Introduction: A demonstration, with repeatable steps, of how to quickly fire-up a Hadoop cluster on Amazon EC2, load data onto the HDFS (Hadoop Distributed File-System), write map-reduce scripts in Ruby and use them to run a map-reduce job on your Hadoop cluster. You will not need to ssh into the cluster, as all tasks are run from your local machine. Below I am using my MacBook Pro as my local machine, but the steps I have provided should be reproducible on other platforms running bash and Java. Fire-Up Your Hadoop Cluster I choose the Cloudera distribution of Hadoop which is still 100% Apache licensed, but has some additional benefits. One of these benefits is that it is released by Doug Cutting , who started Hadoop and drove it’s development at Yahoo! He also started Lucene , which is another of my favourite Apache Projects, so I have good faith that he knows what he is doing. Another benefit, as you will see, is that it is simple to fire-up a Hadoop cluster. I am going to use C
5 0.81645691 731 high scalability-2009-10-28-Need for change in your IT infrastructure
Introduction: Companies earnings outstrip forecasts , consumer confidence is retuning and city bonuses are back . What does this mean for business? Growth! After the recent years of cost cutting in IT budgets, there is the sudden fear induced from increased demand. Pre-existing trouble points in IT infrastructures that have lain dormant will suddenly be exposed. Monthly reporting and real time analytics will suffer as data grows. IT departments across the land will be crying out “The engine canna take no more captain”. What can be done? What we need is a scalable system that grows with the business. A system that can handle sudden increases in data growth without falling over. There are two core principles to a scalable system (1) Users experience constant QoS as demand grows (2) System Architects can grow system capacity proportionally with the available resources. In other words, if demand increases twofold, it is “enough” to purchase twice the hardware. This is linear growth. Is it e
6 0.81222439 1138 high scalability-2011-11-07-10 Core Architecture Pattern Variations for Achieving Scalability
7 0.80458915 807 high scalability-2010-04-09-Vagrant - Build and Deploy Virtualized Development Environments Using Ruby
8 0.79035854 1211 high scalability-2012-03-19-LinkedIn: Creating a Low Latency Change Data Capture System with Databus
9 0.74146926 218 high scalability-2008-01-17-Moving old to new. Do not be afraid of the re-write -- but take some help
10 0.7338981 553 high scalability-2009-04-03-Collectl interface to Ganglia - any interest?
11 0.72889191 6 high scalability-2007-07-11-Friendster Architecture
12 0.72637367 232 high scalability-2008-01-29-When things aren't scalable
13 0.71755511 855 high scalability-2010-07-11-So, Why is Twitter Really Not Using Cassandra to Store Tweets?
14 0.70884269 351 high scalability-2008-07-16-The Mother of All Database Normalization Debates on Coding Horror
15 0.70277482 1003 high scalability-2011-03-14-6 Lessons from Dropbox - One Million Files Saved Every 15 minutes
16 0.6907407 972 high scalability-2011-01-11-Google Megastore - 3 Billion Writes and 20 Billion Read Transactions Daily
17 0.68185949 1385 high scalability-2013-01-11-Stuff The Internet Says On Scalability For January 11, 2013
18 0.66857374 1507 high scalability-2013-08-26-Reddit: Lessons Learned from Mistakes Made Scaling to 1 Billion Pageviews a Month
19 0.66683406 857 high scalability-2010-07-13-DbShards Part Deux - The Internals
20 0.6584549 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star