high_scalability high_scalability-2007 high_scalability-2007-123 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Hello,everybody,I'm plant to building a new website like 2008.sina.com.cn 2008.sohu.com .site contents have pic news,text news,and video news.user blog ....now I have a question to ask everybody,I hope can get usefully information to here. status: 100,000,000 people /per day 50,000 people /peak time more than 200 servers OpenBSD/Opensuse Apache Fast CGI modules lighttpd for picture Mysql varnish LVS lucene search do you have a good idea to it?thans for everybody!
sentIndex sentText sentNum sentScore
1 Hello,everybody,I'm plant to building a new website like 2008. [sent-1, score-0.708]
2 now I have a question to ask everybody,I hope can get usefully information to here. [sent-12, score-0.728]
3 status: 100,000,000 people /per day 50,000 people /peak time more than 200 servers OpenBSD/Opensuse Apache Fast CGI modules lighttpd for picture Mysql varnish LVS lucene search do you have a good idea to it? [sent-13, score-0.511]
wordName wordTfidf (topN-words)
[('pic', 0.493), ('plant', 0.392), ('cgi', 0.383), ('contents', 0.324), ('everybody', 0.311), ('hope', 0.208), ('ask', 0.195), ('question', 0.165), ('people', 0.165), ('blog', 0.16), ('video', 0.156), ('website', 0.128), ('idea', 0.112), ('information', 0.101), ('building', 0.097), ('fast', 0.089), ('good', 0.069), ('get', 0.059), ('new', 0.049), ('like', 0.042)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 123 high scalability-2007-10-15-Olympic Site Architecture
Introduction: Hello,everybody,I'm plant to building a new website like 2008.sina.com.cn 2008.sohu.com .site contents have pic news,text news,and video news.user blog ....now I have a question to ask everybody,I hope can get usefully information to here. status: 100,000,000 people /per day 50,000 people /peak time more than 200 servers OpenBSD/Opensuse Apache Fast CGI modules lighttpd for picture Mysql varnish LVS lucene search do you have a good idea to it?thans for everybody!
2 0.15824872 64 high scalability-2007-08-10-How do we make a large real-time search engine?
Introduction: We're implementing a website which should be oriented to content and with massive access by public and we would need a search engine to index and execute queries on the indexes of contents (stored in a database, most likely MySQL InnoDB or Oracle). The solution we found is to implement a separate service to make index constantly the contents of the database at regular intervals. Anyway, this is a complex and not optimal solution, since we would like it to index in real time and make it searchable. Could you point me to some examples or articles I could review to design a solution for such this context?
3 0.10630381 121 high scalability-2007-10-14-Newbie in scalability design issues
Introduction: I have 3 exp in building website using java.I work on only single server.Website is not very scalable.I always wonder how ebay,youtube,monster handle traffic, giving responses within seconds.From the google i find this site and i hope i can also able to build very scalable website .I need guidelines from where to start ,what are the things we needed.I know that scalability comes through the use of distributed applications but don't how to implement it. I see many website build in languages other than java so java is good choice for building high scalable website. Thanks
4 0.10010086 693 high scalability-2009-09-03-Storage Systems for High Scalable Systems presentation
Introduction: The High Scalable Systems (i.e. Websites) such as: Google, Facebook, Amazon, etc. need high scalable storage system that can deal with huge amount of data with high availability and reliability. Building large systems on top of a traditional RDBMS data storage layer is no longer good enough. This presentation explores the landscape of new technologies available today to augment your data layer to improve performance and reliability. Remember: All of my presentations contents is open source, please feel free to use it, copy it, and re-distribute it as you want. Download the presentation
5 0.095067024 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
6 0.092610806 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
7 0.092565514 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
8 0.090379022 301 high scalability-2008-04-08-Google AppEngine - A First Look
9 0.090314984 451 high scalability-2008-11-30-Creating a high-performing online database
10 0.078867264 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
11 0.077084228 1102 high scalability-2011-08-22-Strategy: Run a Scalable, Available, and Cheap Static Site on S3 or GitHub
12 0.07468646 596 high scalability-2009-05-11-Facebook, Hadoop, and Hive
13 0.074503347 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
14 0.072760515 30 high scalability-2007-07-26-Product: AWStats a Log Analyzer
15 0.071800329 274 high scalability-2008-03-12-YouTube Architecture
16 0.068293929 242 high scalability-2008-02-07-Looking for good business examples of compaines using Hadoop
17 0.065041602 1615 high scalability-2014-03-19-Strategy: Three Techniques to Survive Traffic Surges by Quickly Scaling Your Site
18 0.064662114 284 high scalability-2008-03-19-RAD Lab is Creating a Datacenter Operating System
19 0.064516291 794 high scalability-2010-03-11-What would you like to ask Justin.tv?
20 0.063353874 88 high scalability-2007-09-10-Blog: Scalable Web Architectures by Royans Tharakan
topicId topicWeight
[(0, 0.062), (1, 0.023), (2, 0.006), (3, -0.006), (4, 0.014), (5, -0.049), (6, -0.058), (7, 0.017), (8, 0.029), (9, 0.029), (10, -0.025), (11, -0.021), (12, -0.038), (13, 0.003), (14, 0.042), (15, -0.014), (16, 0.017), (17, 0.004), (18, -0.017), (19, -0.042), (20, -0.007), (21, 0.002), (22, 0.014), (23, 0.037), (24, -0.021), (25, -0.013), (26, 0.046), (27, 0.039), (28, 0.024), (29, 0.035), (30, -0.009), (31, -0.013), (32, 0.067), (33, 0.025), (34, -0.04), (35, -0.014), (36, -0.037), (37, -0.078), (38, 0.024), (39, 0.022), (40, 0.066), (41, 0.016), (42, 0.016), (43, -0.027), (44, 0.047), (45, 0.0), (46, -0.016), (47, 0.03), (48, 0.003), (49, 0.023)]
simIndex simValue blogId blogTitle
same-blog 1 0.94922608 123 high scalability-2007-10-15-Olympic Site Architecture
Introduction: Hello,everybody,I'm plant to building a new website like 2008.sina.com.cn 2008.sohu.com .site contents have pic news,text news,and video news.user blog ....now I have a question to ask everybody,I hope can get usefully information to here. status: 100,000,000 people /per day 50,000 people /peak time more than 200 servers OpenBSD/Opensuse Apache Fast CGI modules lighttpd for picture Mysql varnish LVS lucene search do you have a good idea to it?thans for everybody!
2 0.69393206 239 high scalability-2008-02-04-Streaming Video on Amazon EC2?
Introduction: An Amazon EC2 Flash Video Streaming solution has been announced by Wowza Media. What do you think about the future of similar solutions? Is Amazon EC2 and S3 ready for video streaming? I have found threads on their forums related to the performance, scalability and high availability of the hosted streaming solution. How would you make it scalable? Is it really cheaper than traditional hosting? Looking forward to your thoughts!
3 0.67405772 447 high scalability-2008-11-19-High Definition Video Delivery on the Web?
Introduction: How would you architect and implement an SD and HD internet video delivery system such as the BBC iPlayer or Recast Digital's RDV1 . What do you need to consider on top of the Lessons Learned section in the YouTube Architecture post? How is it possible to compete with the big players like Google? Can you just use a CDN and scale efficiently? Would Amazon's cloud services be a viable platform for high-definition video streaming?
4 0.65517235 1201 high scalability-2012-02-29-Strategy: Put Mobile Video Into Cold Storage After 30 Days
Introduction: Limelight says 95% of Mobile Video Views Take Place in First 90 Days and 88.8 percent of views take place in the first 30 days. Since a lot of people are working with video, which is expensive to store and serve, the implication: there's little need to keep your video close to the user or on a CDN after 30 days.
5 0.64695412 991 high scalability-2011-02-16-Paper: An Experimental Investigation of the Akamai Adaptive Video Streaming
Introduction: Video is hot on the Internet and people are really interested in knowing how to make it work. Dan Rayburn has a post pointing to a fascinating paper: An Experimental Investigation of the Akamai Adaptive Video Streaming , which talks in some detail about the protocols big players like YouTube, Skype and Akamai use to serve video over on an inherently video unfriendly medium like the Internet. For Akamai they found: Each video is encoded in five versions at different bit rates and stored in separate files. The client sends commands to the server with an average inter departure time of about 2 s, i.e. the control algorithm is executed on average each 2 seconds. Akamai uses only the video level to adapt the video source to the available bandwidth, whereas the frame rate of the video is kept constant. When a sudden drop in the available bandwidth occurs, short interruptions of the video playback can occur due to the a large actuation delay. For a sudden increase of the avai
6 0.62413305 294 high scalability-2008-04-01-How to update video views count effectively?
7 0.61623549 560 high scalability-2009-04-08-Learned lessons from the largest player (Flickr, YouTube, Google, etc)
8 0.60740733 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
9 0.59194309 267 high scalability-2008-03-05-Oprah is the Real Social Network
10 0.56740648 193 high scalability-2007-12-26-Finding an excellent LAMP developer
11 0.55903023 747 high scalability-2009-11-26-What I'm Thankful For on Thanksgiving
13 0.53767049 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
14 0.53637201 375 high scalability-2008-09-01-A Scalability checklist?
15 0.53567541 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
16 0.52988708 335 high scalability-2008-05-30-Is "Scaling Engineer" a new job title?
17 0.52787185 60 high scalability-2007-08-07-Can you profit from the coming Content Delivery Network wars?
18 0.52759725 121 high scalability-2007-10-14-Newbie in scalability design issues
19 0.52148628 1037 high scalability-2011-05-10-Viddler Architecture - 7 Million Embeds a Day and 1500 Req-Sec Peak
20 0.51607132 181 high scalability-2007-12-11-Hosting and CDN for startup video sharing site
topicId topicWeight
[(1, 0.133), (79, 0.212), (82, 0.449)]
simIndex simValue blogId blogTitle
same-blog 1 0.81355178 123 high scalability-2007-10-15-Olympic Site Architecture
Introduction: Hello,everybody,I'm plant to building a new website like 2008.sina.com.cn 2008.sohu.com .site contents have pic news,text news,and video news.user blog ....now I have a question to ask everybody,I hope can get usefully information to here. status: 100,000,000 people /per day 50,000 people /peak time more than 200 servers OpenBSD/Opensuse Apache Fast CGI modules lighttpd for picture Mysql varnish LVS lucene search do you have a good idea to it?thans for everybody!
2 0.71979427 640 high scalability-2009-06-28-Google Voice Architecture
Introduction: Hi High Scalability community! Do you have any information on the architecture behind Google Voice , the new service by Google that offers one Google Number for all your calls and SMS? It is based on GrandCentral who has been acquired by Google 2 years ago. Thanks!
3 0.64547908 494 high scalability-2009-01-16-Reducing Your Website's Bandwidth Usage - how to
Introduction: In this article Jeff Atwood (a rockstar programmer and one of StackOverflow website founders) discusses the measures of how you can reduce you bandwidth usage and refers specifically on high trafficked websites for which bandwidth is more costly than for an average website. This is his experience and you can read more on his post on CodingHorror.com .
4 0.61902046 326 high scalability-2008-05-25-Product: Condor - Compute Intensive Workload Management
Introduction: From their website: Condor is a specialized workload management system for compute-intensive jobs. Like other full-featured batch systems, Condor provides a job queueing mechanism, scheduling policy, priority scheme, resource monitoring, and resource management. Users submit their serial or parallel jobs to Condor, Condor places them into a queue, chooses when and where to run the jobs based upon a policy, carefully monitors their progress, and ultimately informs the user upon completion. While providing functionality similar to that of a more traditional batch queueing system, Condor's novel architecture allows it to succeed in areas where traditional scheduling systems fail. Condor can be used to manage a cluster of dedicated compute nodes (such as a "Beowulf" cluster). In addition, unique mechanisms enable Condor to effectively harness wasted CPU power from otherwise idle desktop workstations. For instance, Condor can be configured to only use desktop machines where the keyboard
5 0.48095626 1045 high scalability-2011-05-20-Stuff The Internet Says On Scalability For May 20, 2011
Introduction: Submitted for your reading pleasure on this beautiful morning: Group Decision Making in Honey Bee Swarms . In distributed computing systems nodes reach a quorum when deciding what to do as a group. It turns out bees also use quorum logic when deciding on where to nest! Bees do it a bit differently of course: A scout bee votes for a site by spending time at it, somehow the scouts act and interact so that their numbers rise faster at superior sites, and somehow the bees at each site monitor their numbers there so that they know whether they've reached the threshold number (quorum) and can proceed to initiating the swarm's move to this site. Ants use similar mechanisms to control foraging. Distributed systems may share common mechanisms based on their nature as being a distributed system, the components may not matter that much. Fire! Fire! Brent Chapman shows how to put that IT fire out in Incident Command for IT: What We Can Learn from the Fire Department .
6 0.46590543 40 high scalability-2007-07-30-Product: Amazon Elastic Compute Cloud
7 0.46582261 372 high scalability-2008-08-27-Updating distributed web applications
8 0.45506397 1277 high scalability-2012-07-05-10 Golden Principles For Building Successful Mobile-Web Applications
9 0.45021528 784 high scalability-2010-02-25-Paper: High Performance Scalable Data Stores
10 0.44965589 743 high scalability-2009-11-23-Big Data on Grids or on Clouds?
11 0.44927213 8 high scalability-2007-07-12-Should I use LAMP or Windows?
12 0.44861698 1100 high scalability-2011-08-18-Paper: The Akamai Network - 61,000 servers, 1,000 networks, 70 countries
13 0.44049191 650 high scalability-2009-07-02-Product: Hbase
14 0.44025943 1162 high scalability-2011-12-23-Funny: A Cautionary Tale About Storage and Backup
15 0.43749914 107 high scalability-2007-10-02-Some Real Financial Numbers for Your Startup
16 0.43231407 1169 high scalability-2012-01-05-Shutterfly Saw a Speedup of 500% With Flashcache
17 0.4299686 443 high scalability-2008-11-14-Paper: Pig Latin: A Not-So-Foreign Language for Data Processing
18 0.42932186 75 high scalability-2007-08-28-Google Utilities : An online google guide,tools and Utilities.
19 0.42781723 782 high scalability-2010-02-23-When to migrate your database?
20 0.42492074 224 high scalability-2008-01-27-Scalability vs Performance vs Availability vs Reliability.. Also scale up vs scale out ???