hilary_mason_data hilary_mason_data-2011 hilary_mason_data-2011-61 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: bash: get http response codes for a list of URLs Posted: August 24, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , script , shell | 14 Comments » I had a file with a list of URLs, and I wanted to grab the HTTP response codes for each of them. I’m sure this quick bash script isn’t the best way to do it, but it works, and I’ll probably want to do this again someday, so here it is! #!/bin/bash while read line do echo $(curl --write-out %{http_code} --silent --output /dev/null $line) done <$1
sentIndex sentText sentNum sentScore
1 bash: get http response codes for a list of URLs Posted: August 24, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , script , shell | 14 Comments » I had a file with a list of URLs, and I wanted to grab the HTTP response codes for each of them. [sent-1, score-3.345]
2 I’m sure this quick bash script isn’t the best way to do it, but it works, and I’ll probably want to do this again someday, so here it is! [sent-2, score-1.228]
wordName wordTfidf (topN-words)
[('bash', 0.503), ('codes', 0.373), ('response', 0.288), ('urls', 0.288), ('line', 0.258), ('http', 0.245), ('script', 0.188), ('shell', 0.168), ('echo', 0.168), ('grab', 0.168), ('list', 0.161), ('works', 0.144), ('file', 0.144), ('wanted', 0.144), ('done', 0.123), ('isn', 0.117), ('probably', 0.112), ('quick', 0.108), ('august', 0.1), ('sure', 0.094), ('best', 0.085), ('read', 0.076), ('want', 0.074), ('code', 0.07), ('way', 0.064), ('ll', 0.058), ('get', 0.058), ('mason', 0.022), ('comments', 0.014), ('blog', 0.013), ('tags', 0.009)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 61 hilary mason data-2011-08-24-bash: get http response codes for a list of URLs
Introduction: bash: get http response codes for a list of URLs Posted: August 24, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , script , shell | 14 Comments » I had a file with a list of URLs, and I wanted to grab the HTTP response codes for each of them. I’m sure this quick bash script isn’t the best way to do it, but it works, and I’ll probably want to do this again someday, so here it is! #!/bin/bash while read line do echo $(curl --write-out %{http_code} --silent --output /dev/null $line) done <$1
2 0.21233493 56 hilary mason data-2011-05-02-How to get a random line from a file in bash.
Introduction: How to get a random line from a file in bash. Posted: May 2, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , one-liner , remember , tips | 25 Comments » I work with a lot of data, and while I’d like to pretend it’s all in upside-down quasi-indexed b-tree rocket ships or some other advanced database, the truth is that much of it is in text files. I often find myself wanting to see a random line from one of these files, just to get a sense of what the data looks like. I thought there must be an easy bash way to do this, but I couldn’t find it (‘shuf’ isn’t installed on my server), so I turned to twitter, and now I’m pleased to present more methods for finding a random line than you ever expected! sort -R | head -n 1 If you can use this, do so! If it isn’t available, consider one of the following commands: @andrewgilmartin suggests using awk: awk 'BEGIN { srand() } rand() >= 0.5 { print; exit }' @devinteske offer
3 0.11574739 17 hilary mason data-2008-03-17-LSL: Notecard Selector
Introduction: LSL: Notecard Selector Posted: March 17, 2008 | Author: hilary | Filed under: blog | Tags: library , library script , lsl , lsl script , script , second life , social networking , virtual worlds | 15 Comments » One of my friendly librarian colleagues in SL asked if I had a script to generate dialogs and allow users to select notecards handy. I didn’t, so I coded it up. It seems like it could be useful to others, so here you go: This script is in LSL, for Second Life. Just copy and paste it into a script, throw a few notecards into the object, and you’ll be ready to go! // Notecard Selector // by Ann Enigma // This script presents users with a list of notecards in a dialog box, and allows them to select one // Note: The names of the notecards must be less than 24 characters long // This script is licenced under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License // http://creativecommons.org/licenses/by-nc-sa/3.
4 0.10308012 72 hilary mason data-2012-03-17-Short URLs, Big Fun: I spoke at dropbox!
Introduction: Short URLs, Big Fun: I spoke at dropbox! Posted: March 17, 2012 | Author: Hilary Mason | Filed under: Presentations | 3 Comments Âť The awesome team over at dropbox invited me to come by and give a talk. They have a great post up at their blog, but you can also grab the slides here and see the full video on youtube .
5 0.097786486 45 hilary mason data-2010-07-26-A quick twitter bot, @bc l
Introduction: A quick twitter bot, @bc_l Posted: July 26, 2010 | Author: hilary | Filed under: blog , projects | Tags: bc , bot , command line , hack , script , twitter , unix | 5 Comments » Several months ago, on a whim inspired by an off-hand comment from Chris , I created a bot to bring the wonders of the Unix bc language to twitter. bc is a command-line calculator that’s fast and has the capacity to do some fairly complex math. Try it out on the command line: echo '100 / 10' | bc -l …Or by sending a direct message to bc_l (if you follow bc_l it will follow you back within a few hours). I released the code under GPL, and it’s available on github: http://github.com/hmason/tweetbc . John Cook mentions the bot and makes some great observations in his post three surprises with bc .
6 0.094616525 28 hilary mason data-2009-04-28-LSL: AOL IM Status Indicator
7 0.093611091 37 hilary mason data-2009-11-25-IgniteNYC: How to Replace Yourself with a Very Small Shell Script
8 0.084274083 115 hilary mason data-2014-02-14-Play with your food!
9 0.079273775 38 hilary mason data-2009-12-24-IgniteNYC: The video!
10 0.07456252 2 hilary mason data-2006-05-04-Intro to the Linux Command Line
11 0.072390139 62 hilary mason data-2011-09-25-Conference: Strata NY 2011
12 0.065976657 23 hilary mason data-2009-01-01-Twitter: A greasemonkey script to show who follows you
13 0.061467122 86 hilary mason data-2013-01-22-Introbot: A Script to Ease the Process of Writing Introductory E-mails
14 0.055932984 43 hilary mason data-2010-05-27-E-mail automation, questions and answers
15 0.049111564 82 hilary mason data-2013-01-08-Bitly Social Data APIs
16 0.047648199 39 hilary mason data-2010-01-03-SMS to e-mail gateway: The SMS doorbell
17 0.046355888 26 hilary mason data-2009-02-28-LSL: Newspaper Stand (Pull Data From an API and Display it in Second Life)
18 0.042549502 80 hilary mason data-2012-12-28-Getting Started with Data Science
19 0.041229524 55 hilary mason data-2011-03-27-Gitmarks: a peer-to-peer bookmarking system
20 0.041078866 65 hilary mason data-2011-10-21-I’m on Fortune’s 40 Under 40: Ones to Watch list!
topicId topicWeight
[(0, -0.136), (1, 0.02), (2, -0.091), (3, 0.143), (4, -0.171), (5, 0.043), (6, -0.252), (7, 0.106), (8, -0.017), (9, -0.003), (10, -0.048), (11, 0.038), (12, -0.159), (13, -0.226), (14, -0.048), (15, 0.071), (16, -0.245), (17, 0.149), (18, -0.175), (19, 0.144), (20, -0.185), (21, 0.007), (22, 0.298), (23, -0.093), (24, -0.052), (25, -0.057), (26, -0.082), (27, -0.092), (28, 0.057), (29, -0.003), (30, 0.008), (31, -0.019), (32, 0.051), (33, -0.036), (34, -0.017), (35, -0.017), (36, -0.096), (37, 0.064), (38, -0.09), (39, -0.023), (40, 0.05), (41, -0.051), (42, 0.089), (43, -0.048), (44, -0.075), (45, -0.051), (46, 0.101), (47, -0.088), (48, -0.035), (49, -0.011)]
simIndex simValue blogId blogTitle
same-blog 1 0.99272156 61 hilary mason data-2011-08-24-bash: get http response codes for a list of URLs
Introduction: bash: get http response codes for a list of URLs Posted: August 24, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , script , shell | 14 Comments » I had a file with a list of URLs, and I wanted to grab the HTTP response codes for each of them. I’m sure this quick bash script isn’t the best way to do it, but it works, and I’ll probably want to do this again someday, so here it is! #!/bin/bash while read line do echo $(curl --write-out %{http_code} --silent --output /dev/null $line) done <$1
2 0.58942139 56 hilary mason data-2011-05-02-How to get a random line from a file in bash.
Introduction: How to get a random line from a file in bash. Posted: May 2, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , one-liner , remember , tips | 25 Comments » I work with a lot of data, and while I’d like to pretend it’s all in upside-down quasi-indexed b-tree rocket ships or some other advanced database, the truth is that much of it is in text files. I often find myself wanting to see a random line from one of these files, just to get a sense of what the data looks like. I thought there must be an easy bash way to do this, but I couldn’t find it (‘shuf’ isn’t installed on my server), so I turned to twitter, and now I’m pleased to present more methods for finding a random line than you ever expected! sort -R | head -n 1 If you can use this, do so! If it isn’t available, consider one of the following commands: @andrewgilmartin suggests using awk: awk 'BEGIN { srand() } rand() >= 0.5 { print; exit }' @devinteske offer
3 0.49916375 45 hilary mason data-2010-07-26-A quick twitter bot, @bc l
Introduction: A quick twitter bot, @bc_l Posted: July 26, 2010 | Author: hilary | Filed under: blog , projects | Tags: bc , bot , command line , hack , script , twitter , unix | 5 Comments » Several months ago, on a whim inspired by an off-hand comment from Chris , I created a bot to bring the wonders of the Unix bc language to twitter. bc is a command-line calculator that’s fast and has the capacity to do some fairly complex math. Try it out on the command line: echo '100 / 10' | bc -l …Or by sending a direct message to bc_l (if you follow bc_l it will follow you back within a few hours). I released the code under GPL, and it’s available on github: http://github.com/hmason/tweetbc . John Cook mentions the bot and makes some great observations in his post three surprises with bc .
4 0.34214851 17 hilary mason data-2008-03-17-LSL: Notecard Selector
Introduction: LSL: Notecard Selector Posted: March 17, 2008 | Author: hilary | Filed under: blog | Tags: library , library script , lsl , lsl script , script , second life , social networking , virtual worlds | 15 Comments » One of my friendly librarian colleagues in SL asked if I had a script to generate dialogs and allow users to select notecards handy. I didn’t, so I coded it up. It seems like it could be useful to others, so here you go: This script is in LSL, for Second Life. Just copy and paste it into a script, throw a few notecards into the object, and you’ll be ready to go! // Notecard Selector // by Ann Enigma // This script presents users with a list of notecards in a dialog box, and allows them to select one // Note: The names of the notecards must be less than 24 characters long // This script is licenced under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License // http://creativecommons.org/licenses/by-nc-sa/3.
5 0.33756909 2 hilary mason data-2006-05-04-Intro to the Linux Command Line
Introduction: Intro to the Linux Command Line Posted: May 4, 2006 | Author: hilary | Filed under: articles , blog | Tags: command line , linux , ssh , tutorial | 2 Comments » This document will step through the process of accessing a Linux server, and several basic commands. SSH We will access the server via the SSH , or “Secure SHell”, protocol. SSH provides encrypted communication between two terminals. It is an alternative to telnet or rlogin. First, make sure that you have an SSH client. If you are running Windows, I highly recommend downloading Putty . Click on the top Windows binary and save it to the desktop. You can run Putty.exe directly, without installing. If you are using OS X, open a terminal and run ‘ssh’. Logging In Type your hostname into the box. You can find your hostname by asking your ISP, but a good bet is that “www.yourdomain.com” will resolve to your server. You may need to request shell access Click open. You’ll be presented
6 0.32016093 72 hilary mason data-2012-03-17-Short URLs, Big Fun: I spoke at dropbox!
7 0.29635024 28 hilary mason data-2009-04-28-LSL: AOL IM Status Indicator
8 0.23842618 37 hilary mason data-2009-11-25-IgniteNYC: How to Replace Yourself with a Very Small Shell Script
9 0.20990255 38 hilary mason data-2009-12-24-IgniteNYC: The video!
10 0.1941081 86 hilary mason data-2013-01-22-Introbot: A Script to Ease the Process of Writing Introductory E-mails
11 0.19355616 115 hilary mason data-2014-02-14-Play with your food!
12 0.1815359 43 hilary mason data-2010-05-27-E-mail automation, questions and answers
13 0.17884584 23 hilary mason data-2009-01-01-Twitter: A greasemonkey script to show who follows you
14 0.16757539 103 hilary mason data-2013-06-04-Lucene Revolution Keynote: Search is Not a Solved Problem
15 0.16748329 62 hilary mason data-2011-09-25-Conference: Strata NY 2011
16 0.15968911 65 hilary mason data-2011-10-21-I’m on Fortune’s 40 Under 40: Ones to Watch list!
17 0.15238586 76 hilary mason data-2012-08-28-How do you prioritize research?
18 0.14757618 26 hilary mason data-2009-02-28-LSL: Newspaper Stand (Pull Data From an API and Display it in Second Life)
19 0.14385906 82 hilary mason data-2013-01-08-Bitly Social Data APIs
20 0.14269267 60 hilary mason data-2011-08-21-What do you read that changes the way you think?
topicId topicWeight
[(2, 0.152), (67, 0.668)]
simIndex simValue blogId blogTitle
same-blog 1 0.96744013 61 hilary mason data-2011-08-24-bash: get http response codes for a list of URLs
Introduction: bash: get http response codes for a list of URLs Posted: August 24, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , script , shell | 14 Comments » I had a file with a list of URLs, and I wanted to grab the HTTP response codes for each of them. I’m sure this quick bash script isn’t the best way to do it, but it works, and I’ll probably want to do this again someday, so here it is! #!/bin/bash while read line do echo $(curl --write-out %{http_code} --silent --output /dev/null $line) done <$1
2 0.94321632 103 hilary mason data-2013-06-04-Lucene Revolution Keynote: Search is Not a Solved Problem
Introduction: Lucene Revolution Keynote: Search is Not a Solved Problem Posted: June 4, 2013 | Author: Hilary Mason | Filed under: Presentations | Tags: lucene , presentation , search , solr , talk | 3 Comments » The wonderful folks at LucidWorks have posted the video of my recent Lucene Revolution keynote. The brief idea behind this talk is that search is not a solved problem — there is still a big opportunity for building search (and finding?) capabilities for the kinds of questions that the current product fail to solve. For example, why do search engines just return a list of sorted URLs, but give me no information about the themes that are consistent across them? The audience was technical, specifically Lucene and Solr devs, so I spent some time talking about how we use those technologies at bitly.
3 0.86042684 63 hilary mason data-2011-09-26-Hacking the Food System: The Ultimate Chocolate Chip Cookie
Introduction: Hacking the Food System: The Ultimate Chocolate Chip Cookie Posted: September 26, 2011 | Author: Hilary Mason | Filed under: blog , projects | Tags: cookies , food , tech , writing | 1 Comment » Food+Tech Connect is putting together a fun series of essays where technologists and foodies share their opinions on how to hack to the food system. They also had a great party, with liquid nitrogen ice cream and other very cool foods. I’m honored to have been asked to participate, especially since food and tech are two of my favorite things! I decided to write about a hack that I did about three years ago, where I wrote a parser and built a statistical model of chocolate chip cookie recipes that I crawled off of the web. I’d like to tell you the story of the Ultimate Chocolate Chip Cookie Recipe. This isn’t the Neiman Marcus $65,000 cookie recipe. Nor is it the classic Toll House Chocolate Chip Cookie recipe that we all grew up with (and, though th
4 0.23298599 45 hilary mason data-2010-07-26-A quick twitter bot, @bc l
Introduction: A quick twitter bot, @bc_l Posted: July 26, 2010 | Author: hilary | Filed under: blog , projects | Tags: bc , bot , command line , hack , script , twitter , unix | 5 Comments » Several months ago, on a whim inspired by an off-hand comment from Chris , I created a bot to bring the wonders of the Unix bc language to twitter. bc is a command-line calculator that’s fast and has the capacity to do some fairly complex math. Try it out on the command line: echo '100 / 10' | bc -l …Or by sending a direct message to bc_l (if you follow bc_l it will follow you back within a few hours). I released the code under GPL, and it’s available on github: http://github.com/hmason/tweetbc . John Cook mentions the bot and makes some great observations in his post three surprises with bc .
5 0.22104521 94 hilary mason data-2013-03-08-Speaking: Title Slides + Twitter = You Win
Introduction: Speaking: Title Slides + Twitter = You Win Posted: March 8, 2013 | Author: Hilary Mason | Filed under: speaking | Tags: slides , speaking , title , twitter | 2 Comments » Your title slide should focus on the title of the talk. It should also include your name and affiliation, your logo if you have a cute one, possibly your blog or e-mail address if you want people to get in touch, and your twitter handle. Here’s one of mine: I usually mention that the beginning of the talk that if people have questions they can tweet them at me. This isn’t just because Twitter is a great way to get questions from people too shy to speak up (or who don’t get an opportunity). Here’s the hack: letting people know that you’ll be reading everything they say about your talk on Twitter makes them more likely to say nice things. Further, in a multi-track conference, people who weren’t actually in your talk (or were there but not paying a lot of attention) will judge your
6 0.22045882 60 hilary mason data-2011-08-21-What do you read that changes the way you think?
7 0.2200492 90 hilary mason data-2013-02-18-One Random Tweet, please.
8 0.21878843 34 hilary mason data-2009-10-16-Data: first and last names from the US Census
9 0.19089794 56 hilary mason data-2011-05-02-How to get a random line from a file in bash.
10 0.17861347 93 hilary mason data-2013-03-01-Speaking: Pick a Vague and Specific Title for Your Talk
11 0.17421861 105 hilary mason data-2013-07-05-Speaking: Spend at least 1-3 of the time practicing the talk
12 0.17061636 82 hilary mason data-2013-01-08-Bitly Social Data APIs
13 0.16359849 113 hilary mason data-2013-11-22-Speaking: Two Questions to Ask Before You Give a Talk
14 0.16351773 91 hilary mason data-2013-02-22-Why YOU (an introverted nerd) Should Try Public Speaking
15 0.15978423 24 hilary mason data-2009-01-31-WordPress tip: Move comments from one post to another post
16 0.14932248 95 hilary mason data-2013-03-17-Speaking: Entertain, Don’t Teach
17 0.14220501 104 hilary mason data-2013-06-14-Speaking: Your Slides != Your Talk
18 0.13900681 28 hilary mason data-2009-04-28-LSL: AOL IM Status Indicator
19 0.13804835 13 hilary mason data-2008-01-22-Create a group Twitter account
20 0.13768689 83 hilary mason data-2013-01-10-Book Book — Goose!