hilary_mason_data hilary_mason_data-2013 hilary_mason_data-2013-109 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Need actual random numbers? Meet the NIST randomness beacon. Posted: September 30, 2013 | Author: Hilary Mason | Filed under: projects | Tags: beacon , python , random , randomness , randomnumbers | 5 Comments » I wrote a python module that wraps that NIST Randomness Beacon , making it simple to get truly random numbers in python. It’s easy to use: b = Beacon() print b.last_record() print b.previous_record() #and so on There’s also a handy generator for getting a set of n random numbers. (One of the best gifts I ever got was a copy of 1,000,000 Random Numbers , and I’ve been intrigued ever since.) Please note that this the randomness beacon is not intended to be a source of cryptographic keys — indeed, it’s a public set of numbers, so I wouldn’t recommend doing anything that could be compromised by someone else having the access to the exact same set of numbers . Rather, this is interesting precisely for the scientific opportunities that
sentIndex sentText sentNum sentScore
1 previous_record() #and so on There’s also a handy generator for getting a set of n random numbers. [sent-6, score-0.765]
2 (One of the best gifts I ever got was a copy of 1,000,000 Random Numbers , and I’ve been intrigued ever since. [sent-7, score-0.532]
3 ) Please note that this the randomness beacon is not intended to be a source of cryptographic keys — indeed, it’s a public set of numbers, so I wouldn’t recommend doing anything that could be compromised by someone else having the access to the exact same set of numbers . [sent-8, score-2.394]
4 Rather, this is interesting precisely for the scientific opportunities that are possible when you have a random but public set of inputs. [sent-9, score-0.946]
wordName wordTfidf (topN-words)
[('numbers', 0.452), ('beacon', 0.424), ('randomness', 0.424), ('random', 0.358), ('nist', 0.212), ('set', 0.152), ('print', 0.15), ('ever', 0.14), ('public', 0.125), ('python', 0.114), ('exact', 0.09), ('module', 0.09), ('generator', 0.09), ('keys', 0.09), ('handy', 0.09), ('wraps', 0.09), ('indeed', 0.09), ('scientific', 0.081), ('intrigued', 0.081), ('source', 0.081), ('actual', 0.081), ('precisely', 0.081), ('recommend', 0.075), ('wouldn', 0.075), ('rather', 0.07), ('copy', 0.066), ('else', 0.066), ('opportunities', 0.063), ('got', 0.063), ('wrote', 0.063), ('access', 0.057), ('note', 0.057), ('meet', 0.057), ('could', 0.053), ('simple', 0.051), ('making', 0.051), ('september', 0.051), ('someone', 0.049), ('getting', 0.049), ('possible', 0.047), ('anything', 0.047), ('easy', 0.046), ('best', 0.042), ('interesting', 0.039), ('need', 0.037), ('projects', 0.037), ('please', 0.036), ('get', 0.028), ('ve', 0.027), ('also', 0.026)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 109 hilary mason data-2013-09-30-Need actual random numbers? Meet the NIST randomness beacon.
Introduction: Need actual random numbers? Meet the NIST randomness beacon. Posted: September 30, 2013 | Author: Hilary Mason | Filed under: projects | Tags: beacon , python , random , randomness , randomnumbers | 5 Comments » I wrote a python module that wraps that NIST Randomness Beacon , making it simple to get truly random numbers in python. It’s easy to use: b = Beacon() print b.last_record() print b.previous_record() #and so on There’s also a handy generator for getting a set of n random numbers. (One of the best gifts I ever got was a copy of 1,000,000 Random Numbers , and I’ve been intrigued ever since.) Please note that this the randomness beacon is not intended to be a source of cryptographic keys — indeed, it’s a public set of numbers, so I wouldn’t recommend doing anything that could be compromised by someone else having the access to the exact same set of numbers . Rather, this is interesting precisely for the scientific opportunities that
2 0.19897094 90 hilary mason data-2013-02-18-One Random Tweet, please.
Introduction: One Random Tweet, please. Posted: February 18, 2013 | Author: Hilary Mason | Filed under: projects | 4 Comments » One random tweet. It’s easy to believe that other people use social networks in the same way that you do. Your friends largely do use them the same way, which gives us an even more biased perspective. Unfortunately, most networks don’t provide a way to explore representative communications that you’re not connected to. Well, now you can! One random tweet , please. Update: There were some slight technical difficulties due to hitting Twitter’s oembed rate limit. They should be repaired now. (Note: between this and bookbookgoose.com I’m on a bit of a random kick lately. There’s a method to this madness!)
3 0.15066399 56 hilary mason data-2011-05-02-How to get a random line from a file in bash.
Introduction: How to get a random line from a file in bash. Posted: May 2, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , one-liner , remember , tips | 25 Comments » I work with a lot of data, and while I’d like to pretend it’s all in upside-down quasi-indexed b-tree rocket ships or some other advanced database, the truth is that much of it is in text files. I often find myself wanting to see a random line from one of these files, just to get a sense of what the data looks like. I thought there must be an easy bash way to do this, but I couldn’t find it (‘shuf’ isn’t installed on my server), so I turned to twitter, and now I’m pleased to present more methods for finding a random line than you ever expected! sort -R | head -n 1 If you can use this, do so! If it isn’t available, consider one of the following commands: @andrewgilmartin suggests using awk: awk 'BEGIN { srand() } rand() >= 0.5 { print; exit }' @devinteske offer
4 0.078289114 83 hilary mason data-2013-01-10-Book Book — Goose!
Introduction: Book Book — Goose! Posted: January 10, 2013 | Author: Hilary Mason | Filed under: projects | Tags: absurdity , hack | 25 Comments » I like to read. I love bookstores, I like to wander, and to find things that I didn’t know existed. But bookstores don’t have every book that exists. Amazon has most books, but search is a terrible way to discover new things. Amazon’s recommendations most likely maximize purchases, but are a terrible way to find something you didn’t know you were looking for (look at a book like Effective JavaScript , for example, and you get recommendations for Async JavaScript , Building Node Applications with MongoDB and Backbone , JavaScript Enlightenment ). Similarly, top 100 lists are great at showing you popular things that you’re probably more likely to buy, but not very good at helping you find a book with a story or idea that’s unlike anything you’ve read lately. There must be a better way to explore books. A random way to explor
5 0.072755918 1 hilary mason data-2006-02-20-JavaScript Rotating Images Tutorial
Introduction: JavaScript Rotating Images Tutorial Posted: February 20, 2006 | Author: hilary | Filed under: articles , blog | Tags: javascript , web dev | 1 Comment » Introduction Swapping new images into an established layout is one trick that can keep a site design fresh. Some examples: gettyimages benstraw There are several different techniques for accomplishing this effect. A server-side program is the best approach, because you can automatically pull files from a whole directory (eliminating the need to modify code), and it will work even if a user has JavaScript disabled. Unfortunately, not everyone has access to a host that supports server-side scripting. That’s okay, because the same thing can be accomplished with client-side code in JavaScript. I’ll show you how, with three JavaScript functions of varying levels of ease and functionality. First, gather two or more images that are the same size. Then read on… Setup Click here to see t
6 0.064445831 39 hilary mason data-2010-01-03-SMS to e-mail gateway: The SMS doorbell
7 0.06407015 31 hilary mason data-2009-08-12-My NYC Python Meetup Presentation: Practical Data Analysis in Python
8 0.058925308 110 hilary mason data-2013-10-06-What Mugshots Mean For Public Data
9 0.046042144 86 hilary mason data-2013-01-22-Introbot: A Script to Ease the Process of Writing Introductory E-mails
10 0.037626512 7 hilary mason data-2007-07-30-Tip: How to Search Google for Ideas
11 0.036228314 34 hilary mason data-2009-10-16-Data: first and last names from the US Census
12 0.03545526 10 hilary mason data-2007-09-02-Autoscript Creates LSL Scripts Without Code
13 0.033289544 4 hilary mason data-2007-06-11-Teaching Search Techniques with Google Games
14 0.03304274 91 hilary mason data-2013-02-22-Why YOU (an introverted nerd) Should Try Public Speaking
15 0.033013083 85 hilary mason data-2013-01-19-Startups: How to Share Data with Academics
16 0.032176688 80 hilary mason data-2012-12-28-Getting Started with Data Science
17 0.031735569 112 hilary mason data-2013-11-01-Books Recommendations for Programming Excellence
18 0.031557061 40 hilary mason data-2010-02-16-Conference: Search and Social Media 2010
19 0.026458915 66 hilary mason data-2011-10-21-Web 2.0 Summit: The Secrets of our Data Subconscious
20 0.025587948 82 hilary mason data-2013-01-08-Bitly Social Data APIs
topicId topicWeight
[(0, -0.11), (1, 0.022), (2, -0.104), (3, 0.013), (4, -0.048), (5, 0.134), (6, -0.066), (7, 0.207), (8, 0.043), (9, -0.174), (10, 0.185), (11, -0.156), (12, 0.012), (13, -0.15), (14, 0.185), (15, -0.196), (16, -0.121), (17, -0.011), (18, 0.077), (19, 0.095), (20, 0.036), (21, 0.071), (22, -0.157), (23, 0.018), (24, 0.071), (25, 0.215), (26, -0.041), (27, -0.008), (28, 0.103), (29, 0.093), (30, 0.067), (31, -0.04), (32, -0.017), (33, -0.116), (34, 0.142), (35, -0.078), (36, 0.076), (37, -0.018), (38, 0.186), (39, -0.065), (40, -0.048), (41, -0.037), (42, -0.036), (43, 0.066), (44, 0.024), (45, 0.063), (46, 0.017), (47, 0.013), (48, 0.019), (49, 0.222)]
simIndex simValue blogId blogTitle
same-blog 1 0.99541062 109 hilary mason data-2013-09-30-Need actual random numbers? Meet the NIST randomness beacon.
Introduction: Need actual random numbers? Meet the NIST randomness beacon. Posted: September 30, 2013 | Author: Hilary Mason | Filed under: projects | Tags: beacon , python , random , randomness , randomnumbers | 5 Comments » I wrote a python module that wraps that NIST Randomness Beacon , making it simple to get truly random numbers in python. It’s easy to use: b = Beacon() print b.last_record() print b.previous_record() #and so on There’s also a handy generator for getting a set of n random numbers. (One of the best gifts I ever got was a copy of 1,000,000 Random Numbers , and I’ve been intrigued ever since.) Please note that this the randomness beacon is not intended to be a source of cryptographic keys — indeed, it’s a public set of numbers, so I wouldn’t recommend doing anything that could be compromised by someone else having the access to the exact same set of numbers . Rather, this is interesting precisely for the scientific opportunities that
2 0.62825233 90 hilary mason data-2013-02-18-One Random Tweet, please.
Introduction: One Random Tweet, please. Posted: February 18, 2013 | Author: Hilary Mason | Filed under: projects | 4 Comments » One random tweet. It’s easy to believe that other people use social networks in the same way that you do. Your friends largely do use them the same way, which gives us an even more biased perspective. Unfortunately, most networks don’t provide a way to explore representative communications that you’re not connected to. Well, now you can! One random tweet , please. Update: There were some slight technical difficulties due to hitting Twitter’s oembed rate limit. They should be repaired now. (Note: between this and bookbookgoose.com I’m on a bit of a random kick lately. There’s a method to this madness!)
3 0.57673711 56 hilary mason data-2011-05-02-How to get a random line from a file in bash.
Introduction: How to get a random line from a file in bash. Posted: May 2, 2011 | Author: Hilary Mason | Filed under: blog | Tags: bash , code , one-liner , remember , tips | 25 Comments » I work with a lot of data, and while I’d like to pretend it’s all in upside-down quasi-indexed b-tree rocket ships or some other advanced database, the truth is that much of it is in text files. I often find myself wanting to see a random line from one of these files, just to get a sense of what the data looks like. I thought there must be an easy bash way to do this, but I couldn’t find it (‘shuf’ isn’t installed on my server), so I turned to twitter, and now I’m pleased to present more methods for finding a random line than you ever expected! sort -R | head -n 1 If you can use this, do so! If it isn’t available, consider one of the following commands: @andrewgilmartin suggests using awk: awk 'BEGIN { srand() } rand() >= 0.5 { print; exit }' @devinteske offer
4 0.32496527 39 hilary mason data-2010-01-03-SMS to e-mail gateway: The SMS doorbell
Introduction: SMS to e-mail gateway: The SMS doorbell Posted: January 3, 2010 | Author: hilary | Filed under: blog , projects | Tags: code , nycresistor , python , textmarks | 5 Comments » Over at NYC Resistor , it was getting cold, and we needed a doorbell so visitors wouldn’t be stranded outside when the building was locked. A standard wireless model didn’t work reliably (the space is on the fifth floor, just out of range), so various members generally resorted to writing their phone numbers on a sign on the front door when they were expecting guests. Since almost everyone has a mobile phone already, and SMS-based solution seemed appropriate. In order to implement this we need two things: An SMS shortcode A system to notify when the shortcode is triggered It’s irritating and expensive to acquire your own shortcode, but there are several services that will allow you to use one in exchange for a small fee or advertisements in your messages. TextMarks is my
5 0.3150827 1 hilary mason data-2006-02-20-JavaScript Rotating Images Tutorial
Introduction: JavaScript Rotating Images Tutorial Posted: February 20, 2006 | Author: hilary | Filed under: articles , blog | Tags: javascript , web dev | 1 Comment » Introduction Swapping new images into an established layout is one trick that can keep a site design fresh. Some examples: gettyimages benstraw There are several different techniques for accomplishing this effect. A server-side program is the best approach, because you can automatically pull files from a whole directory (eliminating the need to modify code), and it will work even if a user has JavaScript disabled. Unfortunately, not everyone has access to a host that supports server-side scripting. That’s okay, because the same thing can be accomplished with client-side code in JavaScript. I’ll show you how, with three JavaScript functions of varying levels of ease and functionality. First, gather two or more images that are the same size. Then read on… Setup Click here to see t
6 0.26105076 83 hilary mason data-2013-01-10-Book Book — Goose!
7 0.23048709 110 hilary mason data-2013-10-06-What Mugshots Mean For Public Data
8 0.20949663 31 hilary mason data-2009-08-12-My NYC Python Meetup Presentation: Practical Data Analysis in Python
9 0.20939381 86 hilary mason data-2013-01-22-Introbot: A Script to Ease the Process of Writing Introductory E-mails
10 0.17495711 50 hilary mason data-2011-02-07-NPR: Interview on Science Friday
11 0.11875299 7 hilary mason data-2007-07-30-Tip: How to Search Google for Ideas
12 0.11841536 21 hilary mason data-2008-09-26-What am I like? How about you?
13 0.10805112 66 hilary mason data-2011-10-21-Web 2.0 Summit: The Secrets of our Data Subconscious
14 0.10694637 53 hilary mason data-2011-03-11-Conference: PyCon 2011 Keynote!
15 0.10655369 10 hilary mason data-2007-09-02-Autoscript Creates LSL Scripts Without Code
16 0.1058236 12 hilary mason data-2007-10-24-Teen Second Life College Fair
17 0.094982527 4 hilary mason data-2007-06-11-Teaching Search Techniques with Google Games
18 0.093483567 85 hilary mason data-2013-01-19-Startups: How to Share Data with Academics
19 0.083074436 27 hilary mason data-2009-04-02-From the ACM: Learning More About Active Learning
20 0.082616642 54 hilary mason data-2011-03-18-Be Ballsy.
topicId topicWeight
[(2, 0.032), (13, 0.026), (20, 0.034), (54, 0.02), (56, 0.609), (57, 0.042), (58, 0.027), (59, 0.032), (60, 0.029)]
simIndex simValue blogId blogTitle
1 0.99131012 7 hilary mason data-2007-07-30-Tip: How to Search Google for Ideas
Introduction: Tip: How to Search Google for Ideas Posted: July 30, 2007 | Author: hilary | Filed under: blog | Tags: search | 1 Comment » Will someone please invent a way to search for ideas? Short on inspiration? Harvest ideas from the web by searching Google for “someone please invent” and see what people are wishing for. Using quotes around “someone please invent” insures that Google searches for that exact phrase only. You can further refine the query by adding related terms at the end of the query. For example, try searching for “someone please invent” game* to see game-related results.
2 0.98713118 58 hilary mason data-2011-06-22-My Head is Open Source!
Introduction: My Head is Open Source! Posted: June 22, 2011 | Author: Hilary Mason | Filed under: blog | Tags: 3d , makerbot , opensource | 8 Comments » Last night I visited friends at Makerbot , where artist-in-residence Jonathan Monaghan scanned my head with a high-resolution laser scanner. The model is available on Thingiverse and can be printed on your friendly neighborhood makerbot or other 3d printer. There are lots of other awesome models of people and things to play with, including Stephen Colbert’s head . I look forward to the emergence of plastic clone head armies! Edit: Please note: thanks for asking, but brains are not included.
same-blog 3 0.9828434 109 hilary mason data-2013-09-30-Need actual random numbers? Meet the NIST randomness beacon.
Introduction: Need actual random numbers? Meet the NIST randomness beacon. Posted: September 30, 2013 | Author: Hilary Mason | Filed under: projects | Tags: beacon , python , random , randomness , randomnumbers | 5 Comments » I wrote a python module that wraps that NIST Randomness Beacon , making it simple to get truly random numbers in python. It’s easy to use: b = Beacon() print b.last_record() print b.previous_record() #and so on There’s also a handy generator for getting a set of n random numbers. (One of the best gifts I ever got was a copy of 1,000,000 Random Numbers , and I’ve been intrigued ever since.) Please note that this the randomness beacon is not intended to be a source of cryptographic keys — indeed, it’s a public set of numbers, so I wouldn’t recommend doing anything that could be compromised by someone else having the access to the exact same set of numbers . Rather, this is interesting precisely for the scientific opportunities that
4 0.97676545 87 hilary mason data-2013-01-28-Startups: Why to Share Data with Academics
Introduction: Startups: Why to Share Data with Academics Posted: January 28, 2013 | Author: Hilary Mason | Filed under: blog | 5 Comments » Last week I wrote a bit about how to share data with academics . This is the complimentary piece, on why you should invest the time and energy in sharing your data with the academic community. As I was talking to people about this topic it became clear that there are really two different questions people ask. First, why do this at all? And second, what do I tell my boss? Let’s start with the second one. This is what you should tell your boss: Academic research based on our work is a great press opportunity and demonstrates that credible people outside of our company find our work interesting. Having researchers work on our data is an easy way to access highly educated brainpower, for free, that in no way competes with us. Who knows what interesting stuff they’ll come up with? Personal relationships with university faculty ar
5 0.94624305 114 hilary mason data-2013-12-18-Using Twitter’s Lead-Gen Card to Recruit Beta Testers
Introduction: Using Twitter’s Lead-Gen Card to Recruit Beta Testers Posted: December 18, 2013 | Author: Hilary Mason | Filed under: blog | Tags: email , hack , twitter | 12 Comments » It turns out that it’s pretty easy to co-opt Twitter’s Lead Generation card for anything where you want to gather a bunch of e-mail addresses from your Twitter community. I was looking for people willing to alpha test a little side project of mine, and it worked great and didn’t cost anything. The tweet itself: Love tech discussion but looking for a better community? Help me beta test a side project! https://t.co/H3DYjbCy19 — Hilary Mason (@hmason) December 12, 2013 I created it pretty easily: First, go to ads.twitter.com , log in, and go to “creatives”, then “cards”. Click “Create Lead Generation Card”. It’s a big blue button. You can include a title and a short description. Curiously, you can also include a 600px by 150px image. This seems like an opportunity to
6 0.70384377 40 hilary mason data-2010-02-16-Conference: Search and Social Media 2010
7 0.65186131 85 hilary mason data-2013-01-19-Startups: How to Share Data with Academics
8 0.59790361 46 hilary mason data-2010-08-15-Should you attend Hadoop World? Yes.
9 0.59390801 3 hilary mason data-2007-06-08-The Best Time to Search for Academic Jobs
10 0.57668895 92 hilary mason data-2013-02-25-A (short) List of Data Science Blogs
11 0.57642907 66 hilary mason data-2011-10-21-Web 2.0 Summit: The Secrets of our Data Subconscious
12 0.57485384 80 hilary mason data-2012-12-28-Getting Started with Data Science
13 0.5336318 106 hilary mason data-2013-08-12-DataGotham 2013 is coming!
14 0.52628052 116 hilary mason data-2014-04-09-Come speak at DataGotham 2014!
15 0.52580237 81 hilary mason data-2013-01-03-Interview Questions for Data Scientists
16 0.51992303 82 hilary mason data-2013-01-08-Bitly Social Data APIs
17 0.51639122 110 hilary mason data-2013-10-06-What Mugshots Mean For Public Data
18 0.51560593 4 hilary mason data-2007-06-11-Teaching Search Techniques with Google Games
19 0.51506668 86 hilary mason data-2013-01-22-Introbot: A Script to Ease the Process of Writing Introductory E-mails
20 0.51482862 33 hilary mason data-2009-10-03-Hadoop World NYC