Infomaki facts and figures
Written on March 5, 2009 by Michael Lascarides
Our home-grown usability survey launched a couple of weeks ago and it’s spent most of the intervening time quietly gathering a ton of feedback from our users. Since there’s been a lot of interest around the app, I’d like to share some of the findings so far. First, some top-line stats:
Usability questions posted: 78
Total unique repsondents: 2,410
Total questions answered: 26,067
Average questions answered per person: 10.8
Average responses per question: 334
Average responses per day: 1,184
Obscenities submitted: 2 (Incredibly, the two nasty words showed up within the first 10 minutes of launch–thank you, New York! Even more incredibly, we haven’t had another since.)
The response has been terrific, with roughly a 2% click-through rate from the main site, and 80% of those visitors answering at least one question. In fact, feedback has been so plentiful that we have twice pulled the report because we had enough responses and needed to write new questions.
We’ve added a number of generic demographic questions to the mix (how old are you, where do you live, etc.) and the hope is that in future versions, we will be able to segment responses to one question based on the answers to another question. For example, we can test familiarity with certain terms in one question and segment out those responses by age (for any respondents who answered both questions).
Behind the scenes, there are definitely some improvements that need to be made. It’s becoming clear that a frequent pattern of use is to test the same question (”Where would you click to…?”) over screen-shots of several variant designs. Right now, one must enter the same question repeatedly to get these comparisons. Then once the screenshots are uploaded, it would be helpful to view the results for all variant designs for one question on a single page.

One improvement that has been made is a statistical grid overlay that includes absolute click-counts and percentage of total clicks on each segment of a 40×40 pixel grid. This became a necessity for legibility once the number of responses grew into the hundreds, and the clouds of individual click-marks condensed into unintelligible blurs. (We also added a button to hide all click marks and stats grids to just see what’s underneath!)
So enough about the app itself–what have we learned? Well, one big lesson is that our global navigation designs with fewer choices vastly outperform those with more. Our first draft of the new global navigation had eight elements, but user testing quickly found some gaps and ambiguities. For example, we tend to think of the NYPL Digital Gallery as a kind of special project, so we were testing navigation items named “NYPL Projects”, “Online Resources” or “Online Collections” as a destination page for DG and similar initiatives. But testing showed that users don’t think it’s that special; they think it’s just another way to find things. When presented with one of those choices, a significant number of users still clicked “Books and Materials” as the place to find the image collections. Removing the “special projects” link (whatever its name) led to a user consensus on “Books and Materials” as the go-to destination.
We’ve also been able to ask “little questions”, something that’s not practical in a more formal survey. For example, we’re playing with the idea of a “Community” section as a destination for social networking initiatives (blogs, our iTunes page, our Facebook group, user-generated content and more), but we’re struggling with what to name it. We liked “Community” as a label, but tests showed no one was clicking on it so we quickly added a handful of follow-up questions to get to the bottom of what “community” means to our users, like whether people use the word “neighborhood” or “community” to talk about where they live (it’s 9-to-1 in favor of “neighborhood” in New York, by the way). The question “What would you MOST expect to see on a page labelled ‘Community’?”, coupled with a few set choices followed by an open text field, garnered the most free-form responses of any question so far. We haven’t cracked the Community code yet, but we’re getting closer. The ability to quickly get follow-up questions (even seemingly trivial ones) in front of users is proving to be incredibly insightful.
Filed in: Usability, User testing, infomaki.
This is good stuff. Once you’ve gone a few more rounds with it, I’d encourage you to submit an article proposal to the Code4Lib Journal on it. I’d be happy to see an article on your testing technology, but also heavy on how you are using it — how you fit it into your design process, how you come up with questions, how you use the results, what you’ve learned from it.
Thanks, Jonathan! It’s a crazy busy week here, but I’m hoping to have a draft to you by your March 20 deadline.
Hi Michael,
I’m a doctoral candidate whose dissertation is about social media, museums, and the concept of community. The last bit of your post here was very interesting to me since it gets at how people conceptualize this word. Your last post about Infomaki mentioned you were willing to share data with grad students. Might it be possible for me to get a view of the data related to your community questions?
Thanks,
Amelia
this is really cool!! – is any of the code open source :D
@Susan: A full open-source release is planned within the next few weeks. Look for an upcoming announcement on this blog!
This looks very cool. I’m looking forward to the code release!
That is an awfully astounding column you’ve posted.Thanks a lot for that a fantastically amazing post!
wholesale new era hats
Hi,
Is NYPL continuing with Infomaki? I’ve just come across it and it looks really useful – but the code etc is from 2009 – which made me wonder if the project had been suspended?
Cheers,
Merrin
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] There you will find 68225 more Infos: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] There you will find 68608 more Infos: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
Las Mavericks over the summer, appear in a instructing personnel income, prior front desk staff Terry – Stokes when the founders within the levels about variety, in addition to consequently stand above the various prospects in becoming next Portlandcoach.
Terry And Stokes positioned, which means all the Mavericks require as soon as possible to discover a ideal secretary person, for making ” up ” for the emptiness following he / she left. Were gossips that this Mavericks contain longchamp bags neared ex- Pacers advisor : Micheal O’Brien, want to permit him to subscribe to the group to be a box foreseeable future admin news reports.
In keeping with ESPN the actual popular columnist Mark And Stein discovered upon Forums recently, O’Brien seems to have officially gotten to in addition to calf muscles agreement, he’s going to become the major secretary in the banc.
About Twittollower, Stein said the fact: and also calves “- Sean O’Brien comes with achieved a contract, definitely become the primary admin longchamp bags sale of the alc ? longchamp bag ve, your partner’s associate coach Sean — Carlisle
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
Favorite link…
[...] ordinarily posts some fascinating stuff like this. If you are new to this blog [...]…
… [Trackback] …
[...] Find More Informations here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Informations on that Topic: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] There you will find 60441 more Infos: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] There you will find 97972 more Infos: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
Websites to visit…
[...] needs pretty long time for achieving good results. One must have real fortitude [...]…
The diet solution Review…
Infomaki facts and figures | NYPL Labs…
… [Trackback] …
[...] Read More here: labs.nypl.org/2009/03/05/infomaki-facts-and-figures/ [...] …
http://www.lcpliage.com/ Longchamp Pliage
Cheap Steelers Jerseys…
Infomaki facts and figures | NYPL Labs…
Websites to visit…
[...] involves fairly long time for getting great results. One must have real dedication [...]…
Trackback…
[...] ordinarily posts one or two quite interesting stuff of this nature. When you are new to this site [...]…
Read was interesting, stay in touch……
[...] we wish to pay tribute to a number of internet sites on the net, regardless of whether they aren’t linked to us, by linking to them. Under are a few webpages really worth checking out [...]…
趨㽿…
Infomaki facts and figures | NYPL Labs…
Sources……
[...] that’s the end of this article. Here you’ll see several sites that we presume you’ll appreciate, simply click the links over [...]…
Trackback…
[...] always a huge fanatic of backlinking to blog writers that I appreciate but are rarely getting lots of link love from [...]…
Awesome website…
[...] normally posts certain quite interesting stuff of this nature. When you are new to this page [...]…
This way, the particular Louis Vuitton buckskin items started out generations coming from technology to be able to technology descendant constantly abide by the particular search for top quality, superiority frame of mind. Nowadays, from your buckskin goods (including bags, suitcases, briefcases, and so forth. ) lengthy to be able to trend clothing, footwear, timepieces, fine jewelry, creating products and also accessories, Louis Vuitton continuing to boost regarding the modern significance, nonetheless it provides explain to you the particular.
At payday gwrtdrfs Loans you buoy inspire a speedy, payday loans UK >:]] easy small signal payday loan of up to 1500. Thither’s no daily endeavor and no sound songs. The apply is totally on-line and buoy be realized in 60 bat of an eye. A payday Loanword is a colossal method payday loan >:]] to screen small expression notes surge issuances, portion you refrain from costly belief carte or swear burden. You buoy pament unforeseen nibs or level conscientious delicacy yourself or soul added. pay day loans >:-[ Assume’t away whatever also clock distressing almost those sudden chicamin difficulties and create now your payday with payday Loans. Penetrate Hither to boast away how even your payday Accommodation inclination charge. Handle Instantly and get the chips cashed to your bill in 15 minutes.
Favorite webpage…
[...] In addition to a massive butterfly structure, with ribbons near the charming photograph of the relaxing born [...]…
Great website…
[...] we ran into a very good site that you might love. Look it over if you’d like [...]…
url…
Infomaki facts and figures | NYPL Labs…
Great sites…
[...] Let me reveal a few similar facts [...]…
kdjbix personal loans 1877 cash advance online 9739 same day loan 0479
Favorite link…
[...] plenty of time to study or visit the particular content material or sites we now have linked to below the [...]…
Recommended websites…
[...] I noticed someone having a debate about this on Tumblr and so it tied up to [...]…
Recent Blogroll Additions……
[...] we like to honor a number of sites on the net, even if they are not linked to us, simply by linking to them. Below are some sites really worth looking over [...]…
Websites to check…
[...] Internet sites of interest we have a link to [...]…
ablfpj where to buy viagra 6553 buy cialis 9582
Nice Focus……
[...] listed here you’ll find the link to a few sites that many of us presume you need to have a look at [...]…
Superb website…
[...] Are you without any doubt certain that is definitely the right facts? I observed something else. I’ve basically had another concept that pop into my mind [...]…