Over the past few months we’ve ramped up our usability testing efforts, including testing our mobile apps. In order to test on mobile devices it’s generally assumed that tests will be with local users, or semi-local users, since the options for live remote mobile testing are limited.
After driving to Columbia, SC to do a couple of tests in the field (and a particularly long night of dreaming in iPhone screens) I woke up the next morning with a mission: figure out how to do remote mobile testing.
I googled extensively for anything that might possibly allow screen sharing for mobile devices, but there just wasn’t anything out there that met our immediate needs. There are apps for capturing work flows, there are ways to embed survey questions into beta versions of your app, but nothing we could find that allows screen sharing on mobile devices.
Then it hit me. Why not just have people hold the device up to their webcam while video chatting on Skype? I grabbed Jason from our UX team and we connected over Skype. We tried to find the best angle to twist your torso to view and share the device’s screen at the same time when we realized…just turn the laptop around and give it a good hug. Resting your elbows on the desk around the laptop naturally moved the iPhone right into the view of the webcam.
jason hugging his macbook
You can connect over Skype and view a mobile device this way with any laptop with a webcam, a webcam with a stand or tripod, or with the camera app on an iPad 2 and a good dock. BTW, the picture quality in this batch of testing was best when connecting with the iPad 2.
connecting via iPad2
The trick we found for properly viewing the iPhone screen is to take the brightness on the phone way down, so there’s less light being projected into the webcam. (There *are* words on the screen on the left, we just can’t see them.)
With this set up instead of one or two in-person mobile tests, we connected with 7 people in just two days. We didn’t have to deviate from our normal usability test recordings in Silverback or change the way we share the videos with our team.
Two days after testing the mobile team (plus me and Ben) were able to sit down, watch the videos together on a big monitor, determine the pressing issues, and catch crashes and bugs before you see them. And eat some tacos. Those we can’t share remotely.
Are these web sites? If not, how do you distribute the app to users?
Cool idea, btw.
Chris
Hey Chris,
We do testing on our regular site on mobile, existing apps, and upcoming releases, so sometimes what needs to be tested already exists.
If we’re testing something that’s not out yet, we use TestFlight App for pushing a beta release of our iPhone apps.
Any future Android tests would have to be done in person (as far as we know) since there doesn’t seem to be a way to push code to a device remotely.
Thanks!
-Jenn
Thank you for the documentation of this really good work-around!
Great article–thanks so much! Do you know if this will work with WebEx? Also, have you tried this method with iPad? I’d imagine the tilting of the tablet would be a less natural position for the user than how the phone is held.
Some serious ingenuity going on here… Nice work.
An alternative would be to send Mr. Tappy kits with webcams, this way you’d be able to observe natural use, rather than hugging the laptop etc.
The participant would simply nominate the webcam on the Mr. Tappy kit as their sky camera and share away. A big advantage here is that it will work with absolutely any device too!
Nick
What an awesome idea! Hugs for interfaces!
Hey Jenn,
Loved your blog post – what a great idea!
In addition to what you’ve mentioned, I also want to share a cool app we use for mobile and tablet which is called “Reflections”.
Reflections let’s the participant mirror the mobile screen directly onto your laptop in which you are recording in Silverback.
It’s about $16 for a single user or roughly $50 for multiple users (which is a not too bad)
The participant needs to be somewhat near by taking the test as you observe so it’s not set up for long distance remote, but is a great alternative to being able to see the screen and actions clearly.
Mahalo,
Sarah Figueroa-Berchild
Mobile usability testing sure is a challenge, often the difficulty is testing in context and being able to still use the device in a natural way without any restrictions due to camera mounts etc.
I’ve recently blogged about some of the approaches mentioned http://www.griffininteractive.net/2012/12/mobile_usability_testing.html
Hey Jenn!
Your posts on mobile usability testing have been extremely helpful!! I just discovered a pretty solid mobile usability testing combo, using SolidifyApp and UXRecorder in combination! I’m pretty pumped about the solution! I blogged about it at http://userexperiencerocks.wordpress.com/2013/05/09/mobile-usability-testing-magic/
Thanks again for sharing all of your awesome research on the topic!