Trackpad issues again, eh? Well, hopefully this one can be fixed in software. My new laptop arrives tomorrow!
Over the summer, my Fitbit tracker (from before they split into multiple products) gave up the ghost. I decided it was time to explore the movement tracking space. First I participated in Phyode‘s W/Me Kickstarter, but that’s a topic for another post. More recently, I bought a Misfit Shine, followed by a Withings Pulse. This post will focus on comparing sleep analysis, the weakest point of activity trackers.
Tracking sleep via movements
There is sufficient correlation between movement and sleep quality that all the activity trackers attempt to tell you something about your sleep. You can’t hope for medically informative data from them, but you can probably compare your nights to each other and find correlations with caffeine use or exercise. Activity trackers expect you to notify them when you go to bed and when you get up, and then they analyze the time between a little differently than they do your waking time. As in the daytime, they don’t ask you where you are wearing the device, so analyses can be different based on where you put them. If they suggest anything, companies suggest you wear the tracker on your off-wrist during sleep.
In my case, I get a little annoyed with the results because most people move substantially in their sleep, on occasion. I have to wake up to make substantial movements. I can’t roll over in my sleep; I can’t even shift an arm or leg several inches without waking. I usually have discomfort dreams that inform me I need to wake up and move. But since that’s abnormal, the analyses I get don’t reflect my personal sleep movement patterns as well as they should. In my case, the activity trackers are overly willing to report me as having been asleep. Still, if I stare at the entire movement pattern for a sleep period I can infer things myself, and I find that useful.
Where and how I’m wearing them
During the day, I wear my Misfit Shine on a homemade choker. This is looser and therefore less accurate than the choker they sell, but it’s comfortable, secure, cute, and does well enough for my purposes. At night, I wear it on the watchband on my left wrist (I’m right-handed).
During the day, I wear my Withings Pulse on the clip on the front-right of my belt area. The clip itself feels very secure, but already the enclosing area is starting to feel less secure, so I’m a bit worried about that. Still, I’ve used many similar items on other electronics in the past, and they usually warp just a tiny amount and then stop. At night I wear it in the velcro wristband on my left forearm, above the Shine.
I imagine they get reasonably similar data in these positions.
Comfort and transitioning to and from night use
Transitioning the Shine between the choker and the watchband is easy: pop it out of one ring and into the other. Usually if anything is time-consuming or awkward it’s clasping the homemade necklace. I make the watchband a little more difficult by wearing it inside out, so that the knob doesn’t face my wrist while I sleep. I’m not sure why I do this; it isn’t a particularly poky knob. I think I just dislike wearing things on my wrist while I sleep and seek any potential comfort boost. Anyway, the watchband is quite comfortable in that it conforms to wrist shape, is flexible, has no stabby or lumpy bits, and secures down to my tiny wrist size without strangling.
Transitioning the Pulse between the clip and wristband is also very quick, but since the wristband is stretchy, wide, and velcro, it can take some effort to pull it taut without cutting off blood flow and without leaving velcro exposed to snag on your soft sheets and clothes. In case you can’t tell, I’m not a fan of velcro wristbands, especially for sleeping. I strongly disliked it with my Fitbit too. I’ve caught it on things a couple times (in just a week and a half!), and it even pulled off my wrist one night, screwing up half the night’s data.
Recording sleep time
Before I go to sleep, I have to click the button on the Pulse 5 times, tap the moon icon, and slide my finger in the direction indicated. This is tedious when I’m tired, but easy enough to accomplish. On the Shine, I have to tap it solidly three times. This sounds easy, but now that I have two items on my wrist the Shine gets pushed onto the bendy area, so doesn’t always have a solid item behind it ensure it receives the three taps. That can be annoying.
When I wake up, same deal with the Shine. On the Pulse, I press the button and it requests that I confirm I am getting up by sliding my finger again.
Issues with recording sleep time
The primary issue here is that I have to let it know when I am going to bed and when I am getting up. In both cases, I’m usually sleepy or have other things on my mind, so I don’t always remember. Neither of these services currently allow you to go back and say “Oh yeah! I swear I slept last night…maybe around this time to that time. Please update your analyses accordingly.” I hope both will allow it eventually. These are new products, so I don’t expect them to release with all the features I might like to see.
Now, if I do remember, I remember to do it for both devices. Yet I have no data for the Shine on one night. Did it get accidentally triple-tapped shortly before or after I went to bed and triple-tapped intentionally, thus negating the tag? Did I sleepily see some lights go off and assume it caught the triple-tap when in fact it only caught a double-tap? Or did I forget to inform either device and the Pulse inferred that I was asleep between two times? I can eliminate the last possibility because Pulse reported the amount of time “in bed” and “asleep” as different. But I still don’t know what exactly happened!
Then when I started comparing the results from each devices I realized there was often way more than a minute’s difference between the times each device recorded me as asleep. I got the impression that the Shine was, shall we say, adjusting the values I gave it. Last night I manually recorded my sleep and wake times. The Pulse reflected approximately the same times, while the Shine said I went to bed 20 minutes later. It’s true that I got up again right after I went to bed, but it makes me wonder why I bother telling it that I was in bed!
With only a week and a half of data, I’ve determined that these services have very different algorithms for determining how long I was asleep and how much of that sleep was deep/restful. The standard deviations in differences between all comparable metrics on the two devices range between a 34 and 64 minutes, which is just huge.
Despite that activity tracking is a weak reflection of sleep quantity and quality, I already favor the Shine’s “deep sleep” algorithm. It seems to have some correlation with how rested I feel the next day. The Pulse’s sleep analyses seem to have almost no correlation with my state of mind the next day.
Interestingly, the only times Shine thinks I got more deep sleep than Pulse thinks I got, the Shine is mistakenly under the impression I was asleep much longer than I was. I looked at these data and it appears Pulse is better at trimming off awake times from the beginning and end of the period I tell it I’m asleep. So if I think I’m going to bed and then get distracted, or if I forget for an hour to tell it I’m up and just poking at my laptop/tablet/phone, Pulse is more likely to figure this out. Except that last night the Shine trimmed 20 minutes off the beginning of the time I was “in bed” because I was too active. So there’s something trickier going on here that will require more data to figure out.
Tracking sleep via movements: easy-to-get wishlist
One really simple item I miss from Fitbit’s otherwise useless sleep analysis: number of times I woke during the night. This one was handy: for example, it correlated with my caffeine intake the previous day.
Also, I haven’t seen anyone doing this, but I really want to see the longest stretch of time in “deep sleep”, or whatever they decide to call the most restful sleep. Just from eyeballing my raw sleep data, I’ve determined this is a factor in how energetic I feel the next day. I can’t imagine it’s meaningless for other people!
On 10-11 October I attended Quantified Self 2013 in San Francisco. This post is long, so I’ve broken it into sections:
- Themes: recurring ideas at the conference
- Fun quotes and one-line takeaways: to give conceptual flavor
- Want!: devices and services I want to try
- Shine: my Misfit Shine got some attention
- Notes from my Office Hour: my allocated time to talk about my startup
- General impressions: to give a feel for the attendees and environment, and how things differed from last year
The Quantified Self conference is an incredible experience. It is a self-organized conference attended by people who are personally invested in the topics and are genuinely optimistic and enthusiastic about sharing ideas, providing services, getting feedback, helping out. It is very much a community event with 500 people from around the globe.
Tread softly on people’s lives and flows. Passive tracking with minimal impact is ideal.
Large groups’ needs are not being met with current tracker technology. Why don’t we have uterine sensors and hormone sensors? Where are all the child-adapted trackers? Why aren’t there more trackers for underwater activities?
Breathing sensors are up-and-coming, but with different goals. Some want to find out more about what’s going in and out of your body. Some specifically want to look for toxins, in the air and in your breath. Most want to manage your stress levels. But I ask, where are the breathing trackers aimed at asthma management and improvement?
Fun quotes and one-line takeaways
“Analyzing data is right up there with having sex and playing guitars.”
“They were taken over by the corporate wellness monster, in a way, and I say that in the most friendly tone…”
I have yet to hear someone use the phrase “Internet of Things” productively.
“Single subject design has a place in science and evidence-based medicine.”
“So when I say [to my young children] that the ice cream you eat right now will affect your sleep, they’re generally very accepting of it…and eat the ice cream anyway.”
“Collective intelligence is stupid for individuals.”
There were several toys—er, devices—that I want.
In one case, I couldn’t resist purchasing. Withings gave a 15% conference discount on the Pulse, which is already the cheapest device with heart rate measurement capability. On the downside, it requires active measurement. On the flashy side, I was rather smitten with the LED touchscreen display. We’ll see how it performs, especially in comparison with my Shine and retroactive comparison with my now-dead Fitbit.
I’m still watching the data aggregation services in the hope that one will appear that I like and that works with my devices. So far no demos have impressed me.
I always want to try all the activity trackers on the market. Everyone I talked to with a Jawbone Up was pretty satisfied with their experience so far. I’d love to try it because multiple ex-coworkers worked on the analytics. Very few people have the Basis (probably due to price), but they seem fairly satisfied as well. I’d love to try it because I’d love to have passive heart rate monitoring when I go running, as an indirect window into my asthmatic status. However, running isn’t my primary activity. I have two main activities: climbing and partner dancing. In neither case do I want a snaggable object on my wrist. Sadly, many activity trackers come only in bracelet/watch form factor.
Quick list of shiny things:
- Passive caloric intake and nutrition monitor: http://getairo.com/
- Genetically guided personal fitness: http://www.genetrainer.com/
- Healthy eating assistant, which I’ll be happy to try when available for Android: http://www.zipongo.com/
- Adjustable standing/sitting, treadmill desks: http://www.ergodepot.com
- Sleep tracking via the bed, not you: http://www.beddit.com/
- General health monitoring device and service: http://www.vitalconnect.com/
I think Misfit Wearables should reimburse me for all the advertising. It’s possible I talked about my Shine more than I talked about my startup! I gave people tours of the app, talked about strengths and weaknesses and how easily addressed some of the weaknesses are (after all, it’s a young product). For the record, I’m quite optimistic about the Shine.
Several ladies were intrigued by the idea of slinging the magnetic loop onto a homemade chocker rather than paying $80 for the one Misfit makes. The downside of the homemade one? It’s looser, so your Shine is more likely to sway a bit, especially if you’re bouncing.
Notes from my Office Hour
For Office Hours, several organizations or individuals sit at tables and converse free-form with interested attendees.
It was too windy to bother putting up my poster. It was too sunny to use the electronic signup I created rather than a nice white sheet of paper. I felt like all that preparation could have been directed at working on my product instead. But in reality, it’s good to have focused on marketing for a little while. The results will come in handy. And, my business cards were of great use!
However, my business cards were of greater use outside of my Office Hour. I was scheduled for the worst hour possible; there weren’t very many people circulating the courtyard. I myself had marked off several conflicting interesting events during that time slot that I wouldn’t be able to attend. Still, I had some lovely conversations then and elsewhen!
I forgot it feels about 10ºF cooler in the Presidio than in the South Bay. I should have brought another clothing layer.
The average age was higher and average fitness lower than last year. This is probably because the conference was Thu/Fri this year and Sat/Sun last year, making it easier last year for students and casual enthusiasts to attend. That said, the average fitness level was still definitely higher than the average population.
Further evidence that attendees were more business-oriented and less student-oriented: more people were dressed less casually, and there were fewer people with unnaturally-dyed hair or uncommon piercings.
Gender, however, was better balanced than any tech conference I’ve attended.
It was so cold in the building that even though I had planned to attend some indoor discussions during some sessions, I opted to stay out in the sun for Office Hours most of the time. The fireplace at the back of the main hall was always well-attended, despite that you couldn’t hear or see that well back there.
There were rugs on the lawn in the courtyard for lounging. Perfect!
There were several Google Glasses running around. It definitely makes you hesitate more to join a group, and even moreso to speak.
I was surprised how many people remembered me from last year, given that I’ve failed to attend local community events.
The food at QS conferences is phenomenal. If I ever need an event catered, I’m going to ask them who they get to do it. Delicious, and very thoughtfully healthy.
I’m shy, so I’m often very quiet and passive when I enter a new conversation. A near-stranger introduced me to a group as a person who asks insightful questions, though, and I immediately felt a pressure to live up to that surprising and complimentary introduction.
Playing the non-introvert at the conference and socializing with SF friends in the evenings really wiped me out. I hid under a rock all weekend.
Apparently over 60% of failed businesses are profitable. They fail because people don’t keep enough cash on hand to deal with:
- the delay from accounts payable to accounts receivable
- emergency/unexpected expenses
- expected expenses that increase due to unexpectedly high demand
I found this shocking at first, but then I remembered that most people don’t keep a reasonable cash cushion in their personal lives to deal with the analogous situations. This makes me sad! Low probability events are not likely to happen individually, but it’s likely that a low probability event will happen to you at some point!
Whether it’s in your personal life or your business life, I urge you to take a look at your cash reserves and consider revising them.
A collection of information visualizations that make no sense: http://wtfviz.net/
For the curious, here’s a glimpse of the types of things I work on daily as a tech-oriented startup founder:
- requesting information/providing feedback/doing QA/writing documentation for 1-3 consultants, or my business partner
- poking at 1-2 HR or legal tasks (not my favorite things, so if I didn’t poke at them nigh-daily they’d never get done)
- 2-5 most important UI tasks
- 1-4 most important backend/infrastructure tasks
- poking at 1-3 marketing/branding tasks
- the IP technology (if there’s time…this is the least interruptible work)
- updating and reprioritizing tasks
- wondering how many millions of things I’m forgetting
- making and drinking lots of tea
Other hats are generally less frequent, such as Executive and Accountant. I do not consistently wear all these hats daily; some days I set out to focus on 2 of them and only one other interrupts. Those days are very satisfying! Until I realize I’ve fallen behind with something.