Academia Research  UX Research  Design Implication  

Understand the users' multitasking habit with notification

Duration
Category
My Role
Responsibility

July 2021 - July 2022

UX Research

UX Researcher

Interview / Diary study / Analysis

Objective
Outcome
Past research suggested that blocking notification can protect people's attention. However, research in 2022 show that muting notification increase some people's self-interruption action to check their notification. In our research, we reveal people's multitasking behavior patten and the reason lying behind, and having some design implication on intelligent notification system.
- We conducted 7 days diary studies and in-depth interviews with 30 participants to understand their using pattern and the reason lying behind.
- Our study provides important practical implications:  we decode the context factors making people suspense while they are in a primary work, and we suggest notifications could be classified based on content genres as well as individual differences of users, and each usage can be combined with three timing for opportune moments.
Deliverables
Challenge
- During the COVID-19 pandemic, it's a fully remote research, it's hard to build connection with participants(compare to face-to-face).
- It's a pity that some of our participants caught the COVID-19 and they stopped the experiments.
- User Research:
I responsible for designing the experiment, recruiting participants, interviews, and analyze the qualitative data, and writing the insights.
Backgrounds

Past research seen notifications as a disturbance, intrusion, or interruptions, and there were addiction debates on the situation of notification overloading and technology overuse.Some of research arguing the notifications should delay to an opportune moments. However, while the focus mode, which means to delay notifications, in mobile system do exists for years, it can’t stop people from self-interrupting themselves to check certain notifications. It means that there exists some intents make people want to interact with notifications in a primary task, and we suggest the definition of “what is opportune moment” should also consider the intents that makes people multitask.

In our research, we dig into the qualitative meanings that people interacts with notifications in different time, and their sense-making decision. We conducted 7-days diary studies and in-depth interviews for 30 participants, trying to investigate about the reason why they want to multitask to read notifications while they are in a primary task, and what they are trying to achieve.

In fact, as the genres of notifications has growth, the function of notifications has changed, too. People are not just seen notifications as disturbance, but about seeking stimulation, be productive, and many usages lying behind.

And we discovered that besides multitasking to interact with notifications, the behavior to interact with notifications before entering a task is also another noticeable pattern. And we also dig into the underlying reasons.

Research Process
01
Understand the past design suggestion
02
Understand users' pattern
03
Discussion
04
Generate design suggestion

Understand the past literature insights about the design of notification system.

- Literature review
- Review the notification design guideline currently use.

Based on the past literature insights and conducted diary and user interviews to understand users' behavior with notifications.

- Diary
- Post-interview

Analysis the qualitative result and find out WHY people multitask and WHAT they want to achieve.

- Grounded theory

Develop possible design suggestion and guideline.

01
Initial Survey
02
Pre-diary interview
03
Diary Study
04
Post-diary Interview
05
Analysis

Participants began with a survey covering:
1. general demographics, 2. the level of their technique proficiency, 3. the level of business
4. the level of polychronicity
5. the level of their self-awareness of multitasking
6. the type of devices they owned.

Participants were asked to prompt contextual explanations about :
their general lifestyle, and habits, including notification management and retrieval strategies.

Starting the day after the first interview, participants were then asked to diarise for a week their activities and the activities related to notifications and multitasking behavior.

The purpose of this interview was to walk the researcher through each diary entry, in order to provide more details and more contextual explanations, building on the in-depth data collection.

We analysis:
interview transcripts, diary entries, and photographs
We conducted thematic analysis of our interviews using Atlas.ti software. Open and axial coding was used to define themes, which were then discussed amongst all authors.

Understand the past design suggestion
Literature Review with Academia Research

The Changing Face of Travel
- The beach is best for most travellers, with 74% of respondents preferring to spend their vacations on the coast
- 83% simply prefer to be near water—whether the ocean or a lake
- 51% and 35% prefer mountainous and city vacations, respectively
- Millennials have expensive tastes—12% plan to stay in a villa/estate in the next year vs. only 6% of Boomers and 9% of Gen Xers
source: Cision PR News wire (http://www.prnewswire.com) Date: Feb 22, 2017

Review the notification design guideline currently use

In order to cope with the distraction, some mobile users disable audio alerts (Nield, 2018).
- Apple, for instance, launched a “Do not disturb” function (“Use Do Not Disturb on your iPhone, iPad, and iPod touch”, 2019), whereby all calls, alerts and notifications would be silenced when the device is locked.
- Android and Google have introduced similar functions on their devices. These “Do not disturb” functions are seen by many as a potential solution to the constant buzz and rings coming from our phones, and even to curb mobile phone addiction (Jolly, 2019).

Methods
Methods

We recruit participants via questionnaire on the social media, and it ends up generate three Persona which is consistent with our market teams' report. The Persona and the insight not only help us understand users, but also make sure our product goals between design and marketing team are consistent, too.

The demographic in our recruiting questionnaire.

Recruiting questionnaire

We recruit participants via questionnaire on the social media, and it ends up generate three Persona which is consistent with our market teams' report. The Persona and the insight not only help us understand users, but also make sure our product goals between design and marketing team are consistent, too.

Diary & User Interview

We recruit participants via questionnaire on the social media, and it ends up generate three Persona which is consistent with our market teams' report. The Persona and the insight not only help us understand users, but also make sure our product goals between design and marketing team are consistent, too.

Analysis through grounded theory

We conducted thematic analysis of our interviews using Atlas.ti software. Generation of the initial codebook was guided by our interview protocol, and focused on participants’ IM practices, response decisions, and response behaviors.

Findings: Understand users' pattern

Based on the Persona and Survey, we develop three core function to reach the must have goal in our MVP.

Insights

In the questionnaire, we understand the must have function will related to the pain point below:
1. Time consuming searching across many sites
2. No easy way to direct compare price
3. No flexible date searching/ calendar search does not fit for purpose
4. Poor filter options or does not fit for purpose

Participant’s reason for delaying notification to an opportune moment
Direct compare price across many site.

In the questionnaire, we understand the must have function will related to the pain point below:
1. Time consuming searching across many sites
2. No easy way to direct compare price
3. No flexible date searching/ calendar search does not fit for purpose
4. Poor filter options or does not fit for purpose

Flexible date searching

In the questionnaire, we understand the must have function will related to the pain point below:
1. Time consuming searching across many sites
2. No easy way to direct compare price
3. No flexible date searching/ calendar search does not fit for purpose
4. Poor filter options or does not fit for purpose

Strong Filter purpose fit for different purposes.

In the questionnaire, we understand the must have function will related to the pain point below:
1. Time consuming searching across many sites
2. No easy way to direct compare price
3. No flexible date searching/ calendar search does not fit for purpose
4. Poor filter options or does not fit for purpose

Discussion:
Pilot Run
We use HotJar to observe the users' behavior and understand the usability issue about our MVP in the pilot run.
We examined the high / medium video recording in the HotJar with unusual pattern and adjust out design, and we also use Optimize tool to set our A/B testing experiment to decide where to place the flexible date button.
And we also use HotJar embedding feedback widget to collect opinions to have quick view.
Outcome

After release to the pilot group, we asked them to do a quick survey.
The feedback was positive and looking forwards to an upgrade version of more features.
Although we having a successful result in the pilot run in the alpha version, we need to find a good timing to launch our beta version service due to the COVID-19 pandemic.