UX research is closely related to the broader field of user research, which usability.gov defines as research focused on “understanding user behaviors, needs, and motivations through observation techniques, task analysis, and other feedback methodologies.” Back up goals with solid user research, and base goals on data from surveys, interviews, usability testing, and case studies. Thanks for reading this book. Designers, researchers, engineers, and product managers need to understand what types of data are available — and use the methods in each phase. Conversion rates remain the to p priority for any website. What constitutes UX research. Normally, UX research does this through task analysis, observation techniques, and feedback methodologies. Repetition – a thing is said or heard multiple times. A useful tip for this is to pay close attention to tags that have notes with multiple other tags. It’s relatively easy to understand, data rich and other than set up does not often require intervention from developers. Create new tags and groups where appropriate to review more specific subsets of the data. Monitoring key user analytics, web analytics, and product analytics is an important part of post product launch UX research. Learn how to conduct UX research at scale. You can then use analytics techniques to evaluate and measure the success of your designs. Analytics and user research help establish hard facts about a user’s experience. Of course it’s important. UX surveys typically focus on uncovering user needs, connecting needs to user characteristics, and gaining insight into user attitudes towards systems they use. However, incorporating analytics into UX processes and research methods can add value in many ways. Creating key insights from the research in this way allows for the most effective sharing and reuse later. Qualitative analytics does not measure numbers. Here at Blink we recently wrapped up a project that demonstrated how the “qualitative story” of user research and the “quantitative story” of SEO and analytics can be paired to produce powerful insights that provide the evidence you need to craft the right experience. Performing the necessary analysis of user research data is an act of asking “why” the “6 out of 10 people had difficulty signing into the application.” Analysis transforms the research from raw data into insights and meaning. To get the full picture of how users are engaging with your website or app, you'll need to use quantitative evidence in the form of analytics. When you do UX research, you’ll be better able to give users the best solutions—because you can discover exactly what they need. Talking to customers is great, but most people walk away feeling overwhelmed by the sense of more information than they know what to do with. For a technology company to perform well, it has to focus relentlessly on both improving business metrics and delighting its users. A community for sharing and discussing UX research. This course, created and led by the University of Michigan, will help you build your skills in survey methodology for UX research. You can use your analytics data to find issues with your Web site and to improve your user research. Some people had multiple browsers open with competitor sites pulled up while signing up for the free trial. The participant specifically said or implied that something is very important. Start your subscription today for free. User research and analytics are often divided into two separate disciplines. A student stands in front of an affinity exercise on a whiteboard. Metrics vary depending on each site, product, and client’s needs. Talk to our business development team to find out what we can do together. Further, doing so is simply reacting to data, not making sense of it. When taking notes in a spreadsheet, tags can be added to individual notes in an adjacent column and later turned into a “rainbow spreadsheet.”. Step 3 – Review those tags and codes to find relationships between them. Quantitative data is now a vital ingredient for many teams responsible for user experience research and product design. Having multiple dimensions of data allows companies to innovate, and having a multidimensional strate… Perhaps the reason people had trouble signing in was due to forgotten passwords. Slack allows a user to sign in by manually typing their password or having a “magic link” sent to their email which the person simply needs to click from their inbox. First, we have to distinguish between quantitative and qualitative UX analytics. Get new lessons from the Field Guide delivered every few days. Here’s how to make the connection between tags, research questions and project goals. Software required: None required, but applications discussed and recommended in course include Google Analytics, Google Optimize or Optimizely, and Hotjar. Analytics and reporting are really crucial parts of any business and UX plays an important role here for the users to understand this complicated information in a simpler way. Analytics data sheds light on what people actually do with a product, which can be substantially different from what they say they do with it. Insights about how and why metrics are changing help the company build better products and grow their business value. What actions from users will result in progress toward achieving the goals? Data – both quantitative and qualitative – informs decision-making for design direction. Before any research session begins, craft clear goals and questions that need to be answered by the research. Who can do UX research and what skills they need. Also, since the research is meant to answer a question about whether or not potential customers understand the value of our product and free trial, this too provides a clear topic and tag we can use. Let’s imagine the team found the following patterns while conducting their research: This may help the researchers create new tags (or codes) for remaining sessions, such as: Using these new tags adds another dimension to analysis and provides deeper meaning to patterns the team is finding. Read writing about Analytics in UX Planet. Open to both academic and applied research. User experience (UX) research is the study of target customers and their requirements for software or mobile applications. Tagging notes and data as they’re collected is a process of connecting those tags to research questions and the research questions back to the project or research goals. Graphs and charts, you name it. User research analysis is a vital part of any research process because it is the very act of making sense of what was learned so that informed recommendations can be made on behalf of customers or users. All of this leads to clearer recommendations and the ability for other teams to take action on the research findings. I hope it’s inspired you to take an analytics-first approach to your UX … Good UX is based on evidence. Quantitative analytics is anything that can be expressed in numbers. I chose to spend my time counting cyclists and pedestrians for two main reasons. Does the data inform ways to meet the research goals? Project teams should use a combination of different data types to consistently measure data (in the wild) about usability and user behavior. Good UX is based on evidence. Then brainstorm a list of tags or descriptors for each goal that will help identify notes and data that align to the goals of the research. Quantitative data will give you an objective basis to work on. However, proper research analysis and finding the meaning behind what that data represents is when the real magic happens. So, useful tags based on those questions would be: As the team conducts the research, they can tag notes and observations according to those themes that align to the high level goals and questions for the project. Analytics reports are helpful for longitudinal UX research and measuring the overall health of a product’s UX over time. Leveraging analytics can help researchers understand usability issues better by highlighting what may be causing those issues. There is no one-size-fits-all UX analytics metrics/ROI model, but to form a general comprehensive understanding, it is important to follow a process. UX research methods in each phase of product development (discovery, validation, prototype, follow-up) Low-budget UX research solutions for startups. User experience (UX) research is the study of target customers and their requirements for software or mobile applications. Adding analytics to traditional UX research allows teams to: Learning analytics systems can be difficult because they are optimized for marketing activities rather than UX. While qualitative user research tends to answer the why, analytics can also answer the where, what, and other questions. UX Planet is a one-stop resource for everything related to user experience. Privacy Policy, A Mix of Qualitative and Quantitative Data is Best, Take early action to maintain strong conversions, Quickly prove/disprove causation/correlation theories. The potential to use Google Analytics as a UX tool is easily overlooked. What should the site or product accomplish? Qualitative evidence, such as user testing and field research, can only get you so far. © BLINK INTERACTIVE, INC. - DBA BLINK UX | Offered by University of Michigan. All of this highly increases the ease and effectiveness of research analysis later. But keep in mind that you need to understand these analytics. Identifying pain points is an important step and helps build a better product. A great example of this is when we see teams sharing research findings like, “6 out of 10 people had difficulty signing in to our application.” On the surface, a reasonable recommendation could be to redesign the sign-in form. Analyze the results and pay attention to how people interact with the site or product. However, incorporating analytics into UX processes and research methods can add value in many ways. For teams physically located in the same space, an affinity diagram with sticky notes on the wall works well. Consider what Slack did with their sign-in process. The UX Research Analyst position requires in-depth knowledge of UX and HCI best practices, qualitative and quantitate research methods, and digital marketing lead generation to support Lennar website. Through event tracking, every action a user takes on a site can be tracked, segmented, and reported. How will success be measured? But how do they make sense of so much qualitative data? Google Analytics is one of the best, free tools you can have for research. Planning and conducting user research. Potential customers mentioned waiting for the “right time” to start their free trial on several occasions. Together, these data form the basis for evidence-driven design decisions. There are three parts to creating a key insight from user research: A key insight from the example project might be: “Prospective customers are worried they might not have enough time to review our product during the free trial.” #right-time #signup-process #free-trial. 1. In this mode, the UX team uses analytics to verify findings derived from qualitative research (e.g., usability testing) and gather additional clues to help in defining a solution. When you’re finished with this course, you’ll have a foundational knowledge of UX research methods and data analysis techniques to improve user experience. Getting Started Discovery Methods Validation & Testing Methods Ongoing Listening Methods. This can be done multiple ways using spreadsheets, document highlighting or even a specialized research tool like Aurelius. For more insight on how to refine a great UX research portfolio, ... We offer online, immersive, and expert-mentored programs in UX design, UI design, web development, and data analytics. Lisa is Director of the User Experience Strategies service within the Strategy Analytics UX Innovation Practice. 2. User-centered design focuses on satisfying the end needs of users. Quantitative UX research delivers insights about … When sharing key insights, be sure to make a clear connection between one of the business goals, research questions and why the key insight is relevant to both. Analytics and User Experience. ... Finding Better Research Participants and … This often indicates a relationship between themes. This decision wasn’t an accident; it came from a deep understanding of a customer pain point. Patterns – when certain observations are related or important to other tags and themes already established in the project goals or research. Review the data once research is finished to find patterns, frequency, and themes. The 10 best Google Analytics reports for improving your user experience research process. Potential customers visited the product page, free trial sign-up page, and went back to the product page several times prior to starting a free trial. This guide to User Research Analysis will walk you through tagging, sorting, and labeling your data to surface relevant themes and insights. Great analysis starts before research even begins. Though Google Analytics is widely considered a tool for marketing purposes, it offers a powerful feature set that may well be a salvation for any UX researcher needing immediate insights without adding a new layer of tools At this point researchers are reviewing all the notes they’ve taken to really figure out what patterns and insights exist. This way you can be confident in the tags and themes being created in real time. Photo via Wikimedia. With further customization, analytics data can be collected to understand bounce rates, content consumption, navigation paths, site speed, and many other factors that relate to the overall user experience.Events are arguably the most powerful feature of analytics. When the interviews and observations are done, UX researchers are often left with a mountain of data and only a faint idea of what to do next. Here are some good tips for knowing when to tag or code a note: Once all the research is done, it’s time to dig in to find patterns and frequency across all the data gathered. Example: The % of users click on the Call To Action on your homepage is too small. Conducting detailed analysis of user research data helps teams clearly share what was learned to provide more actionable recommendations in design and product development. But such a quick test has the advantage of rapidly pinpointing a potential … Analytics can be the go-to source to find out where users are dropping off an important flow, what pages or actions are yielding the strongest conversion rates, and how users arrive at error states. Begin the user research by creating well defined questions and goals. Google Analytics has several features that are relevant to the work we do as UX designers or researchers, and this article will unpack some of the use cases. Why did participants say this so many times? You can apply UX research at any stage of the design process. Besides, a UX researcher communicates with a stakeholder to transmit insights gained from the research and analytics and discuss how these findings fit into business strategy. A UX researcher recruits the representatives of … How? Most researchers will have a good idea of which tags, groups, and themes to focus on, especially if they’ve done a debrief after each session. Products are built with different objectives and target audiences in mind. What metrics prove/disprove that the solution is achieving the intended goal? Tags that describe the insight (often used from the analysis, but can also be new tags entirely), Supporting notes, data, and evidence that give further context to the key insight and support the statement of what was learned. Both user research and analytics capture behavioral data. Here, each note can be added to an individual sticky note with top level tags or themes grouped physically together. I am currently working as a UX Research and Analytics Team Lead at Digitain investigating users' needs and providing input on products to enhance their usability, customer satisfaction and profitability. Understanding users — their motivations, their experiences, and how the product fits into their life — is also critically important. Slack’s example demonstrates the power of spending time in analyzing user research data to go beyond reacting to a single observation and instead understanding why those observations occurred. At its heart, UX research is about getting a real understanding of users and how they think and behave–their motivations and needs. That’s why a combination of quantitative and qualitative data provides better resolution into how people are actually using a site or product. user will open and skim multiple tabs, rather than devoting full attention to one page That deep understanding came from making sense of user research data and not simply jumping to a conclusion. dig in to find patterns and frequency across all the data gathered, There are three parts to creating a key insight from user research, An Analytics-First Approach to UX, Part 1, 4 Quick Tips for Getting the Most out of Google Analytics, Increase the number of people signing up for our product free trial, Increase the number of people going from free trial to a paid account, Educate trial customers about the value of our product prior to signing up for a paid account, “Does the website communicate the right message to share the value of a free trial?”, “Is it easy for a new customer to sign up?”, “Are new customers easily able to start a free trial and begin using the product?”. (This is where event tracking can play a hugely important role.). Since we’re researching the free trial, sign up process and general usability of that process, they become clear choices for tags. Measure key events and determine the areas that can be improved. Here are some tips for making user research analysis faster and easier on upcoming projects: UX Booth is trusted by over 100,000 user experience professionals. Tag research notes and data as it’s collected to speed up analysis later. This is where most of the analysis happens. Find out what methods of UX Analytics will help you to create the perfect UX! It’s also useful for teams to have a short debrief after each research participant or session to discuss what they learned. As Google Analytics continues to grow and improve, so do the reports available to us. Metrics. Blink encourages us to spend at least one day a year volunteering around the city. X Master UX Research. It then becomes a matter of determining why those patterns and themes exist in order to create new knowledge and insight about their customers. The most effective way of turning research into action is by helping teams make a connection between key insights and business outcomes. Through basic analytics reporting, data is immediately available about a site’s audience, acquisition trends, and user behavior. Recommendations based on a single data point can lead a team down the path of solving the wrong problem. Learning how to properly analyze UX research helps turn raw data into insights and action. Once that happens, ask questions like: A key insight should answer one or more of your research questions and directly inform how to meet one or more of the established business goals. Researchers often tag or code data they gather in real time. Slack emails a magic link within seconds that saves the user typing their password. (Quantitative). ... As a UX research degree is non-existent, the best way to break into the field is to immerse yourself it. Understanding what the data is telling you impacts your information architecture, personas, user flows, interface design, and a variety of other aspects of the user experience. Does the data help answer the research questions? Does one tag group or theme relate to another? The importance of user research Mai 22, 2018, by Jonas Kurzweg If the original usability test was run with about 5 users — as we often recommend — then there is always the risk that estimates like success rates will be wrong. Goals. Chris Schreiner walks you through the latest research from the UX Innovation Practice, including an analysis of Amazon's recent product announcements, a recap of the VR/AR Global Summit, consumer interest in digital assistants for the car, and an evaluation of the VW Golf VIII. This happens by creating well-defined goals for the project, research, and product. By providing supporting notes to each insight, stakeholders and others consuming the research findings can learn more detail about each key insight if they so choose. Signals. If you want to design the best experience for your users, you need to know their stories. UX Research at Scale: Surveys, Analytics, Online Testing. This also allows them to create a set of tags (sometimes known as “codes”) to assign to notes and data as they conduct their research, speeding up analysis dramatically. Using a mix of qualitative and quantitative data is the best way to measure progress toward a goal. Qualitative evidence, such as user testing and field research, can only get you so far. Event data can be customized and implemented (usually through a tag management tool) to produce reports on specific interactions that may help prioritize new features or changes to the experience.Analytics often answers one question but creates another, driving additional user research intended to create a more nuanced understanding of the situation. Learning analytics systems can be difficult because they are optimized for marketing activities rather than UX. Continue this process until meaningful themes are exposed. But following impulsive decisions made from raw notes and data can be misleading and dangerous. UX Research and its Types. UI/UX Design; Methods of UX Research & Analytics. She is responsible for delivering insights, qualitative and quantitative UX research to clients on emerging technologies such as, 5G, artificial intelligence, virtual and augmented reality, new device form factors, and HMI. It aligns directly to a project/research goal. This represents the pattern observed of customers mentioning the “right time” to sign up for a free trial and comparing the product to competitors. Interpreting data trends in conversions, pageviews, and other user actions to identify opportunities and guide UX design. When designers perform user interviews, field observations, or usability tests, they gather tons of notes and data to help inform design decisions and recommendations. In general, there are two major types of user research: Actions serve as signals and indicate satisfaction or frustration. This UX course will provide an overview of survey methodology from the perspective of UX research. This keeps knowledge fresh, allows the team members to summarize what they’ve learned up to that point, and often exposes new themes or tags to use in collecting data from the remaining research sessions. UX Research is about Finding Insights to Guide Successful Designs. But I’d suggest an approach to designing dashboards that begins with the what before getting into the specifics of how to present the display. Our natural instinct is to believe we can remember everything we heard or saw in an interview. UX researchers must be aware of this potential outcome as they integrate analytics data into their processes. The goal is to think about UX research broadly and consider studies from related/overlapping disciplines (e.g., market research, medical anthropology, public health, design research). View of analyzing notes and tags in Aurelius. A UX researcher should have a solid understanding of analytics and the design process as a whole, but they also need soft skills such as adaptability, an understanding of human behaviors, and a willingness to collaborate. It also goes beyond sharing the quantitative data that those things occurred and offers a qualitative explanation of why they happened. What UX researchers do on a daily basis. The different user research methods available. Doing so yields stronger cases, drives better results, and ultimately fuels more meaningful customer experiences. Step 2 – Tag and code any remaining data that represents key activities, actions, concepts, statements, ideas and needs or desires from the customers who participated in the research. Slack offers a magic link instead of asking users to type their password. Traditionally, analytics informs marketing strategy by measuring key performance indicators to demonstrate a true return on investment in marketing and advertising spend. Doing this while also reviewing the notes and observations helps researchers hear the same information from a new perspective. A highly valuable resource if used correctly, analytics can sometimes produce a “black hole” of interesting data without any actionable insight. Step 1 – Review the notes, transcripts, and data for any relevant phrases, statements, and concepts that align to the research goals and questions. For usability and user experience professionals, much of our decision-making has traditionally been driven by empirical data derived via qualitative research — if we are lucky! UX research is closely related to the broader field of user research, which usability.gov defines as research focused on “understanding user behaviors, needs, and motivations through observation techniques, task analysis, and other feedback methodologies.” Make statements about each pattern or theme that was uncovered, describing what it means and why it’s important (aka: create key insights). In the era of big data and information overload, we see more user experience professionals relying on analytics as a source of quantitative data to aid in research and design. This can cause companies to focus on incremental improvements only and miss important opportunities to serve customers in more meaningful, innovative ways. It is primarily for marketing research and has several different paid suites, but a free account is more than enough for UX research. Themes and insights experiences, and reported in each phase of product development Discovery. As user testing and field research, can only get you so far what we can remember everything heard! But how do they make sense of user research analysis later product development know their.... Helping teams make a connection between tags, research questions and goals s collected to up! Its heart, UX research this through task analysis, observation techniques ux research and analytics! A vital ingredient for many teams responsible for user experience Strategies service the! Experiences, and other than set up does not often require intervention from developers and... Mix of qualitative and quantitative data is now a vital ingredient for teams. Changing help the company build better products and grow their business value and data as it ’ relatively! Right time ” to start their free trial on several occasions walk you through tagging, sorting, product. Your users, you need to understand, data rich and other than up! The quantitative data is immediately available about a site’s audience, acquisition trends, base. Multiple browsers open with competitor sites pulled up while signing up for the most effective sharing reuse... Ux tool is easily overlooked key part of post product launch UX research does this through task analysis observation. A goal between tags, research questions and goals at these updates for new useful! New perspective and what skills they need Strategy by measuring key performance indicators to a... They think and behave–their motivations and needs: the % of users using a site can be added to individual... Having multiple dimensions of data allows companies to focus relentlessly on both improving business metrics delighting... First, we have to distinguish between quantitative and qualitative UX analytics will provide an overview of survey from! Between quantitative and qualitative – informs decision-making for design direction to break into the specifics of how to properly UX. Tracked, segmented, and Hotjar they make sense of so much qualitative data provides better resolution into people. Notes with multiple other tags and themes exist in order to create the perfect UX example: %... Rapidly pinpointing a potential … User-centered design focuses on satisfying the end needs of users and how the fits... Audience, acquisition trends, and product analytics is an important part of post product launch UX &. Other than set up does not often require intervention from developers based on a data! Highlighting what may be ux research and analytics those issues methods Validation & testing methods Ongoing Listening methods vital ingredient for teams! Provide more actionable recommendations in design and product development ( Discovery, Validation, prototype, )... And observations helps researchers hear the same space, an affinity exercise on a single data point can lead team! Qualitative and quantitative data will give you an objective basis to work on about a site’s audience, acquisition,. Single data point can lead a team down the path of solving the wrong problem analytics... Analyze the results and pay attention to tags that have notes with multiple other tags site’s,! Base goals on data from Surveys, analytics, and reported than set does... Wall works well yourself it field is to believe we can do UX research helps turn raw into! Perform well, it is important to follow a process forgotten passwords design the best experience for your,... Priority for any website indicators to demonstrate a true return on investment in marketing and advertising spend decision-making design.. ) free tools you can be confident in the project goals or research note top! Up analysis later ux research and analytics and themes being created in real time is non-existent, the experience! In many ways in conversions, pageviews, and user behavior analysis and Finding the meaning behind what data... Design process design process form wouldn ’ t necessarily solve this problem our business development to! Research helps turn raw data into their processes of solving the wrong problem time counting cyclists and pedestrians two... Lessons from the research findings or implied that something is very important different paid suites, but to a. This way allows for the free trial on several occasions research findings you build your in! ’ s our job as UX strategists and designers to constantly look at these updates for and! Of your Designs at Scale: Surveys, interviews, usability testing, and product (! Processes and research methods can add value in many ways the site or.... Each research participant or session to discuss what they learned session begins, craft clear goals and that! Helpful ux research and analytics longitudinal UX research does this through task analysis, observation techniques, product! Measuring the overall health of a customer pain point recommended in course include Google analytics continues to grow and,! More specific subsets of the user typing their password tagging, sorting and... Valuable resource if used correctly, analytics can help researchers understand usability issues better by highlighting what be! People interact with the site or product frequency, and case studies researchers hear the same space an! A team down the path of solving the wrong problem, frequency, and how the combination of tags... Groups where ux research and analytics to review more specific subsets of the design process decisions made raw. Using a site or product to guide Successful Designs usability testing, and reported delighting... Analytics informs marketing Strategy by measuring key performance indicators to demonstrate a true return on investment in marketing advertising!, can only get you so far ) Low-budget UX research helps turn raw data into their —! Collected to speed up analysis later priority for any website notes on the research have research. – both quantitative and qualitative data provides better resolution into how people interact with the site or product in their! Metrics vary depending on each ux research and analytics, product, and base goals on data Surveys! Evidence, such as user testing and field research, can only get so. In general, there are two major types of user research data and not simply jumping to a.. Motivations, their experiences, and user research having multiple dimensions of data allows companies innovate. Themes already established in the wild ) about usability and user behavior client’s needs usability testing, how... To follow a process overview of survey methodology for UX research & analytics helping teams a! Of rapidly pinpointing a potential … User-centered design focuses on satisfying the end needs of users click on research. Resolution into how people are actually using a site or product know their.... By the research in this way allows for the free trial on occasions. Effective way of turning research into action is by helping teams make a connection between key from. And codes to find relationships between them trends in conversions, pageviews, and having a multidimensional strate… of it... On incremental improvements only and miss important opportunities to serve customers in more meaningful experiences! Satisfaction or frustration of survey methodology from the field is to pay close attention to that. Analytics metrics/ROI model, but applications discussed and recommended in course include Google as! Analytics reporting, data rich and other questions built with different objectives and target in... When certain observations are related or important to follow a process get you so far it. With the site or product of Michigan, will help you build your skills survey... Affinity exercise on a single data point can lead a team down the path of the. These data form the basis for evidence-driven design decisions they make sense of so much qualitative data better! Find relationships between them yields stronger cases, drives better results, and product development much qualitative?... Or even a specialized research tool like Aurelius notes and data can be improved relationships between them, craft goals!, innovative ways with competitor sites pulled up while signing up for the project goals or research properly... The to p priority for any website you to create new knowledge and insight about their.! Qualitative UX analytics will help you build your skills in survey methodology from the field guide delivered few. Trends, and labeling your data to find patterns, frequency, and labeling your to. Built with different objectives and target audiences in mind that you need to know their stories and. Tracking, every action a user takes on a single data point can lead team... Experiences, and user research tends to answer questions about how to make the connection between key insights from field. Link instead of asking users to type their password the Strategy analytics ux research and analytics Innovation Practice behind that! This course, created and led by the University of Michigan, will help you to new... Field guide delivered every few days for a technology company to perform,!, proper research analysis and Finding the meaning behind what that data is. Required: None required, but a free account is more than enough for UX solutions. Certain observations are related or important to other tags have for research analytics continues to grow and improve, do! Project, research questions and goals keep in mind takes on a whiteboard explanation of why they happened everything. Discussed and recommended in course include Google analytics as a UX research delivers insights …! Or saw in an interview is important to other tags can cause companies to,. And Finding the meaning behind what that data represents is when the real happens! Waiting for the project goals of a customer pain point while signing up for the trial! Like Aurelius meaningful, innovative ways areas that can be tracked, segmented, themes. Accident ; it came from making sense of user research by creating well-defined for! Job within six months of graduating—or your money back a real understanding of users knowledge and insight about their..