Ye Li https://undergradbiz.ucr.edu/ en The Future of Decision Making https://undergradbiz.ucr.edu/blog/2025/05/02/future-decision-making <span>The Future of Decision Making</span> <span><span>ilseu</span></span> <span><time datetime="2025-05-22T16:37:40-07:00" title="Thursday, May 22, 2025 - 16:37">Thu, 05/22/2025 - 16:37</time> </span> <a href="https://undergradbiz.ucr.edu/blog">More Blog Posts</a> <picture> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/ye-li-podcast-graphic-copy.jpg?h=f39a247e&amp;itok=OsK_UVup 1x" media="all and (min-width: 1401px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/ye-li-podcast-graphic-copy.jpg?h=f39a247e&amp;itok=OsK_UVup 1x" media="all and (min-width: 1025px) and (max-width: 1400px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_m/public/ye-li-podcast-graphic-copy.jpg?h=f39a247e&amp;itok=xHCMw9ni 1x" media="all and (min-width: 768px) and (max-width: 1024px)" type="image/jpeg" width="1023" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_s/public/ye-li-podcast-graphic-copy.jpg?h=f39a247e&amp;itok=qQ9kr0U6 1x" type="image/jpeg" width="767" height="767"> <img loading="eager" width="1170" height="450" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/ye-li-podcast-graphic-copy.jpg?h=f39a247e&amp;itok=OsK_UVup" alt="Prof. Ye Li"> </picture> Josh Haynam | Interact <time datetime="2025-05-02T12:00:00Z">May 02, 2025</time> <p>In a recent episode of the Quiz Marketing Podcast, Josh Haynam, Co-founder at Interact, sat down with Professor Ye Li, Associate Professor of Management at UC Riverside, to explore the fascinating world of behavioral science and decision-making. What makes this episode so compelling is how it bridges theory and practice, showing listeners why the psychology behind our choices matters not only in research but also in real-world applications like marketing, finance, and even health-related behaviors.</p> <p>Professor Li and Josh begin by discussing the role of emotions in shaping decisions. Many people assume decision-making is purely rational, but as Li explains, emotions often act as shortcuts that influence how we evaluate options. For example, feelings of gratitude can lead individuals to be more generous with money or more trusting in negotiations. On the other hand, fear or anxiety might cause people to avoid risks even when the logical choice points the other way. Understanding these emotional drivers allows businesses, marketers, and policymakers to anticipate behavior and design strategies that resonate with people on a deeper level.</p> <p>They then dive into the concept of cognitive shortcuts—or heuristics—and how these mental “rules of thumb” help us navigate daily life. Heuristics are essential because they save time and energy, but they can also introduce bias. Professor Li gives examples of how the framing of a question or the way information is presented can dramatically influence outcomes. Something as simple as asking whether a glass is “half full” versus “half empty” can change how people feel about the same situation. For marketers, this insight is crucial: the phrasing of quiz questions, survey items, or product descriptions can determine whether someone engages positively or feels uncertain.</p> <p>Another major theme of the episode is personalization. Li highlights how micro-targeting and individual differences shape the effectiveness of marketing campaigns. Two people may react very differently to the same message based on their values, past experiences, or personality traits. By paying attention to these nuances, businesses can craft experiences that feel more personal, increasing customer satisfaction and loyalty. Interact’s quiz-based marketing model fits seamlessly into this discussion, as it allows brands to segment audiences and provide tailored recommendations.</p> <p>The conversation also turns toward the future of decision-making in the age of artificial intelligence. Far from replacing human judgment, Professor Li emphasizes that AI works best when it collaborates with human insight. Algorithms can process massive amounts of data, but humans bring context, creativity, and ethical considerations that machines alone cannot provide. Together, the two create a decision-making process that is not only efficient but also more balanced and humane. For students, entrepreneurs, and professionals alike, this perspective encourages critical thinking about how to leverage AI responsibly while respecting human judgment.</p> <p>Whether you’re interested in marketing strategy, psychology, or leadership, this podcast episode delivers valuable takeaways. If you’re a marketer, you’ll walk away with new ways to frame questions, design quizzes, and appeal to your audience’s emotions. If you’re a business leader, you’ll gain insights into motivating teams, understanding customer behavior, and making more informed decisions. And for students or lifelong learners, Professor Li provides a clear and engaging introduction to behavioral science that connects academic research with everyday life.</p> <p>The 48-minute podcast is available on two platforms, making it easy to tune in on your favorite service:</p> <p><a class="btn-ucr-green" data-auth="NotApplicable" data-linkindex="2" href="https://open.spotify.com/episode/4rkXPOIDfYxbq8wAkFpxnc?si=g3BvNNjiTuO7KoMYDIvNLg" rel="noopener noreferrer" target="_blank" title="https://open.spotify.com/episode/4rkXPOIDfYxbq8wAkFpxnc?si=g3BvNNjiTuO7KoMYDIvNLg">Spotify</a>&nbsp;</p> <p>&nbsp;<a class="btn-ucr-green" data-auth="NotApplicable" data-linkindex="3" href="https://podcasts.apple.com/us/podcast/decision-making-with-ye-li/id1507705934?i=1000705843886" rel="noopener noreferrer" target="_blank" title="https://podcasts.apple.com/us/podcast/decision-making-with-ye-li/id1507705934?i=1000705843886">Apple Podcasts</a>.&nbsp;</p> <p>&nbsp;</p> <div alt="Ye Li on the Interact podcast" data-embed-button="media_browser" data-entity-embed-display="media_image" data-entity-embed-display-settings="{&quot;image_style&quot;:&quot;&quot;,&quot;image_link&quot;:&quot;file&quot;,&quot;image_loading&quot;:{&quot;attribute&quot;:&quot;lazy&quot;}}" data-entity-type="media" data-entity-uuid="6ef7a817-fcd8-4c85-9062-d221cac79ee5" data-langcode="en" title="Ye Li on the Interact podcast" class="embedded-entity align-center"> <a href="https://undergradbiz.ucr.edu/sites/default/files/ye-li-interact-banner.png"><img loading="lazy" src="https://undergradbiz.ucr.edu/sites/default/files/ye-li-interact-banner.png" alt="Ye Li on the Interact podcast" title="Ye Li on the Interact podcast"> </a> </div> <p>&nbsp;</p> <p>___________________________</p> <p><em>The Interact podcast explores human behavior and decision making. Interviews with experts delve into the specifics of how humans operate and make choices, with the goal of better understanding what drives people. Josh Haynam, Co-founder at Interact, hosts the podcast. Josh has been studying human behavior through the lens of personality quizzes since 2013 and has seen over 1 billion data points come through the Interact platform. Conversations weave in and out of research studies and anecdotal&nbsp;information derived from experiences of guests and quiz creators.&nbsp;</em></p> <p>&nbsp;</p> <div class="tags-title">Tags</div> <div class="tags-list"> <div><a href="https://undergradbiz.ucr.edu/tags/faculty-spotlight" hreflang="en">faculty spotlight</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/faculty" hreflang="en">faculty</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/ye-li" hreflang="en">Ye Li</a></div> </div> <div class="sharing-title">Share This</div><span class="a2a_kit a2a_kit_size_32 addtoany_list" data-a2a-url="https://undergradbiz.ucr.edu/blog/2025/05/02/future-decision-making" data-a2a-title="The Future of Decision Making"><a class="a2a_button_facebook"></a><a class="a2a_button_x"></a><a class="a2a_button_linkedin"></a><a class="a2a_button_google_plus"></a><a class="a2a_button_email"></a><a class="a2a_button_printfriendly"></a><a class="a2a_dd addtoany_share" aria-label="more options to share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fundergradbiz.ucr.edu%2Fblog%2F2025%2F05%2F02%2Ffuture-decision-making&amp;title=The%20Future%20of%20Decision%20Making"></a></span><script> (function () { const customClassName = 'show-for-sr'; const targetContainer = document.querySelector('.a2a_kit.addtoany_list'); if (!targetContainer) return; const addClassToLabels = () => { const labels = targetContainer.querySelectorAll('.a2a_label'); if (labels.length > 0) { labels.forEach(label => { if (!label.classList.contains(customClassName)) { label.classList.add(customClassName); } }); console.log('Successfully applied show-for-sr class to AddToAny labels.'); return true; } return false; }; const observerConfig = { childList: true, subtree: true }; const observer = new MutationObserver((mutationsList, observer) => { if (addClassToLabels()) { observer.disconnect(); } }); if (!addClassToLabels()) { observer.observe(targetContainer, observerConfig); } })(); </script> Thu, 22 May 2025 23:37:40 +0000 ilseu 2555 at https://undergradbiz.ucr.edu ‘I Would Take His Class Again in a Heartbeat’ https://undergradbiz.ucr.edu/blog/2023/02/27/professor-li-faculty-award <span>‘I Would Take His Class Again in a Heartbeat’</span> <span><span>clin246</span></span> <span><time datetime="2022-11-18T14:30:01-08:00" title="Friday, November 18, 2022 - 14:30">Fri, 11/18/2022 - 14:30</time> </span> <a href="https://undergradbiz.ucr.edu/blog">More Blog Posts</a> <picture> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/Awards_2022_Business_faculty.jpg?h=1d11c2e6&amp;itok=Kap8GHxy 1x" media="all and (min-width: 1401px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/Awards_2022_Business_faculty.jpg?h=1d11c2e6&amp;itok=Kap8GHxy 1x" media="all and (min-width: 1025px) and (max-width: 1400px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_m/public/Awards_2022_Business_faculty.jpg?h=1d11c2e6&amp;itok=1uXPWajy 1x" media="all and (min-width: 768px) and (max-width: 1024px)" type="image/jpeg" width="1023" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_s/public/Awards_2022_Business_faculty.jpg?h=1d11c2e6&amp;itok=6veULlHk 1x" type="image/jpeg" width="767" height="767"> <img loading="eager" width="1170" height="450" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/Awards_2022_Business_faculty.jpg?h=1d11c2e6&amp;itok=Kap8GHxy" alt="UCR School of Business Faculty Awards 2022"> </picture> Laurie McLaughlin <time datetime="2023-02-27T12:00:00Z">February 27, 2023</time> <p>“Experiential learning” is a term bandied about in academia, but how does it work in practice? Associate Professor of Management <a href="mailto:https://profiles.ucr.edu/app/home/profile/yeliphd" rel=" noopener" target="_blank">Ye Li</a> at UCR’s School of Business lays out exactly what it looks like within his graduate courses.<br> <br> “Experiential learning includes online surveys, in-class polls, simulated decisions, games, and group projects,” says Li. “My lectures provide relatable, recent examples to help clarify and cement concepts that will be remembered past finals week.”</p> <figure role="group" class="embedded-entity align-right"> <div alt="Ye Li, Associate Professor of Management, UCR School of Business" data-embed-button="media_browser" data-entity-embed-display="media_image" data-entity-embed-display-settings="{&quot;image_style&quot;:&quot;bubble&quot;,&quot;image_link&quot;:&quot;&quot;}" data-entity-type="media" data-entity-uuid="20d94fb3-a38f-4ad0-80bd-011158c20178" data-langcode="en" title="Ye Li, Associate Professor of Management, UCR School of Business"> <img alt="Ye Li, Associate Professor of Management, UCR School of Business" height="250" loading="lazy" src="https://undergradbiz.ucr.edu/sites/default/files/styles/bubble/public/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg?h=39d6c24d&amp;itok=9AKZimOO" title="Ye Li, Associate Professor of Management, UCR School of Business" width="250"> </div> <figcaption>Ye Li, associate professor of management</figcaption> </figure> <p>Li also spends a great deal of time guaranteeing each student completes the quarter with a full understanding of the material: “To ensure that students can learn and improve, I provide substantial feedback, usually five to 10 sentences in length,” he says. “To encourage class discussion, which is sometimes hard for those who are anxious or do not speak English fluently, I try to foster a friendly, inclusive environment.<br> <br> “I emphasize that getting things wrong in a safe environment is important for learning, and failure leads to success even more than does initial success.”<br> <br> His graduate students appreciate his approach: They presented Li with the 2021-2022 Golden Apple Award for Teaching Excellence for graduate elective courses, an honor for which he tied in the student voting with Associate Dean for Graduate Programs and Professor of Marketing Rami Zwick.<br> <br> “Dr. Li has one of the most engaging, exciting, informational, and relevant classes I have ever had the pleasure of taking,” wrote one student voter. “He genuinely cares about his students and goes above and beyond to help students stay on track.<br> <br> “He even takes the time to analyze the data we provide him, and he tells us what the data means. I would take his class again in a heartbeat.”<br> <br> Selected by Poets &amp; Quants for their 2020 Best 40 Under 40 Business Professors listing, Li’s research is on decision-making and behavioral economics, and he examines the psychology of how and why people make suboptimal decisions. He is particularly interested in the role of time in decision-making.<br> <br> In the classroom, he says, “How people make decisions is an important set of skills for students to have. So, it is satisfying to see students start to understand the concepts in my class.<br> <br> “Even better, is when they get in contact years later and tell me how useful the class concepts were for their careers and life decisions.”</p> <p>&nbsp;</p> <p>&nbsp;</p> <div class="tags-title">Tags</div> <div class="tags-list"> <div><a href="https://undergradbiz.ucr.edu/tags/faculty-awards" hreflang="en">FACULTY AWARDS</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/awards" hreflang="en">awards</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/ye-li" hreflang="en">Ye Li</a></div> </div> <div class="sharing-title">Share This</div><span class="a2a_kit a2a_kit_size_32 addtoany_list" data-a2a-url="https://undergradbiz.ucr.edu/blog/2023/02/27/professor-li-faculty-award" data-a2a-title="‘I Would Take His Class Again in a Heartbeat’"><a class="a2a_button_facebook"></a><a class="a2a_button_x"></a><a class="a2a_button_linkedin"></a><a class="a2a_button_google_plus"></a><a class="a2a_button_email"></a><a class="a2a_button_printfriendly"></a><a class="a2a_dd addtoany_share" aria-label="more options to share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fundergradbiz.ucr.edu%2Fblog%2F2023%2F02%2F27%2Fprofessor-li-faculty-award&amp;title=%E2%80%98I%20Would%20Take%20His%20Class%20Again%20in%20a%20Heartbeat%E2%80%99"></a></span><script> (function () { const customClassName = 'show-for-sr'; const targetContainer = document.querySelector('.a2a_kit.addtoany_list'); if (!targetContainer) return; const addClassToLabels = () => { const labels = targetContainer.querySelectorAll('.a2a_label'); if (labels.length > 0) { labels.forEach(label => { if (!label.classList.contains(customClassName)) { label.classList.add(customClassName); } }); console.log('Successfully applied show-for-sr class to AddToAny labels.'); return true; } return false; }; const observerConfig = { childList: true, subtree: true }; const observer = new MutationObserver((mutationsList, observer) => { if (addClassToLabels()) { observer.disconnect(); } }); if (!addClassToLabels()) { observer.observe(targetContainer, observerConfig); } })(); </script> Fri, 18 Nov 2022 22:30:01 +0000 clin246 2271 at https://undergradbiz.ucr.edu "New" Doesn’t Mean Improved. Why Do We Choose It? https://undergradbiz.ucr.edu/news/2022/10/28/new-doesnt-mean-improved <span>"New" Doesn’t Mean Improved. Why Do We Choose It?</span> <span><span>ilseu</span></span> <span><time datetime="2022-10-31T00:26:34-07:00" title="Monday, October 31, 2022 - 00:26">Mon, 10/31/2022 - 00:26</time> </span> <a href="https://undergradbiz.ucr.edu/news">More News</a> <picture> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/consumer-1.jpg?h=47d93903&amp;itok=rgau6Wm_ 1x" media="all and (min-width: 1401px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/consumer-1.jpg?h=47d93903&amp;itok=rgau6Wm_ 1x" media="all and (min-width: 1025px) and (max-width: 1400px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_m/public/consumer-1.jpg?h=47d93903&amp;itok=Ov3GMbnW 1x" media="all and (min-width: 768px) and (max-width: 1024px)" type="image/jpeg" width="1023" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_s/public/consumer-1.jpg?h=47d93903&amp;itok=7LGp7f35 1x" type="image/jpeg" width="767" height="767"> <img loading="eager" width="1170" height="450" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/consumer-1.jpg?h=47d93903&amp;itok=rgau6Wm_" alt="Consumer choosing a product"> </picture> Darin Estep <time datetime="2022-10-28T12:00:00Z">October 28, 2022</time> <figure role="group" class="embedded-entity align-right"> <div alt="Ye Li, Assistant Professor of Management, UCR School of Business" data-embed-button="media_browser" data-entity-embed-display="media_image" data-entity-embed-display-settings="{&quot;image_style&quot;:&quot;article_image_listing&quot;,&quot;image_link&quot;:&quot;&quot;}" data-entity-type="media" data-entity-uuid="20d94fb3-a38f-4ad0-80bd-011158c20178" data-langcode="en" title="Ye Li, Assistant Professor of Management, UCR School of Business"> <img alt="Ye Li, Assistant Professor of Management, UCR School of Business" height="266" loading="lazy" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_image_listing/public/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg?h=39d6c24d&amp;itok=BV-pzEgr" title="Ye Li, Assistant Professor of Management, UCR School of Business" width="266"> </div> <figcaption>Associate Professor of Management Ye Li</figcaption> </figure> <p>Suppose you had a chance to bid on two identical boxes of chocolates, both with the same expiration date, both stored in the refrigerator. The only difference: One was purchased off the shelf a week ago, the other was purchased today.</p> <p>If you’re like most people, you would be willing to pay more for the box purchased today. In fact, as <a href="https://profiles.ucr.edu/app/home/profile/yeliphd" rel=" noopener" target="_blank">Associate Professor of Management Ye Li</a> reports in a recent paper published in the Journal of Retailing, you might be willing to pay 44% more for the “newer” box of chocolates.</p> <p>In the paper, “<a href="https://www.sciencedirect.com/science/article/pii/S0022435921000683" rel=" noopener" target="_blank">Chronological cues and consumers’ preference for mere newness,</a>” Li and his co-author (one of his former students at UCR, Yun Jie, now at the School of Tourism Management in Guangzhou, South China Normal University, Higher Education Mega Center) found ample evidence that consumers are willing to pay a “newness premium” – even when there is no substantial benefit. The findings have implications for retailers and consumers alike.</p> <p>These were not cases of obvious advantage of newness, such as the freshness of food, or technological advances, or even novelty. In multiple studies that emphasized comparisons of equivalent products, the belief that “newer is better” showed up for otherwise-identical Post-it Notes, books, wireless headphones.</p> <p>“We actually collected over a hundred studies, although only six made it into the paper,” Li said. “The main effect of people preferring the newer thing is incredibly robust. It shows up significantly every time. And what's more, it's actually really hard to get rid of.”<br> &nbsp;</p> <h6><strong>Lessons for sellers and consumers</strong></h6> <p>One reason retailers might want to get rid of the newness label: Although “new” is one of the most common words used in marketing, it can pose a dilemma.</p> <p>“Releasing a new product will always make an older product less valuable,” Li said. “If you have a box of something sitting there collecting dust, no one is going to buy it. You do want to advertise things as new, but every time you do that, something else is no longer new.”</p> <p>In these cases, Li recommends alternative message strategies, such as promoting a “product of the day” – highlighting an item that may not be literally new but worth attention.</p> <p>Similarly, consumers should be aware of how their preference for “mere newness” influences their decisions, even for products that offer no advantage.</p> <p>“As a consumer, you really have to actively work against this feeling,” Li said. You really have to try hard to suppress the desire to get the newest thing just because it's new. Ask yourself: Are there actual features that I want?”</p> <p>This can be a hard habit to break, as noted by an opening quotation in the paper: “Americans have been conditioned to respect newness, whatever it costs them.”<br> &nbsp;</p> <h6><strong>A nearly universal trait</strong></h6> <p>Although the quotation, from John Updike’s 1975 novel, “A Month of Sundays,” specifies American habits, this preference is found in cultures around the world, Li said.</p> <p>Other examples include people being willing to bet more on a coin toss that was made today over one that tossed yesterday. Or paying more for a lottery ticket that was purchased today over one that was bought a week ago.</p> <p>“There's just some something powerful about the influence of time,” Li said. “A lot of my research is about the influence of time and its effect on decision making. This set of studies is all about the kind of improper influence of time when time doesn't matter.”</p> <p>&nbsp;</p> <p>&nbsp;</p> <div class="tags-title">Tags</div> <div class="tags-list"> <div><a href="https://undergradbiz.ucr.edu/tags/faculty-news" hreflang="en">faculty news</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/ye-li" hreflang="en">Ye Li</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/research-news" hreflang="en">Research News</a></div> </div> <div class="sharing-title">Share This</div><span class="a2a_kit a2a_kit_size_32 addtoany_list" data-a2a-url="https://undergradbiz.ucr.edu/news/2022/10/28/new-doesnt-mean-improved" data-a2a-title="&quot;New&quot; Doesn’t Mean Improved. Why Do We Choose It?"><a class="a2a_button_facebook"></a><a class="a2a_button_x"></a><a class="a2a_button_linkedin"></a><a class="a2a_button_google_plus"></a><a class="a2a_button_email"></a><a class="a2a_button_printfriendly"></a><a class="a2a_dd addtoany_share" aria-label="more options to share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fundergradbiz.ucr.edu%2Fnews%2F2022%2F10%2F28%2Fnew-doesnt-mean-improved&amp;title=%22New%22%20Doesn%E2%80%99t%20Mean%20Improved.%20Why%20Do%20We%20Choose%20It%3F"></a></span><script> (function () { const customClassName = 'show-for-sr'; const targetContainer = document.querySelector('.a2a_kit.addtoany_list'); if (!targetContainer) return; const addClassToLabels = () => { const labels = targetContainer.querySelectorAll('.a2a_label'); if (labels.length > 0) { labels.forEach(label => { if (!label.classList.contains(customClassName)) { label.classList.add(customClassName); } }); console.log('Successfully applied show-for-sr class to AddToAny labels.'); return true; } return false; }; const observerConfig = { childList: true, subtree: true }; const observer = new MutationObserver((mutationsList, observer) => { if (addClassToLabels()) { observer.disconnect(); } }); if (!addClassToLabels()) { observer.observe(targetContainer, observerConfig); } })(); </script> Mon, 31 Oct 2022 07:26:34 +0000 ilseu 2256 at https://undergradbiz.ucr.edu Repetitive Questions in Studies Yield Bad Data https://undergradbiz.ucr.edu/news/2022/01/28/repetitive-questions-bad-data <span>Repetitive Questions in Studies Yield Bad Data</span> <span><span>ilseu</span></span> <span><time datetime="2022-01-28T13:56:59-08:00" title="Friday, January 28, 2022 - 13:56">Fri, 01/28/2022 - 13:56</time> </span> <a href="https://undergradbiz.ucr.edu/news">More News</a> <picture> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/opinion-poll-g9857d9ced_1920.jpeg?h=35d27844&amp;itok=RjE6P9D6 1x" media="all and (min-width: 1401px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/opinion-poll-g9857d9ced_1920.jpeg?h=35d27844&amp;itok=RjE6P9D6 1x" media="all and (min-width: 1025px) and (max-width: 1400px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_m/public/opinion-poll-g9857d9ced_1920.jpeg?h=35d27844&amp;itok=oDE30R0D 1x" media="all and (min-width: 768px) and (max-width: 1024px)" type="image/jpeg" width="1023" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_s/public/opinion-poll-g9857d9ced_1920.jpeg?h=35d27844&amp;itok=RigV8QJ- 1x" type="image/jpeg" width="767" height="767"> <img loading="eager" width="1170" height="450" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/opinion-poll-g9857d9ced_1920.jpeg?h=35d27844&amp;itok=RjE6P9D6" alt="Hand with pen, filling out survey"> </picture> Holly Ober } UCR News <time datetime="2022-01-28T12:00:00Z">January 28, 2022</time> <p>Surveys that ask too many of the same type of question tire respondents and return unreliable data, according to a new UC Riverside-led&nbsp;<a href="https://journals.sagepub.com/doi/abs/10.1177/00222437211073581" rel=" noopener" target="_blank">study</a>.</p> <p>The study found that people tire from questions that vary only slightly and tend to give similar answers to all questions as the survey progresses. Marketers, policymakers, and researchers who rely on long surveys to predict consumer or voter behavior will have more accurate data if they craft surveys designed to elicit reliable, original answers, the researchers suggest.</p> <figure role="group" class="embedded-entity align-right"> <div alt="Ye Li, Assistant Professor of Management, UCR School of Business" data-embed-button="media_browser" data-entity-embed-display="media_image" data-entity-embed-display-settings="{&quot;image_style&quot;:&quot;scale_367&quot;,&quot;image_link&quot;:&quot;file&quot;}" data-entity-type="media" data-entity-uuid="20d94fb3-a38f-4ad0-80bd-011158c20178" data-langcode="en" title="Ye Li, assistant professor of management, UCR School of Business"> <a href="https://undergradbiz.ucr.edu/sites/default/files/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg"><img alt="Ye Li, Assistant Professor of Management, UCR School of Business" loading="lazy" src="https://undergradbiz.ucr.edu/sites/default/files/styles/scale_367/public/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg?itok=KLHcbg0o" title="Ye Li, assistant professor of management, UCR School of Business"> </a> </div> <figcaption>Ye Li, assistant professor of management</figcaption> </figure> <p>“We wanted to know, is gathering more data in surveys always better, or could asking too many questions lead to respondents providing less useful responses as they adapt to the survey,” said first author&nbsp;<a href="https://profiles.ucr.edu/app/home/profile/yeliphd" rel=" noopener" target="_blank">Ye Li</a>, a UC Riverside assistant professor of management. “Could this paradoxically lead to asking more questions but getting worse results?”</p> <p>While it may be tempting to assume more data is always better, the authors wondered if the decision processes respondents use to answer a series of questions might change, especially when those questions use a similar, repetitive format.&nbsp;</p> <p>The research addressed quantitative surveys of the sort typically used in market research, economics, or public policy research that seek to understand people’s values about certain things. These surveys often ask a large number of structurally similar questions.&nbsp;</p> <p>Researchers analyzed four experiments that asked respondents to answer questions involving choice and preference.&nbsp;</p> <p>Respondents in the surveys adapted their decision making as they answer more repetitive, similarly structured choice questions, a process the authors call “adaptation.” This means they processed less information, learned to weigh certain attributes more heavily, or adopted mental shortcuts for combining attributes.&nbsp;</p> <p>In one of the studies, respondents were asked about their preferences for varying configurations of laptops. They were the sort of questions marketers use to determine if customers are willing to sacrifice a bit of screen size in return for increased storage capacity, for example.</p> <p>“When you’re asked questions over and over about laptop configurations that vary only slightly, the first two or three times you look at them carefully but after that maybe you just look at one attribute, such as how long the battery lasts. We use shortcuts. Using shortcuts gives you less information if you ask for too much information,” said Li.</p> <p>While humans are known to adapt to their environment, most methods in behavioral research used to measure preferences have underappreciated this fact.&nbsp;</p> <p>“In as few as six or eight questions people are already answering in such a way that you’re already worse off if you’re trying to predict real-world behavior,” said Li. “In these surveys if you keep giving people the same types of questions over and over, they start to give the same kinds of answers.”</p> <p>The findings suggest some tactics that can increase the validity of data while also saving time and money. Process-tracing, a research methodology that tracks not just the quantity of observations but also their quality, can be used to diagnose adaptation, helping to identify when it is a threat to validity. Adaptation could also be reduced or delayed by repeatedly changing the format of the task or adding filler questions or breaks. Finally, the research suggests that to maximize the validity of preference measurement surveys, researchers could use an ensemble of methods, preferably using multiple means of measurement, such as questions that involve choosing between options available at different times, matching questions, and a variety of contexts.</p> <p>“The tradeoff isn’t always obvious. More data isn’t always better. Be cognizant of the tradeoffs,” said Li. “When your goal is to predict the real world, that’s when it matters.”</p> <p>Li was joined in the research by Antonia Krefeld-Schwalb, Eric J. Johnson, and Olivier Toubia at Columbia University; Daniel Wall at the University of Pennsylvania; and Daniel M. Bartels at the University of Chicago. The paper, “The more you ask, the less you get: When additional questions hurt external validity,” is published in the Journal of Marketing Research and is <a href="https://journals.sagepub.com/doi/abs/10.1177/00222437211073581">available to read</a>.</p> <p>_____________________________________</p> <p><em>Header photo:&nbsp;<a href="https://pixabay.com/photos/opinion-poll-opinion-polling-survey-1594962/" rel=" noopener" target="_blank">andibreit on Pixabay</a></em><br> &nbsp;</p> <p>&nbsp;</p> <div class="tags-title">Tags</div> <div class="tags-list"> <div><a href="https://undergradbiz.ucr.edu/tags/ucr-news" hreflang="en">UCR News</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/ye-li" hreflang="en">Ye Li</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/marketing" hreflang="en">Marketing</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/research-news" hreflang="en">Research News</a></div> </div> <div class="sharing-title">Share This</div><span class="a2a_kit a2a_kit_size_32 addtoany_list" data-a2a-url="https://undergradbiz.ucr.edu/news/2022/01/28/repetitive-questions-bad-data" data-a2a-title="Repetitive Questions in Studies Yield Bad Data"><a class="a2a_button_facebook"></a><a class="a2a_button_x"></a><a class="a2a_button_linkedin"></a><a class="a2a_button_google_plus"></a><a class="a2a_button_email"></a><a class="a2a_button_printfriendly"></a><a class="a2a_dd addtoany_share" aria-label="more options to share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fundergradbiz.ucr.edu%2Fnews%2F2022%2F01%2F28%2Frepetitive-questions-bad-data&amp;title=Repetitive%20Questions%20in%20Studies%20Yield%20Bad%20Data"></a></span><script> (function () { const customClassName = 'show-for-sr'; const targetContainer = document.querySelector('.a2a_kit.addtoany_list'); if (!targetContainer) return; const addClassToLabels = () => { const labels = targetContainer.querySelectorAll('.a2a_label'); if (labels.length > 0) { labels.forEach(label => { if (!label.classList.contains(customClassName)) { label.classList.add(customClassName); } }); console.log('Successfully applied show-for-sr class to AddToAny labels.'); return true; } return false; }; const observerConfig = { childList: true, subtree: true }; const observer = new MutationObserver((mutationsList, observer) => { if (addClassToLabels()) { observer.disconnect(); } }); if (!addClassToLabels()) { observer.observe(targetContainer, observerConfig); } })(); </script> Fri, 28 Jan 2022 21:56:59 +0000 ilseu 1941 at https://undergradbiz.ucr.edu Understanding Why We Do What We Do https://undergradbiz.ucr.edu/news/2022/01/03/professor-helps-students-understand <span>Understanding Why We Do What We Do</span> <span><span>ilseu</span></span> <span><time datetime="2021-12-12T08:55:54-08:00" title="Sunday, December 12, 2021 - 08:55">Sun, 12/12/2021 - 08:55</time> </span> <a href="https://undergradbiz.ucr.edu/news">More News</a> <picture> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/YeLi%20With%20Students%202021.jpg?h=99d704cb&amp;itok=Oyv7oGE3 1x" media="all and (min-width: 1401px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/YeLi%20With%20Students%202021.jpg?h=99d704cb&amp;itok=Oyv7oGE3 1x" media="all and (min-width: 1025px) and (max-width: 1400px)" type="image/jpeg" width="1170" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_m/public/YeLi%20With%20Students%202021.jpg?h=99d704cb&amp;itok=T1Njp56Z 1x" media="all and (min-width: 768px) and (max-width: 1024px)" type="image/jpeg" width="1023" height="450"> <source srcset="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_s/public/YeLi%20With%20Students%202021.jpg?h=99d704cb&amp;itok=zyTNXmV7 1x" type="image/jpeg" width="767" height="767"> <img loading="eager" width="1170" height="450" src="https://undergradbiz.ucr.edu/sites/default/files/styles/article_header_l/public/YeLi%20With%20Students%202021.jpg?h=99d704cb&amp;itok=Oyv7oGE3" alt="Dr. Ye Li with graduate students, UCR School of Business"> </picture> Darin Estep <time datetime="2022-01-03T12:00:00Z">January 03, 2022</time> <p>Professor Ye Li knows why you are checking Twitter instead of working on that project that’s due next week.</p> <figure role="group" class="embedded-entity align-right"> <div alt="Ye Li, Assistant Professor of Management, UCR School of Business" data-embed-button="media_browser" data-entity-embed-display="media_image" data-entity-embed-display-settings="{&quot;image_style&quot;:&quot;scale_367&quot;,&quot;image_link&quot;:&quot;file&quot;}" data-entity-type="media" data-entity-uuid="20d94fb3-a38f-4ad0-80bd-011158c20178" data-langcode="en" title="Ye Li, Assistant Professor of Management, UCR School of Business"> <a href="https://undergradbiz.ucr.edu/sites/default/files/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg"><img alt="Ye Li, Assistant Professor of Management, UCR School of Business" loading="lazy" src="https://undergradbiz.ucr.edu/sites/default/files/styles/scale_367/public/Ye%20Li%20UCR%20Biz%20School%20Portraits%20and%20groups%20Spring%202018%20114%20copy.jpg?itok=KLHcbg0o" title="Ye Li, Assistant Professor of Management, UCR School of Business"> </a> </div> <figcaption>Ye Li, assistant professor of management</figcaption> </figure> <p>You might chalk it up to simple procrastination. But Li sees such things through the lens of his research of “intertemporal choices” – and the tradeoffs between immediate and later consequences. As an assistant professor of management in the School of Business, Li helps students understand the implications not just for business but nearly every aspect of life.</p> <p>“I teach the Judgment and Decision Making course, which is at the intersection of economics and psychology,” he says. “I'm not really looking at the decisions we're supposed to be making, which is what most business classes cover, but rather how do people make decisions – the descriptive reality – and then understanding what mistakes people make.”</p> <p>Li has a knack for helping students connect these concepts to real life. It was among the reasons he was recognized as one of the “<a href="https://poetsandquants.com/2020/04/29/2020-best-40-under-40-professors-ye-li-school-university-of-california-riverside-anderson-graduate-school-of-management/?pq-category=business-school-news/">Best 40 Under 40 Professors</a>” in 2020 by Poets &amp; Quants. Li also has been nominated for the UCR Academy of Distinguished Teaching, among <a href="https://profiles.ucr.edu/api/CvAttachment/2095809">other recognitions</a>.</p> <p>His work has been published in journals such as <em>Proceedings of the National Academy of Sciences, Psychological Science, Journal of Behavioral Decision Making, and Annual Review of Psychology</em>. A paper in the <em>Journal of Marketing Research </em>is forthcoming.</p> <h5><br> <strong>Showing an Interest in Students</strong></h5> <p>Students have praised his enthusiasm for robust class participation. They also have noticed that he makes a point to learn the names of every student in every class he teaches. This reflects an interest in students that Li says comes naturally.</p> <p>“So, one big thing that I absolutely have to cop to is that I like giving advice. And I especially like it when students come to me for advice,” he says. “That's why, after class, I always stay to see if anyone has additional questions. I actively invite people to my office hours. I love it when someone comes in, and I can just talk their ear off for half an hour and offer them advice.”</p> <p>That’s important, Li says, especially for the significant number of first-generation students at UCR. Many of these students aren’t familiar with the strategies needed to succeed in higher education.&nbsp;“I try not to be intimidating. So, I think that's a big part of why there's this comfort to come talk to me in the first place,” he says. “And once you reach that connection, you can sense this relief of like, ‘Oh, this professor's a real person. And being able to engage with them one-on-one is not as scary as I expected.’”</p> <h5><br> <strong>An Academic Influence</strong></h5> <p>Li can speak from personal experience about the value of engaging with professors. While an undergrad at California Institute of Technology, he studied and worked with behavioral economics pioneer Colin F. Camerer. This sparked his fascination with the psychology behind economic decision-making.</p> <p>After earning two bachelor of science degrees (business economics and management and electrical engineering) with highest honors, he went on to earn master’s and doctoral degrees in behavioral science at the same graduate school where Camerer studied: the University of Chicago Booth School of Business.</p> <p>“And so, it really was this happenstance that I discovered this field,” he says. “And I just love it. For example, in my daily life, I love playing board games with my kids and my friends, which is all about making decisions.”</p> <h5><br> <strong>Learning from Perspectives</strong></h5> <p>Because he teaches a behavioral science class, he encourages a lot of class discussion.</p> <p>“We all have different perspectives. We make mistakes on one side or on the other side of the coin, and I always try to get the student perspectives in class,” he says. “And I tell people, ‘It's not about having the right answer. It's about having your perspective on things. And even if it happens to be wrong, we will all learn from it.’"</p> <p>In behavioral economics, these perspectives apply to decisions with long-term consequences for business, but they also are evident in everyday life.</p> <p>Li abounds with examples: Whether you should force yourself to finish a meal at a restaurant just because you paid for it (get the doggy bag); or whether you should go running in the morning, as Li does, even though it’s cold and unpleasant (you’ll feel better later); or whether you should accept $10 now versus $20 in three months (the latter is equivalent to a 400% annualized return).</p> <p>“When you frame it that way, people are like, ‘OK, well, if you say it like that, then sure. It seems like I should do the long-term thing.’ And so, a lot of my research here obviously applies to business.”</p> <p>Li encourages students to take a similarly long view, particularly when using their time at UCR.</p> <p>“For the students who really take advantage of their time at UCR,” he says, “I think they can do really great things.”</p> <p>&nbsp;</p> <p>&nbsp;</p> <div class="tags-title">Tags</div> <div class="tags-list"> <div><a href="https://undergradbiz.ucr.edu/tags/ye-li" hreflang="en">Ye Li</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/faculty-spotlight" hreflang="en">faculty spotlight</a></div> <div><a href="https://undergradbiz.ucr.edu/tags/faculty" hreflang="en">faculty</a></div> </div> <div class="sharing-title">Share This</div><span class="a2a_kit a2a_kit_size_32 addtoany_list" data-a2a-url="https://undergradbiz.ucr.edu/news/2022/01/03/professor-helps-students-understand" data-a2a-title="Understanding Why We Do What We Do"><a class="a2a_button_facebook"></a><a class="a2a_button_x"></a><a class="a2a_button_linkedin"></a><a class="a2a_button_google_plus"></a><a class="a2a_button_email"></a><a class="a2a_button_printfriendly"></a><a class="a2a_dd addtoany_share" aria-label="more options to share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fundergradbiz.ucr.edu%2Fnews%2F2022%2F01%2F03%2Fprofessor-helps-students-understand&amp;title=Understanding%20Why%20We%20Do%20What%20We%20Do"></a></span><script> (function () { const customClassName = 'show-for-sr'; const targetContainer = document.querySelector('.a2a_kit.addtoany_list'); if (!targetContainer) return; const addClassToLabels = () => { const labels = targetContainer.querySelectorAll('.a2a_label'); if (labels.length > 0) { labels.forEach(label => { if (!label.classList.contains(customClassName)) { label.classList.add(customClassName); } }); console.log('Successfully applied show-for-sr class to AddToAny labels.'); return true; } return false; }; const observerConfig = { childList: true, subtree: true }; const observer = new MutationObserver((mutationsList, observer) => { if (addClassToLabels()) { observer.disconnect(); } }); if (!addClassToLabels()) { observer.observe(targetContainer, observerConfig); } })(); </script> Sun, 12 Dec 2021 16:55:54 +0000 ilseu 1866 at https://undergradbiz.ucr.edu