Malcolm Ocean's roamblog

January 17th, 2023

edited 2023-01-17 · open in Roam
  • idea of building an app to help people listen to each other when in a chat convo
    • from here
    • > Digital user representations and perspective taking in mediated communication
    • > Human social interaction is increasingly mediated by technology, with many of the signals present in traditional face-to-face interaction being replaced by digital representations (e.g., avatars, nameplates, and emojis). To communicate successfully, participants in a conversational interaction must keep track of the identities of their co-participants, as well as the “common ground” they share with each—the dynamically changing set of mutually held beliefs, knowledge, and suppositions. Perceptual representations of interlocutors may serve as important memory cues to shared information in communicative interaction (Horton & Gerrig, 2016; O’Shea, Martin, & Barr, in press). Our main question concerns how digital representations of users across different interaction modalities (text, voice, video chat) influence the development of and access to common ground during communication. To examine the impact of digital user representations on real-time language production and comprehension, the project will use a variety of behavioral methods including visual world eye-tracking (Tanenhaus, et al. 1995), latency measures, as well as analysis of speech/text content. In the first phase of the project, we will examine how well people can keep track of who said what during a discourse depending on the abstract versus rich nature of user representations (e.g., from abstract symbols to dynamic avatar-based user representations), and how these representations impact people’s ability to tailor messages to their interlocutors, as well as to correctly interpret a communicator’s intended meaning. For example, in one such study, we will test participants’ ability to track “conceptual pacts” (Brennan & Clark, 1996) with a pair of interlocutors during an interactive task where each partner appears (1) through a video stream; (2) as an animated avatar; or (3) as a static user icon. In the second phase, we will examine whether the nature of the user representation during encoding affects the long-term retention of common ground information. In support of the behavioural experiments, this project will also involve developing a range of conversational agents, both embodied and speech-only, and defining appropriate behaviour models to allow those agents to take part in the studies. The defined behaviour will incorporate both verbal interaction as well as non-verbal actions, to replicate the full richness of human face-to-face conversation (Foster, 2019; Bavelas et al., 1997). Insights and techniques developed during the project are intended to improve interfaces for computer-mediated human communication.
      • References
        • Bavelas, J. B., Hutchinson, S., Kenwood, C., & Matheson, D. H. (1997). Using Face-to-face Dialogue as a Standard for Other Communication Systems. Canadian Journal of Communication, 22(1).
        • Brennan, S. E., & Clark, H. H. (1996). Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 1482.
        • Foster, M. E. (2019). Face-to-face conversation: why embodiment matters for conversational user interfaces. Proceedings of the 1st International Conference on Conversational User Interfaces – CUI ’19. the 1st International Conference.
        • Horton, W. S., & Gerrig, R. J. (2016). Revisiting the memory‐based processing approach to common ground. Topics in Cognitive Science, 8, 780-795.
        • O’Shea, K. J., Martin, C. R., & Barr, D. J. (2021). Ordinary memory processes in the design of referring expressions. Journal of Memory and Language, 117, 104186.
        • Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634.
  • fragments from a groupchat, re shame, forgiveness, apology, double bind
    • I think there's something messed up in how we or society at large or something thinks of wrongdoing and forgiveness. Never sin, never do wrong. But also, it's going to happen. You're going to do wrong. So hopefully, most of the time, we own up to it, apologize, atone, and they forgive.
    • But that doesn't happen. If people don't forgive, then you cannot admit wrongdoing. If people keep hurting you, despite what they say, you can't forgive
    • Idk exactly what's what or if I'm pointing at the thing well enough, but there's some kind of double bind there
    • If you won't be forgiven, you can't feel shame
    • If you can't feel shame, you can't confront those times you've done wrong and feel how what you did was wrong
    • I feel like normally you still can feel shame even if you're not forgiven, which is why shame is 'high stakes', i.e shame comes from the risk of not being forgiven
    • i like that you're pointing to how there's something there about how wrongdoing and shame is bound together (edited)
    • or are you more pointing to the forgiveness bit?
    • My take on this is that it's actually not safe to feel shame, and especially to broadcast it, if in a social environment where paths to forgiveness aren't available
    • And actually, the paths to forgiveness have to be pretty flexible for it to be safe
    • (flexible as in many ways to forgiveness, or ease of forgiveness?)
    • There're a lot of environments where shame will be treated as evidence of wrongdoing
    • Not necessarily ease but you have to work with the person to work through their shame on mutually agreeable terms
    • Because e.g. people do stuff for reasons - so probably there's gonna be objections to the rule they broke
    • And that should be accounted for
    • There're a lot of environments where shame will be treated as evidence of wrongdoing
    • Shame is evidence of wrongdoing though, and that's ok? That should be ok? Showing shame and contrition when appropriately should be viewed positively, but instead people lean on getting mad because of the wrongdoing?
    • In an ideal world, when someone does something wrong, they show shame and contrition, things change to account for the wrongdoing if necessary (whether fixing things or preventing future wrongdoing or something else), people are forgiven if possible, things go back to a new normal
    • I guess also one should act in such a way that others would prefer to tell you if they did something wrong and apologize than to keep it secret from you
    • Hmm I dunno about that
    • Shame is probably always evidence of wrongdoing according to the person feeling the shame, but they might've picked up the idea that what they did was bad from all kinds of untrustworthy sources (e.g. early childhood lol)
    • Wrongdoing can also be bilateral, but if one person feels and owns up to shame, I think it requires a good amount of sophistication on the part of the people around to not default to blaming that person
  • this tweet connects with ~ep3 of Awakening from the Meaning Crisis talking about the judeochristian god as "the god of the open future"
      • levels of awareness in a convo:
        1. total autopilot confabulation
        2. sincere figuring things out but in some sense not aware of being in a conversation
        3. aware of conversational dynamics but taking certain assumptions for granted (~circling)
        4. aware of