We review the state of research on empathy in our field and identify the following issues: (1) empathy definitions are absent or abstract, which (2) leads to low construct validity and reproducibility. Moreover, (3) emotional empathy is overemphasized, skewing our focus to a narrow subset of simplified tasks. We believe these issues hinder research progress and argue that current directions will benefit from a clear conceptualization that includes operationalizing cognitive empathy components. Our main objectives are to provide insight and guidance on empathy conceptualization for NLP research objectives and to encourage researchers to pursue the overlooked opportunities in this area, highly relevant, e.g., for the clinical and educational sector.
@inproceedings{lahnala-etal-2022-acritical,title={A Critical Reflection and Forward Perspective on Empathy and Natural Language Processing},author={Lahnala, Allison and Welch, Charles and Jurgens, David and Flek, Lucie},booktitle={Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP)},year={2022},publisher={Association for Computational Linguistics},}
EMNLP
Unifying Data Perspectivism and Personalization: An Application to Social Norms
Plepi, Joan, Neuendorf, Béla, Flek, Lucie, and Welch, Charles
In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2022
Instead of using a single ground truth for language processing tasks, several recent studies have examined how to represent and predict the labels of the set of annotators. However, often little or no information about annotators is known, or the set of annotators is small. In this work, we examine a corpus of social media posts about conflict from a set of 13k annotators and 210k judgements of social norms. We provide a novel experimental setup that applies personalization methods to the modeling of annotators and compare their effectiveness for predicting the perception of social norms. We further provide an analysis of performance across subsets of social situations that vary by the closeness of the relationship between parties in conflict, and assess where personalization helps the most.
@inproceedings{plepi-etal-2022-unifying,title={Unifying Data Perspectivism and Personalization: An Application to Social Norms},author={Plepi, Joan and Neuendorf, B{\'e}la and Flek, Lucie and Welch, Charles},booktitle={Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP)},year={2022},publisher={Association for Computational Linguistics},}
NLP+CSS
Understanding Interpersonal Conflict Types and their Impact on Perception Classification
Welch, Charles, Plepi, Joan, Neuendorf, Béla, and Flek, Lucie
In Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science 2022
Studies on interpersonal conflict have a long history and contain many suggestions for conflict typology. We use this as the basis of a novel annotation scheme and release a new dataset of situations and conflict aspect annotations. We then build a classifier to predict whether someone will perceive the actions of one individual as right or wrong in a given situation, outperforming previous work on this task. Our analyses include conflict aspects, but also generated clusters, which are human validated, and show differences in conflict content based on the relationship of participants to the author. Our findings have important implications for understanding conflict and social norms.
@inproceedings{welch2022understanding,title={Understanding Interpersonal Conflict Types and their Impact on Perception Classification},author={Welch, Charles and Plepi, Joan and Neuendorf, B{\'e}la and Flek, Lucie},booktitle={Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science},year={2022},}
GEM
Nearest Neighbor Language Models for Stylistic Controllable Generation
Trotta, Severino, Flek, Lucie, and Welch, Charles
In Proceedings of the Second Workshop on Generation, Evaluation & Metrics (GEM) 2022
Recent language modeling performance has been greatly improved by the use of external memory. This memory encodes the context so that similar contexts can be recalled during decoding. This similarity depends on how the model learns to encode context, which can be altered to include other attributes, such as style. We construct and evaluate an architecture for this purpose, using corpora annotated for politeness, formality, and toxicity. Through extensive experiments and human evaluation we demonstrate the potential of our method to generate text while controlling style. We find that style-specific datastores improve generation performance, though results vary greatly across styles, and the effect of pretraining data and specific styles should be explored in future work.
@inproceedings{trotta2022nearest,title={Nearest Neighbor Language Models for Stylistic Controllable Generation},author={Trotta, Severino and Flek, Lucie and Welch, Charles},booktitle={Proceedings of the Second Workshop on Generation, Evaluation & Metrics (GEM)},year={2022},}
NAACL
Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy
Lahnala, Allison, Welch, Charles, Neuendorf, Béla, and Flek, Lucie
In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2022
Large pre-trained neural language models have supported the effectiveness of many NLP tasks, yet are still prone to generating toxic language hindering the safety of their use. Using empathetic data, we improve over recent work on controllable text generation that aims to reduce the toxicity of generated text. We find we are able to dramatically reduce the size of fine-tuning data to 7.5-30k samples while at the same time making significant improvements over state-of-the-art toxicity mitigation of up to 3.4% absolute reduction (26% relative) from the original work on 2.3m samples, by strategically sampling data based on empathy scores. We observe that the degree of improvements is subject to specific communication components of empathy. In particular, the more cognitive components of empathy significantly beat the original dataset in almost all experiments, while emotional empathy was tied to less improvement and even underperforming random samples of the original data. This is a particularly implicative insight for NLP work concerning empathy as until recently the research and resources built for it have exclusively considered empathy as an emotional concept.
@inproceedings{lahnala-etal-2022-mitigating,title={Mitigating Toxic Degeneration with Empathetic Data: {E}xploring the Relationship Between Toxicity and Empathy},author={Lahnala, Allison and Welch, Charles and Neuendorf, Béla and Flek, Lucie},booktitle={Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies},year={2022},publisher={Association for Computational Linguistics},}
WASSA
CAISA at WASSA 2022: Adapter-Tuning for Empathy Prediction
Lahnala, Allison, Welch, Charles, and Flek, Lucie
In Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis 2022
We build a system that leverages adapters, a light weight and efficient method for leveraging large language models to perform the task Empathy and Distress prediction tasks for WASSA 2022. In our experiments, we find that stacking our empathy and distress adapters on a pre-trained emotion classification adapter performs best compared to full fine-tuning approaches and emotion feature concatenation. We make our experimental code publicly available.
@inproceedings{lahnala-etal-2022-caisa,title={CAISA at WASSA 2022: Adapter-Tuning for Empathy Prediction},author={Lahnala, Allison and Welch, Charles and Flek, Lucie},booktitle={Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis},year={2022},publisher={Association for Computational Linguistics},}
ACL
Leveraging Similar Users for Personalized Language Modeling with Limited Data
Welch, Charles, Gu, Chenxi, Kummerfeld, Jonathan K., Pérez-Rosas, Verónica, and Mihalcea, Rada
In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics 2022
Personalized language models are designed and trained to capture language patterns specific to individual users. This makes them more accurate at predicting what a user will write. However, when a new user joins a platform and not enough text is available, it is harder to build effective personalized language models. We propose a solution for this problem, using a model trained on users that are similar to a new user. In this paper, we explore strategies for finding the similarity between new users and existing ones and methods for using the data from existing users who are a good match. We further explore the trade-off between available data for new users and how well their language can be modeled.
@inproceedings{welch-etal-2022-leveraging,title={{L}everaging {S}imilar {U}sers for {P}ersonalized {L}anguage {M}odeling with {L}imited {D}ata},author={Welch, Charles and Gu, Chenxi and Kummerfeld, Jonathan K. and P{\'e}rez-Rosas, Ver{\'o}nica and Mihalcea, Rada},booktitle={Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics},year={2022},publisher={Association for Computational Linguistics},}
ACL
Knowledge Enhanced Reflection Generation for Counseling Dialogues
Shen, Siqi, Pérez-Rosas, Verónica, Welch, Charles, Poria, Soujanya, and Mihalcea, Rada
In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics 2022
In this paper, we study the effect of commonsense and domain knowledge while generating responses in counseling conversations using retrieval and generative methods for knowledge integration. We propose a pipeline that collects domain knowledge through web mining, and show that retrieval from both domain-specific and commonsense knowledge bases improves the quality of generated responses. We also present a model that incorporates knowledge generated by COMET using soft positional encoding and masked self-attention.
We show that both retrieved and COMET-generated knowledge improve the system’s performance as measured by automatic metrics and also by human evaluation. Lastly, we present a comparative study on the types of knowledge encoded by our system showing that \textitcausal and \textitintentional relationships benefit the generation task more than other types of commonsense relations.
@inproceedings{shen-etal-2022-leveraging,title={Knowledge Enhanced Reflection Generation for Counseling Dialogues},author={Shen, Siqi and P{\'e}rez-Rosas, Ver{\'o}nica and Welch, Charles and Poria, Soujanya and Mihalcea, Rada},booktitle={Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics},year={2022},publisher={Association for Computational Linguistics},}
2021
Thesis
Leveraging Longitudinal Data for Personalized Prediction and Word Representations
@phdthesis{welch2021leveraging,title={Leveraging Longitudinal Data for Personalized Prediction and Word Representations},author={Welch, Charles},year={2021},}
ACL
Exploring Self-Identified Counseling Expertise in Online Support Forums
Lahnala, Allison, Zhao, Yuntian, Welch, Charles, Kummerfeld, Jonathan K., An, Lawrence C, Resnicow, Kenneth, Mihalcea, Rada, and Pérez-Rosas, Verónica
In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 2021
A growing number of people engage in online health forums, making it important to understand the quality of the advice they receive. In this paper, we explore the role of expertise in responses provided to help-seeking posts regarding mental health. We study the differences between (1) interactions with peers; and (2) interactions with self-identified mental health professionals. First, we show that a classifier can distinguish between these two groups, indicating that their language use does in fact differ. To understand this difference, we perform several analyses addressing engagement aspects, including whether their comments engage the support-seeker further as well as linguistic aspects, such as dominant language and linguistic style matching. Our work contributes toward the developing efforts of understanding how health experts engage with health information- and support-seekers in social networks. More broadly, it is a step toward a deeper understanding of the styles of interactions that cultivate supportive engagement in online communities.
@inproceedings{lahnala-etal-2021-exploring,title={Exploring Self-Identified Counseling Expertise in Online Support Forums},author={Lahnala, Allison and Zhao, Yuntian and Welch, Charles and Kummerfeld, Jonathan K. and An, Lawrence C and Resnicow, Kenneth and Mihalcea, Rada and P{\'e}rez-Rosas, Ver{\'o}nica},booktitle={Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021},year={2021},address={Online},publisher={Association for Computational Linguistics},url={https://aclanthology.org/2021.findings-acl.392},doi={10.18653/v1/2021.findings-acl.392},pages={4467--4480},}
arXiv
Modeling Proficiency with Implicit User Representations
Breitwieser, Kim, Lahnala, Allison, Welch, Charles, Flek, Lucie, and Potthast, Martin
We introduce the problem of proficiency modeling: Given a user’s posts on a social media platform, the task is to identify the subset of posts or topics for which the user has some level of proficiency. This enables the filtering and ranking of social media posts on a given topic as per user proficiency. Unlike experts on a given topic, proficient users may not have received formal training and possess years of practical experience, but may be autodidacts, hobbyists, and people with sustained interest, enabling them to make genuine and original contributions to discourse. While predicting whether a user is an expert on a given topic imposes strong constraints on who is a true positive, proficiency modeling implies a graded scoring, relaxing these constraints. Put another way, many active social media users can be assumed to possess, or eventually acquire, some level of proficiency on topics relevant to their community. We tackle proficiency modeling in an unsupervised manner by utilizing user embeddings to model engagement with a given topic, as indicated by a user’s preference for authoring related content. We investigate five alternative approaches to model proficiency, ranging from basic ones to an advanced, tailored user modeling approach, applied within two real-world benchmarks for evaluation.
@article{breitwieser2021modeling,title={Modeling Proficiency with Implicit User Representations},author={Breitwieser, Kim and Lahnala, Allison and Welch, Charles and Flek, Lucie and Potthast, Martin},journal={arXiv preprint arXiv:2110.08011},year={2021},}
2020
NLP COVID-19
Expressive Interviewing: A Conversational System for Coping with COVID-19
Welch, Charles, Lahnala, Allison, Perez-Rosas, Veronica, Shen, Siqi, Seraj, Sarah, An, Larry, Resnicow, Kenneth, Pennebaker, James, and Mihalcea, Rada
In Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020 2020
The ongoing COVID-19 pandemic has raised concerns for many regarding personal and public health implications, financial security and economic stability. Alongside many other unprecedented challenges, there are increasing concerns over social isolation and mental health. We introduce Expressive Interviewing – an interview-style conversational system that draws on ideas from motivational interviewing and expressive writing. Expressive Interviewing seeks to encourage users to express their thoughts and feelings through writing by asking them questions about how COVID-19 has impacted their lives. We present relevant aspects of the system’s design and implementation as well as quantitative and qualitative analyses of user interactions with the system. In addition, we conduct a comparative evaluation with a general purpose dialogue system for mental health that shows our system potential in helping users to cope with COVID-19 issues.
@inproceedings{welch-etal-2020-expressive,title={Expressive Interviewing: A Conversational System for Coping with {COVID}-19},author={Welch, Charles and Lahnala, Allison and Perez-Rosas, Veronica and Shen, Siqi and Seraj, Sarah and An, Larry and Resnicow, Kenneth and Pennebaker, James and Mihalcea, Rada},booktitle={Proceedings of the 1st Workshop on {NLP} for {COVID}-19 (Part 2) at {EMNLP} 2020},year={2020},address={Online},publisher={Association for Computational Linguistics},url={https://aclanthology.org/2020.nlpcovid19-2.6},doi={10.18653/v1/2020.nlpcovid19-2.6},}
SIGDIAL
Counseling-Style Reflection Generation Using Generative Pretrained Transformers with Augmented Context
Shen, Siqi, Welch, Charles, Mihalcea, Rada, and Pérez-Rosas, Verónica
In Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2020
We introduce a counseling dialogue system that seeks to assist counselors while they are learning and refining their counseling skills. The system generates counselors’reflections – i.e., responses that reflect back on what the client has said given the dialogue history. Our method builds upon the new generative pretrained transformer architecture and enhances it with context augmentation techniques inspired by traditional strategies used during counselor training. Through a set of comparative experiments, we show that the system that incorporates these strategies performs better in the reflection generation task than a system that is just fine-tuned with counseling conversations. To confirm our findings, we present a human evaluation study that shows that our system generates naturally-looking reflections that are also stylistically and grammatically correct.
@inproceedings{shen-etal-2020-counseling,title={Counseling-Style Reflection Generation Using Generative Pretrained Transformers with Augmented Context},author={Shen, Siqi and Welch, Charles and Mihalcea, Rada and P{\'e}rez-Rosas, Ver{\'o}nica},booktitle={Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue},year={2020},address={1st virtual meeting},publisher={Association for Computational Linguistics},url={https://aclanthology.org/2020.sigdial-1.2},pages={10--20},}
EMNLP
Improving Low Compute Language Modeling with In-Domain Embedding Initialisation
Welch, Charles, Mihalcea, Rada, and Kummerfeld, Jonathan K.
In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2020
Many NLP applications, such as biomedical data and technical support, have 10-100 million tokens of in-domain data and limited computational resources for learning from it. How should we train a language model in this scenario? Most language modeling research considers either a small dataset with a closed vocabulary (like the standard 1 million token Penn Treebank), or the whole web with byte-pair encoding. We show that for our target setting in English, initialising and freezing input embeddings using in-domain data can improve language model performance by providing a useful representation of rare words, and this pattern holds across several different domains. In the process, we show that the standard convention of tying input and output embeddings does not improve perplexity when initializing with embeddings trained on in-domain data.
@inproceedings{welch-etal-2020-improving,title={Improving Low Compute Language Modeling with In-Domain Embedding Initialisation},author={Welch, Charles and Mihalcea, Rada and Kummerfeld, Jonathan K.},booktitle={Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},year={2020},address={Online},publisher={Association for Computational Linguistics},url={https://aclanthology.org/2020.emnlp-main.696},doi={10.18653/v1/2020.emnlp-main.696},pages={8625--8634},}
EMNLP
Compositional Demographic Word Embeddings
Welch, Charles, Kummerfeld, Jonathan K., Pérez-Rosas, Verónica, and Mihalcea, Rada
In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2020
Word embeddings are usually derived from corpora containing text from many individuals, thus leading to general purpose representations rather than individually personalized representations. While personalized embeddings can be useful to improve language model performance and other language processing tasks, they can only be computed for people with a large amount of longitudinal data, which is not the case for new users. We propose a new form of personalized word embeddings that use demographic-specific word representations derived compositionally from full or partial demographic information for a user (i.e., gender, age, location, religion). We show that the resulting demographic-aware word representations outperform generic word representations on two tasks for English: language modeling and word associations. We further explore the trade-off between the number of available attributes and their relative effectiveness and discuss the ethical implications of using them.
@inproceedings{welch-etal-2020-compositional,title={Compositional Demographic Word Embeddings},author={Welch, Charles and Kummerfeld, Jonathan K. and P{\'e}rez-Rosas, Ver{\'o}nica and Mihalcea, Rada},booktitle={Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},year={2020},address={Online},publisher={Association for Computational Linguistics},url={https://aclanthology.org/2020.emnlp-main.334},doi={10.18653/v1/2020.emnlp-main.334},pages={4076--4089},}
COLING
Exploring the Value of Personalized Word Embeddings
Welch, Charles, Kummerfeld, Jonathan K., Pérez-Rosas, Verónica, and Mihalcea, Rada
In Proceedings of the 28th International Conference on Computational Linguistics 2020
In this paper, we introduce personalized word embeddings, and examine their value for language modeling. We compare the performance of our proposed prediction model when using personalized versus generic word representations, and study how these representations can be leveraged for improved performance. We provide insight into what types of words can be more accurately predicted when building personalized models. Our results show that a subset of words belonging to specific psycholinguistic categories tend to vary more in their representations across users and that combining generic and personalized word embeddings yields the best performance, with a 4.7% relative reduction in perplexity. Additionally, we show that a language model using personalized word embeddings can be effectively used for authorship attribution.
@inproceedings{welch-etal-2020-exploring,title={Exploring the Value of Personalized Word Embeddings},author={Welch, Charles and Kummerfeld, Jonathan K. and P{\'e}rez-Rosas, Ver{\'o}nica and Mihalcea, Rada},booktitle={Proceedings of the 28th International Conference on Computational Linguistics},year={2020},address={Barcelona, Spain (Online)},publisher={International Committee on Computational Linguistics},url={https://aclanthology.org/2020.coling-main.604},doi={10.18653/v1/2020.coling-main.604},pages={6856--6862},}
2019
CICLing
Look Who’s Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog
Welch, Charles, Pérez-Rosas, Verónica, Kummerfeld, Jonathan K, and Mihalcea, Rada
We examine a large dialog corpus obtained from the conversation history of a single individual with 104 conversation partners. The corpus consists of half a million instant messages, across several messaging platforms. We focus our analyses on seven speaker attributes, each of which partitions the set of speakers, namely: gender; relative age; family member; romantic partner; classmate; co-worker; and native to the same country. In addition to the content of the messages, we examine conversational aspects such as the time messages are sent, messaging frequency, psycholinguistic word categories, linguistic mirroring, and graph-based features reflecting how people in the corpus mention each other. We present two sets of experiments predicting each attribute using (1) short context windows; and (2) a larger set of messages. We find that using all features leads to gains of 9-14% over using message text only.
@article{welch2019look,title={Look Who's Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog},author={Welch, Charles and P{\'e}rez-Rosas, Ver{\'o}nica and Kummerfeld, Jonathan K and Mihalcea, Rada},publisher={Conference on Computational Linguistics and Intelligent Text Processing},booktitle={Proceedings of the 20th International Conference on Computational Linguistics and Intelligent Text Processing},year={2019},}
IEEE
Learning from Personal Longitudinal Dialog Data
Welch, Charles, Pérez-Rosas, Verónica, Kummerfeld, Jonathan K, and Mihalcea, Rada
We explore the use of longitudinal dialog data for two dialog prediction tasks: next message prediction and response time prediction. We show that a neural model using personal data that leverages a combination of message content, style matching, time features, and speaker attributes leads to the best results for both tasks, with error rate reductions of up to 15% compared to a classifier that relies exclusively on message content and to a classifier that does not use personal data.
@article{welch2019learning,title={Learning from Personal Longitudinal Dialog Data},author={Welch, Charles and P{\'e}rez-Rosas, Ver{\'o}nica and Kummerfeld, Jonathan K and Mihalcea, Rada},journal={IEEE Intelligent Systems},volume={34},number={4},pages={16--23},year={2019},publisher={IEEE},}
2018
LREC
World Knowledge for Abstract Meaning Representation Parsing
Welch, Charles, Kummerfeld, Jonathan K., Feng, Song, and Mihalcea, Rada
In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) 2018
In this paper we explore the role played by world knowledge in semantic parsing. We look at the types of errors that currently exist in a state-of-the-art Abstract Meaning Representation (AMR) parser, and explore the problem of how to integrate world knowledge to reduce these errors. We look at three types of knowledge from (1) WordNet hypernyms and super senses,(2) Wikipedia entity links, and (3) retraining a named entity recognizer to identify concepts in AMR. The retrained entity recognizer is not perfect and cannot recognize all concepts in AMR and we examine the limitations of the named entity features using a set of oracles. The oracles show how performance increases if it can recognize different subsets of AMR concepts. These results show improvement on multiple fine-grained metrics, including a 6% increase in named entity F-score, and provide insight into the potential of world knowledge for future work in Abstract Meaning Representation parsing.
@inproceedings{welch-etal-2018-world,title={World Knowledge for {A}bstract {M}eaning {R}epresentation Parsing},author={Welch, Charles and Kummerfeld, Jonathan K. and Feng, Song and Mihalcea, Rada},booktitle={Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)},year={2018},address={Miyazaki, Japan},publisher={European Language Resources Association (ELRA)},url={https://aclanthology.org/L18-1492},}
TAC
Entity and Event Extraction from Scratch Using Minimal Training Data
Wendlandt, Laura, Wilson, Steve R, Ignat, Oana, Welch, Charles, Zhang, Li, Wang, Mingzhe, Deng, Jia, and Mihalcea, Rada
Understanding current world events in real-time involves sifting through news articles, tweets, photos, and videos from many different perspectives. The goal of the DARPA-funded AIDA project1 is to automate much of this process, building a knowledge base that can be queried to strategically generate hypotheses about different aspects of an event. We are participating in this project as a TA1 team, and we are building the first step of the overall system. Given raw multimodal input (eg, text, images, video), our goal is to generate a knowledge graph with entities, events, and relations.
@article{wendlandt2018entity,title={Entity and Event Extraction from Scratch Using Minimal Training Data},author={Wendlandt, Laura and Wilson, Steve R and Ignat, Oana and Welch, Charles and Zhang, Li and Wang, Mingzhe and Deng, Jia and Mihalcea, Rada},year={2018},publisher={Text Analysis Conference},booktitle={Proceedings of the Text Analysis Conference 2018},}
2016
COLING
Targeted Sentiment to Understand Student Comments
Welch, Charles, and Mihalcea, Rada
In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers 2016
We address the task of targeted sentiment as a means of understanding the sentiment that students hold toward courses and instructors, as expressed by students in their comments. We introduce a new dataset consisting of student comments annotated for targeted sentiment and describe a system that can both identify the courses and instructors mentioned in student comments, as well as label the students’ sentiment toward those entities. Through several comparative evaluations, we show that our system outperforms previous work on a similar task.
@inproceedings{welch-mihalcea-2016-targeted,title={Targeted Sentiment to Understand Student Comments},author={Welch, Charles and Mihalcea, Rada},booktitle={Proceedings of {COLING} 2016, the 26th International Conference on Computational Linguistics: Technical Papers},year={2016},address={Osaka, Japan},publisher={The COLING 2016 Organizing Committee},url={https://aclanthology.org/C16-1233},pages={2471--2481},}
IVA
Targeted Sentiment Analysis: Identifying Student Sentiment Toward Courses and Instructors
Welch, Charles, and Mihalcea, Rada
In Proceedings of Intelligent Virtual Agents Conference 2016
We examine targeted sentiment analysis for the purpose of building a dialog system for academic advising. For dialog tasks such as course selection it is important to recognize the entities (ie, courses and instructors) and the sentiment that students express toward them. We examine the effect of domain specific features, and show performance improvements for both the entity recognition and sentiment analysis tasks over baseline methods. A discussion of errors provides insight into the limitations of our method and directions for future work.
@inproceedings{welch2016targeted,title={Targeted Sentiment Analysis: Identifying Student Sentiment Toward Courses and Instructors},author={Welch, Charles and Mihalcea, Rada},publisher={Intelligent Virtual Agents Conference},booktitle={Proceedings of Intelligent Virtual Agents Conference},year={2016},}
2015
AAAI
What Women Want: Analyzing Research Publications to Understand Gender Preferences in Computer Science
Mihalcea, Rada, and Welch, Charles
In Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence 2015
While the number of women who choose to pursue computer science and engineering careers is growing, men continue to largely outnumber them. In this paper, we describe a data mining approach that relies on a large collection of scientific articles to identify differences in gender interests in this field. Our hope is that through a better understanding of the differences between male and female preferences, we can enable more effective outreach and retention, and consequently contribute to the growth of the number of women who choose to pursue careers in this field.
@inproceedings{mihalcea2015women,title={What Women Want: Analyzing Research Publications to Understand Gender Preferences in Computer Science},author={Mihalcea, Rada and Welch, Charles},booktitle={Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence},year={2015},}
2014
Serdica
Classification of Paintings by Artist, Movement, and Indoor Setting Using MPEG-7 Descriptor Features
Image classification is an essential problem for content based image retrieval and image processing. Visual properties can be extracted from images in the form of MPEG-7 descriptors. Statistical methods can use these properties as features and be used to derive an effective method of classifying images by evaluating a minimal number of properties used in the MPEG-7 descriptor. Classification by artist, artistic movement, and indoor/outdoor setting is examined using J48, J48 graft, best first, functional, and least absolute deviation tree algorithms. An improved accuracy of 11% in classification of artist and 17% in classification of artistic movement over previous work is achieved using functional trees. In addition classification by indoor/outdoor setting shows that the method can be applied to new categories. We present an analysis of generated decision trees that shows edge histogram information is most prominent in classification of artists and artistic movements, while scalable color information is most useful for classification of indoor/outdoor setting.
@article{welch2014classification,title={Classification of Paintings by Artist, Movement, and Indoor Setting Using MPEG-7 Descriptor Features},author={Welch, Charles},journal={Serdica Journal of Computing},volume={8},number={1},pages={15--28},year={2014},}
2013
ANT
An Efficient Algorithm for Finding Large Localizable Regions in Wireless Sensor Networks
In this paper, we find a novel algorithm that can identify large localizable regions within a wireless sensor network. This algorithm is based on graph rigidity. We find a new technique to annex localizable subgraphs to other localizable subgraphs, thus expanding the localization. We simulate the results on wireless sensor graphs of various topologies. Our results indicate that we are able to localize almost all nodes in wireless sensor networks of various radii. Using MDS-MAP techniques in conjuction with this algorithm, wireless sensor networks can be localized with very small number of anchor nodes.
@article{kanchi2013efficient,title={An Efficient Algorithm for Finding Large Localizable Regions in Wireless Sensor Networks},author={Kanchi, Saroja and Welch, Charles},journal={Procedia Computer Science},volume={19},pages={1081--1087},year={2013},publisher={Elsevier},}