Mainak Ghosh, M.Sc.

Articles in Refereed Journals

Chatterjee, Chirantan; Chugunova, Marina; Ghosh, Mainak; Singhal, Abhay; Wang, Lucy Xiaolu (2023). Human Mediation Leads to Higher Compliance in Digital Mental Health: Field Evidence from India, Frontiers in Behavioral Economics, 2. DOI

Conference papers

Hagerer, Gerhard; Kirchhoff, Martin; Danner, Hannah; Pesch, Robert; Ghosh, Mainak; Roy, Archishman; Jiaxi, Zhao; Groh, Georg (2021). SocialVisTUM: An Interactive Visualization Toolkit for Correlated Neural Topic Models on Social Media Opinion Mining, in: Galia Angelova et al. (ed.), Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021) - Deep Learning for Natural Language Processing Methods and Applications, INCOMA Ltd., Shoumen 2021, 475-482.

• Recent research in opinion mining proposedword embedding-based topic modeling methods that provide superior coherence compared to traditional topic modeling. In this paper, we demonstrate how these methods can be used to display correlated topic models on social media texts using SocialVisTUM, our proposed interactive visualization toolkit. It displays a graph with topics as nodes and their correlations as edges. Further details are displayed interactively to support the exploration of large text collections, e.g., representative words and sentences of topics, topic and sentiment distributions, hierarchical topic clustering, and customizable, predefined topic labels. The toolkit optimizes automatically on custom data for optimal coherence. We show a working instance of the toolkit on data crawled from English social media discussions about organic food consumption. The visualization confirms findings of a qualitative consumer research study. SocialVisTUM and its training procedures are accessible online.
• Event: International Conference "Recent Advances in Natural Language Processing, Shoumen, 2021-09-01

Further Publications, Press Articles, Interviews

Hagerer, Gerhard; Moeed, Abdul; Dugar, Sumit; Gupta, Sarthak; Ghosh, Mainak; Danner, Hannah; Mitevski, Oliver; Nawroth, Andreas; Groh, Georg (2020). An Evaluation of Progressive Neural Networks for Transfer Learning in Natural Language Processing, in: Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), Marseille, 1376-1381.

• A major challenge in modern neural networks is the utilization of previous knowledge for new tasks in an effective manner, otherwise known as transfer learning. Fine-tuning, the most widely used method for achieving this, suffers from catastrophic forgetting. The problem is often exacerbated in natural language processing (NLP). In this work, we assess progressive neural networks (PNNs) as an alternative to fine-tuning. The evaluation is based on common NLP tasks such as sequence labeling and text classification. By gauging PNNs across a range of architectures, datasets, and tasks, we observe improvements over the baselines throughout all experiments.
  
• Conference Paper
• Conference Volume
• Event: 12th Language Resources and Evaluation Conference, Marseille, 2020-05-11

Discussion Papers

Ghosh, Mainak; Erhardt, Sebastian; Rose, Michael; Buunk, Erik; Harhoff, Dietmar (2024). PaECTER: Patent-level Representation Learning using Citation-informed Transformers, arXiv preprint 2402.19411. DOI

• PaECTER is a publicly available, open-source document-level encoder specific for patents. We fine-tune BERT for Patents with examiner-added citation information to generate numerical representations for patent documents. PaECTER performs better in similarity tasks than current state-of-the-art models used in the patent domain. More specifically, our model outperforms the next-best patent specific pre-trained language model (BERT for Patents) on our patent citation prediction test dataset on two different rank evaluation metrics. PaECTER predicts at least one most similar patent at a rank of 1.32 on average when compared against 25 irrelevant patents. Numerical representations generated by PaECTER from patent text can be used for downstream tasks such as classification, tracing knowledge flows, or semantic similarity search. Semantic similarity search is especially relevant in the context of prior art search for both inventors and patent examiners. PaECTER is available on Hugging Face.

Erhardt, Sebastian; Ghosh, Mainak; Buunk, Erik; Rose, Michael; Harhoff, Dietmar (2022). Logic Mill - A Knowledge Navigation System, arXiv preprint 2301.00200.

• Logic Mill is a scalable and openly accessible software system that identifies semantically similar documents within either one domain-specific corpus or multi-domain corpora. It uses advanced Natural Language Processing (NLP) techniques to generate numerical representations of documents. Currently it leverages a large pre-trained language model to generate these document representations. The system focuses on scientific publications and patent documents and contains more than 200 million documents. It is easily accessible via a simple Application Programming Interface (API) or via a web interface. Moreover, it is continuously being updated and can be extended to text corpora from other domains. We see this system as a general-purpose tool for future research applications in the social sciences and other domains.
• https://doi.org/10.48550/arXiv.2301.00200