Mainak Ghosh, M.Sc.

Further Publications, Press Articles, Interviews

Hagerer, Gerhard; Moeed, Abdul; Dugar, Sumit; Gupta, Sarthak; Ghosh, Mainak; Danner, Hannah; Mitevski, Oliver; Nawroth, Andreas; Groh, Georg (2020). An Evaluation of Progressive Neural Networks for Transfer Learning in Natural Language Processing, in: Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), Marseille, 1376-1381.

• A major challenge in modern neural networks is the utilization of previous knowledge for new tasks in an effective manner, otherwise known as transfer learning. Fine-tuning, the most widely used method for achieving this, suffers from catastrophic forgetting. The problem is often exacerbated in natural language processing (NLP). In this work, we assess progressive neural networks (PNNs) as an alternative to fine-tuning. The evaluation is based on common NLP tasks such as sequence labeling and text classification. By gauging PNNs across a range of architectures, datasets, and tasks, we observe improvements over the baselines throughout all experiments.
  
• Conference Paper
• Conference Volume
• Event: 12th Language Resources and Evaluation Conference, Marseille, 2020-05-11

Discussion Papers

Erhardt, Sebastian; Ghosh, Mainak; Buunk, Erik; Rose, Michael; Harhoff, Dietmar (2022). Logic Mill - A Knowledge Navigation System, arXiv preprint 2301.00200.

• Logic Mill is a scalable and openly accessible software system that identifies semantically similar documents within either one domain-specific corpus or multi-domain corpora. It uses advanced Natural Language Processing (NLP) techniques to generate numerical representations of documents. Currently it leverages a large pre-trained language model to generate these document representations. The system focuses on scientific publications and patent documents and contains more than 200 million documents. It is easily accessible via a simple Application Programming Interface (API) or via a web interface. Moreover, it is continuously being updated and can be extended to text corpora from other domains. We see this system as a general-purpose tool for future research applications in the social sciences and other domains.
• https://doi.org/10.48550/arXiv.2301.00200