2023/2024 University of Leeds NLP • Deep Learning • Transformers
This dissertation explores fine-grained emotion detection from text by building a hybrid deep learning architecture that combines contextual embeddings with sequential and local feature learning. The work follows a structured data-mining approach and evaluates performance through multiple experiments and tuning.
Develop a robust classifier capable of detecting and classifying emotions expressed in text by leveraging a hybrid model: RoBERTa + RNN (LSTM) + CNN + Transformer + FNN.
The project uses the GoEmotions dataset (Reddit comments) with 27 emotion categories + neutral, designed for fine-grained emotion recognition and multi-label annotation.
The pipeline includes: data acquisition → preprocessing (tokenization, cleaning, normalization) → encoding with RoBERTa tokenizer → model training/evaluation → deployment integration.
Experiments explored hyperparameter tuning (epochs, batch size) and transfer learning. The tuned hybrid model achieved improved accuracy compared to the initial setup, and transfer learning further boosted performance.
Accuracy: ~58.71%
After tuning epochs/batch size and evaluation setup.
Accuracy: ~62.37% / 65.22%
Shows potential gains with pretrained transfer.
GitHub Repository: github.com/sc23mm/MSc-Project
Report PDF: View Dissertation Report (Place your PDF in the correct path or update this link.)