Zagazig University Digital Repository
Home
Thesis & Publications
All Contents
Publications
Thesis
Graduation Projects
Research Area
Research Area Reports
Search by Research Area
Universities Thesis
ACADEMIC Links
ACADEMIC RESEARCH
Zagazig University Authors
Africa Research Statistics
Google Scholar
Research Gate
Researcher ID
CrossRef
BERT-CNN: A Deep Learning Model for Detecting Emotions from Text
Faculty
Computer Science
Year:
2021
Type of Publication:
ZU Hosted
Pages:
2943-2961
Authors:
Ahmed Raafat Abass Mohamed Saliem
Staff Zu Site
Abstract In Staff Site
Journal:
in CMC-Computers, Materials & Continua Tech Science Press
Volume:
71
Keywords :
BERT-CNN: , Deep Learning Model , Detecting Emotions
Abstract:
Due to the widespread usage of social media in our recent daily lifestyles, sentiment analysis becomes an important field in pattern recognition andNatural Language Processing (NLP). In this field, users’ feedback data on a specific issue are evaluated and analyzed.Detecting emotions within the text is therefore considered one of the important challenges of the current NLP research. Emotions have been widely studied in psychology and behavioral science as they are an integral part of the human nature. Emotions describe a state of mind of distinct behaviors, feelings, thoughts and experiences. The main objective of this paper is to propose a new model named BERT-CNN to detect emotions from text. This model is formed by a combination of the Bidirectional Encoder Representations from Transformer (BERT) and the Convolutional Neural networks (CNN) for textual classification. This model embraces the BERT to train the word semantic representation language model. According to the word context, the semantic vector is dynamically generated and then placed into the CNN to predict the output. Results of a comparative study proved that the BERT-CNN model overcomes the state-of-art baseline performance produced by different models in the literature using the semeval 2019 task3 dataset and ISEAR datasets. The BERTCNN model achieves an accuracy of 94.7% and an F1-score of 94% for semeval2019 task3 dataset and an accuracy of 75.8% and an F1-score of 76% for ISEAR dataset.
Author Related Publications
Ahmed Raafat Abass Mohamed Saliem, "Using General Regression with Local Tuning for Learning Mixture Models from Incomplete Data Sets", ScienceDirect, 2010
More
Ahmed Raafat Abass Mohamed Saliem, "On determining efficient finite mixture models with compact and essential components for clustering data", ScienceDirect, 2013
More
Ahmed Raafat Abass Mohamed Saliem, "Unsupervised learning of mixture models based on swarm intelligence and neural networks with optimal completion using incomplete data", ScienceDirect, 2012
More
Ahmed Raafat Abass Mohamed Saliem, "Adaptive competitive learning neural networks", ScienceDirect, 2013
More
Ahmed Raafat Abass Mohamed Saliem, "Using Incremental General Regression Neural Network for Learning Mixture Models from Incomplete Data", ScienceDirect, 2011
More
Department Related Publications
Ahmed Salah Mohamed Mostafa, "Lazy-Merge: A Novel Implementation for Indexed Parallel K-Way In-Place Merging", IEEE, 2016
More
Ibrahiem Mahmoud Mohamed Elhenawy, "A Review on the Applications of Neutrosophic Sets", Source: Journal of Computational and Theoretical Nanoscience, Volume 13, Number 1, January 2016, pp. 936-944(9), 2016
More
Doaa El-Shahat Barakat Mohammed, "A modified nature inspired meta-heuristic whale optimization algorithm for solving 0–1 knapsack problem", Springer Berlin Heidelberg, 2017
More
Ibrahiem Mahmoud Mohamed Elhenawy, "A novel whale optimization algorithm for cryptanalysis in Merkle-Hellman cryptosystem", Springer US, 2018
More
Abdallah Gamal abdallah mahmoud, "A Bipolar Neutrosophic Multi Criteria Decision Making Framework for Professional Selection", MDPI, 2020
More
جامعة المنصورة
جامعة الاسكندرية
جامعة القاهرة
جامعة سوهاج
جامعة الفيوم
جامعة بنها
جامعة دمياط
جامعة بورسعيد
جامعة حلوان
جامعة السويس
شراقوة
جامعة المنيا
جامعة دمنهور
جامعة المنوفية
جامعة أسوان
جامعة جنوب الوادى
جامعة قناة السويس
جامعة عين شمس
جامعة أسيوط
جامعة كفر الشيخ
جامعة السادات
جامعة طنطا
جامعة بنى سويف