Automated building and analysis of Ukrainian Twitter corpus for toxic text detection

Abstract

Toxic text detection is an emerging area of study in Inter-net linguistics and corpus linguistics. The relevance of the topic can be explained by the lack of Ukrainian social media text corpora that are publicly available. Research involves building of the Ukrainian Twitter corpus by means of scraping; collective annotation of 'toxic/non-toxic' texts; construction of the obscene words dictionary for future feature engineering; and models training for the task of text classi cation (com-paring Logistic Regression, Support Vector Machine, and Deep Neural Network).

Description

Keywords

toxic text detection, text corpus, Twitter

Citation

Bobrovnyk K. Automated building and analysis of Ukrainian Twitter corpus for toxic text detection / Kateryna Bobrovnyk // Computational Linguistics and Intelligent Systems. — Lviv : Lviv Politechnic Publishing House, 2019. — Vol 2 : Proceedings of the 3nd International conference, COLINS 2019. Workshop, Kharkiv, Ukraine, April 18-19, 2019. — P. 55–56. — (Student section).