在线评论内容生成的自动文本生成器效率研究

Efficiency of automatic text generators for online review content generation

Technological Forecasting and Social Change · 2023
被引 28
ABS 3

中文导读

研究GPT2生成的虚假评论对现有检测分类器准确率的影响,发现高创造性参数会降低分类器性能,且生成器训练数据影响检测效果,但情感极性无显著作用。

Abstract

The evolution of Artificial Intelligence has led to the appearance of automatic text generators able to closely resemble human writing, endangering the development of e-commerce and the consumer confidence. Thus, it is critical to deeply understand how these text generators work to present the presence of deceptive reviews. This paper analyzes one of the most popular text generators, GPT2 (Generative Pre-trained Transformer 2), and studies its effectivity compared to human-generated reviews using previously published classifiers trained to distinguish between real and deceptive reviews. One parameter of the model is the so-called temperature, which determines how deterministic the model is. The temperature adjusts the probability distribution of the words in the model, so that a higher temperature translates into a higher degree of inventiveness in the generation of the texts. Findings reveal (i) that automatically-generated deceptive reviews worsen the accuracy of existing classifiers, this effect being accentuated by the degree of inventiveness; (ii) that their performance depends on the data used to train the generator; and (iii) that the sentiment polarity has no effect on the performance of detection classifiers.

电子商务自然语言处理人工智能消费者行为