BERT

A text analysis Web service for technical articles includes topic identification and keywords extraction. The model of topic identification uses a pre-trained BERT and fine-tuned on the dataset of LinkedInfo.co and questions on Stack Overflow.

Introduction This is a follow up post of Multi-label classification to predict topic tags of technical articles from LinkedInfo.co. We will continute the same task by using BERT. Firstly we’ll just use the embeddings from BERT, and then feed them to the same classification model used in the last post, SVM with linear kenel. The reason of keep using SVM is that the size of the dataset is quite small.