Document Data Analysis via Machine/Deep Learning techniques
Abstract
Job advert aggregators gather millions of adverts every single day, by scraping job
boards and various other sources across the globe. Aggregators are getting visited by
millions of active job seekers every day, that wish to find their perfect match in order
to land a job, according to their skills and field of studies. With such high volume of
visitors seeking to find their optimal match, proper categorization of job adverts
becomes a must have feature for any aggregator in order to help their users have a
smooth experience while searching for their perfect job match. However, due to the
huge volume of data and the nature of the job adverts themselves, where each job
description can possibly match with multiple categories and similar positions might
have huge variations in the language used to describe them, the proper classification
of such data comes to be a hard task. In this work, various machine learning, deep
learning, data processing and data augmentation methods are used in order to try and
classify job adverts in one of the twenty-nine categories of the Adzuna company.
Towards this, a real-world private dataset, consisting of about 234.000 job adverts
from the United Kingdom, containing titles, descriptions and hand-crafted categories,
is provided by the Adzuna company. Our main results show that Deep Learning
models outperform all kinds of conventional Machine Learning approaches such as
Support Vector Classifiers, Multinomial Naïve Bayes and Decision Trees. In addition,
training custom word2vec embeddings helps achieve higher accuracy metrics
compared to using pretrained embeddings such as Glove 100. However, the model
selection (choosing a Deep Learning model against a conventional Machine Learning
model) is of higher impact towards better metrics than using embeddings and
sequences of words. The model that achieved the highest weighted average F1-Score
(80%) and the highest testing accuracy (80.5%) was the Feedforward Neural Network
trained on Bag of Words (TF-IDF) representations of lowercased and stemmed job
descriptions. Specifically, this model achieved a weighted average Precision of 80%,
a weighted average Recall of 81%