Legal HeBERT: A BERT-based NLP Model for Hebrew Legal, Judicial and Legislative Texts

Abstract

In this work in progress, we offer a BERT-based Hebrew NLP model for the legal, legislative and judicial domains. To the best of our knowledge, this is the first ever BERT-based Hebrew NLP model developed for legal tasks. We illustrate the superiority of our model when applied to both supervised and unsupervised tasks in these domains. Our model is freely offered for public use.