Skip to content

A language detector which can identify types of language based on written texts

Notifications You must be signed in to change notification settings

IvanLauLinTiong/language-detector

Repository files navigation

Language Detector

app.png

This app used pretrained xlm-roberta-base model and fine-tuned on the common_language dataset under PyTorch and HuggingFace framework. It can detect 45 languages based on user text input and is hosted on HuggingFace space platform.

Fine-tuned Model

Download: language-detection-fine-tuned-on-xlm-roberta-base

Demo

Try it out: language detector

Files Description

  • hf_demo

    • repo for HuggingFace space app demo
  • datset

    • folder where train and test dataset will be downloaded to.
  • xlm_roberta_base_commonlanguage_language_detector.ipynb

    • notebook for fine-tuning xlm-roberta-base model

About

A language detector which can identify types of language based on written texts

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published