-
Notifications
You must be signed in to change notification settings - Fork 76
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dnnc config arg #585
base: dev
Are you sure you want to change the base?
Dnnc config arg #585
Conversation
Release v0.1.0
Release v0.1.1
Release v0.1.2
Release v0.1.3
Release v0.1.4
Release v0.1.4
Release v0.1.5
Release v0.1.6
Release v0.1.7
Release v0.1.8
Release v0.1.9
Release v0.1.10
Release v0.2.0
Release v0.2.1
Release v0.2.2
Release v0.3.0
Release v0.3.1
Release 0.4.0
Release v0.4.1
Release v0.5.0
Release v0.6.0
Release v0.6.1
Release v0.6.2
Release v0.7.0
Release v0.8.0
Release v0.9.0
… classes supported
annotators/dnnc_intents/Readme.md
Outdated
@@ -0,0 +1,2 @@ | |||
DNNC intent classifier. | |||
Source: https://github.com/deeppavlov/DeepPavlov/blob/master/deeppavlov/configs/classifiers/few_shot_roberta.json |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
другой формат ридми немного - посмотри по аналогии сделай, пожалуйста
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Можно уточнить, по аналогии с чем? У разных скиллов и аннотаторов ридми разные
|
||
LOGREG_DIR = "/root/.deeppavlov/downloads/logreg_files" | ||
try: | ||
model = build_model(os.getenv("CONFIG"), download=True) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
у тебя тут вроде скачивается модель. Но почему у тебя куча файликов всяких добавлено - надо убрать их и скачивать тоже
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
tar.gz убрал
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
так а pkl почему оставил? и что за огромные jso, которые даже на гитхабе не открываются? их бы тоже убрать в скачивание
logger = logging.getLogger(__name__) | ||
|
||
|
||
supported_intents = ["tell_joke", "are_you_a_bot", "meaning_of_life", "oos"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
почему это здесь? это должно быть частью конфиг файла. Ну то есть чтобы задать названия классов тоже в рамках конфига
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
добавил
url: http://dnnc-intents:8218/model | ||
dialog_formatter: | ||
name: state_formatters.dp_formatters:preproc_last_human_utt_dialog | ||
skill_name: dnnc_intents |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
это не так работает. Убери этот параметр отсюда и из пайплайн конфа
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Параметр skill_name убрал. В пайплайн конфе в dnnc_intents его и нет
@@ -0,0 +1,25 @@ | |||
FROM deeppavlov/base-gpu:0.17.5 | |||
|
|||
RUN pip install git+https://github.com/deeppavlov/DeepPavlov.git@1.3.0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
а базового докер образа поновее сразу нет? чтобы не переставлять, а сразу взять новый? если нет, напиши Феде запрос на такой, пожалуйста, в паблик канале слака.
|
||
app = Flask(__name__) | ||
if os.getenv("CONFIG") == "classifier.json": | ||
labels = [k.split("\t")[0] for k in open(f"{LOGREG_DIR}/classes.dict", "r").readlines()] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
а почему так? почему не универсальное обращение
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
лучше бы было единообразное обращение в обоих случаях
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
плюс хочется, чтобы если человек хочет весь список доступных интентов детектить, ему не надо было все перечислять в классес, а можно было просто классес убрать и все
|
||
LOGREG_DIR = "/root/.deeppavlov/downloads/logreg_files" | ||
try: | ||
model = build_model(os.getenv("CONFIG"), download=True) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
так а pkl почему оставил? и что за огромные jso, которые даже на гитхабе не открываются? их бы тоже убрать в скачивание
No description provided.