Embeddable AI Self-Serve Assets using NLP Library

Assets/Accelerators for Watson NLP (this repo) contains self-serve notebooks and documentation on how to create NLP models using Watson NLP library, how to serve Watson NLP models, and how to make inference requests from custom applications. With an IBM Cloud account a full production sample can be deployed in roughly one hour.

Key Technologies:

• IBM Watson NLP (Natural Language Processing) comes with a wide variety of text processing capabilities, such as emotion analysis and topic modeling. Watson NLP is built on top of the best AI open source software. It provides stable and supported interfaces, it handles a wide range of languages and its quality is enterprise proven. The Watson NLP containers can be deployed with Docker, on various Kubernetes-based platforms, or using cloud-based container services.

Outline

Machine Learning notebooks, tutorials, and datasets focused on supporting a Data Science Engineer are under the ML folder. Assets focused on deployment are under the MLOps folder. Go to the respective folders to learn more about these assets.

• ML Assets
  • Emotion Classification
    • Emotion Classification Tutorial
    • Emotion Classification Pretrained Notebook
    • Emotion Classification Custom Training Notebook
    • Emotion Classification Dataset
  • Entities & Keywords Extraction
    • Entities, Keywords & Phrases Extraction Tutorial
    • Entities, Keywords & Phrases Extraction Notebook
    • Belgrave Hotel Dataset
    • Dorset Hotel Dataset
    • Euston Hotel Dataset
  • Sentiment Analysis
    • Sentiment Analysis Tutorial
    • Sentiment Analysis Pretrained Notebook
    • Sentiment Analysis Fine-tune/Re-training Notebook
    • Sentiment Analysis Dataset
  • Text Classification
    • Consumer Complaint Text Classification Notebook
    • Hotel Reviews Text Classification
  • Topic Modeling
    • Topic Modeling Tutorial
    • Topic Modeling Notebook
    • Topic Modeling Comparison with LDA Notebook
    • PII Extraction - Custom Train Models.ipynb -PII Extraction
    • PII Extraction - Custom-RBR Models.ipynb
    • PII Extraction - Pre-Trained Models.ipynb
    • PII Extraction - Fine-Tuned Models.ipynb
• MLOps Assets
  • Serve Pretrained Models using Docker
  • Serve Custom Models using Docker
  • Serve Models with Standalone Containers on Kubernetes or OpenShift
  • Serve Models with AWS Fargate
  • Serve Models with Azure Container Instances
  • Serve Models with IBM Code Engine
  • Serve Pretrained Models on Kubernetes or OpenShift
  • Serve Custom Models with Kubernetes or OpenShift
  • Serve Models with KServe ModelMesh
  • Create an NLP Python Client

Resources

• IBM Watson NLP Library for Embed
  • Software Announcement
  • Documentation
• IBM Technology Zone assets
  • Embeddable AI
  • Watson NLP - Text Classification
  • Watson NLP - Entities & Keywords extraction
  • Watson NLP - Topic Modeling
  • Watson NLP - Sentiment and Emotion Analysis
  • Watson NLP - Creating Client Applications
  • Watson NLP - Serving Models with Standalone Containers
  • Watson NLP - Serving Models with Kubernetes and OpenShift
• IBM Developer Tutorials
  • Embeddable AI Homepage
  • Set up your Watson NLP Environment
  • Use the Watson NLP Library to Perform Emotion Classification
  • Use the Watson NLP Library to Perform Sentiment Analysis

Team

Created & Architected By

Kunal Sawarkar, Chief Data Scientist

Builders

Michael Spriggs, Principal Architect Shivam Solanki, Senior Advisory Data Scientist Kevin Huang, Sr. ML-Ops Engineer Abhilasha Mangal, Senior Data Scientist Himadri Talukder - Senior Software Engineer

Disclaimer

This framework is developed by Build Lab, IBM Ecosystem. Please note that this content is made available to foster Embeddable AI technology adoption and serve ecosystem partners. The content may include systems & methods pending patent with the USPTO and protected under US Patent Laws. SuperKnowa is not a product but a framework built on the top of IBM watsonx along with other products like LLAMA models from Meta & ML Flow from Databricks. Using SuperKnowa implicitly requires agreeing to the Terms and conditions of those products. This framework is made available on an as-is basis to accelerate Enterprise GenAI applications development. In case of any questions, please reach out to kunal@ibm.com.

Copyright @ 2023 IBM Corporation.