serverless-lambda-docker

Built docker images for Text Summarization and Named Entity Recognition using Hugging Face.

Steps involved:

• create a Python Lambda function with the Serverless Framework.
• add the respective summarization and ner models to our function and create an individual inference pipeline.
• Create a custom docker image for both
• Deploy a custom docker image to Amazon ECR
• Deploy AWS Lambda function with a custom docker image
• Test Serverless APIs

Follow the tutorial at https://www.philschmid.de/serverless-bert-with-huggingface-aws-lambda-docker to create docker images.

Huggung Face models:

• For text summarization: https://huggingface.co/sshleifer/distilbart-cnn-12-6
• For Named Entity Recognition: https://huggingface.co/dslim/bert-base-NER

Creating docker images:

Deploying on AWS ECR

POST urls after deployment

• For summarization: https://eyzkheoq1d.execute-api.us-east-1.amazonaws.com/dev/qa
• For NER : https://ej1c3zhs6g.execute-api.us-east-1.amazonaws.com/dev/qa

Testing using Postman

Summarization

Named Entity Recognition

Link for the codelabs:

https://codelabs-preview.appspot.com/?file_id=1376pofyspTVM8YhhbUKDEpiNaxczACY9KN0wI6lGPEg#0

References:

1. https://github.com/philschmid/serverless-bert-huggingface-aws-lambda-docker
2. https://huggingface.co/dslim/bert-base-NER
3. https://huggingface.co/sshleifer/distilbart-cnn-12-6