# MPAI-MMC Automatic Speech Recognition


This code refers to the implementation of the MPAI-NNW under MPAI-AIF, as described in the [AIMs](https://mpai.community/standards/mpai-mmc/v2-2/ai-modules/automatic-speech-recognition/.

### Guide to the ASR code #1

The code takes Speech Objects from MMC-AUS and generates Text Segments (called text transcripts). It uses the whisper-large-v3 model to convert an input Speech Object (speaker’s turn) into a Text Segment (here called text transcript). Disfluencies (e.g., repetitions, repairs, filled pauses) are often omitted. The Whisper reference document is available.

The MMC-ASR Reference Software is found at the MPAI gitlab site. Use of this AI Modules is for developers who are familiar with Python, Docker, RabbitMQ, and downloading models from HuggingFace. The Reference Software contains:

    1. src: a folder with the Python code implementing the AIM
    2. Dockerfile: a Docker file containing only the libraries required to build the Docker image and run the container
    3. requirements.txt: dependencies installed in the Docker image
    4. README.md: commands for cloning https://huggingface.co/openai/whisper-large-v3

Library: https://github.com/linto-ai/whisper-timestamped

### Guide to the ASR code #2

Use of this AI Modules is for developers who are familiar with Python and downloading models from HuggingFace,

A wrapper for the Whisper NN Module:

    1. Manages input files and parameters: Speech Object
    2. Performs Speech Recognition on each Speech Object by executing the Whisper Module.
    3. Outputs Recognised Text.

The MMC-ASR Reference Software is found at the NNW gitlab  site (registration required). It contains:

    1. The python code implementing the AIM.
    2. The required libraries are: pytorch and transformers (HuggingFace).