README.md 2.13 KB
Newer Older
Niccolò Pretto's avatar
Niccolò Pretto committed
1
2
# Audio Analyzer

Matteo's avatar
update    
Matteo committed
3
4
5
6
7
8
[![MPAI CAE-ARP](https://img.shields.io/badge/MPAI%20CAE--ARP-gray?style=for-the-badge&logo=AppleMusic&logoColor=cyan&link=https://mpai.community/standards/mpai-cae/about-mpai-cae/)](https://mpai.community/standards/mpai-cae/about-mpai-cae/)

Implements the Technical Specification of [MPAI CAE-ARP](https://mpai.community/standards/mpai-cae/about-mpai-cae/#Figure2) *Audio Analyser* AIM, providing:
- 2 Irregularity Files
- Audio Files

Matteo's avatar
Matteo committed
9
10
11
12
13
# TODO

- [x] calculate the video/audio offset

- [ ] Read the input file(s?) and generate a list of audio files
Matteo's avatar
update    
Matteo committed
14
15
16
17
- [x] Split each file different channels
- [x] extract silence from each channel
- [x] generate an irregularity for each silence found
- [x] save the list of irregularities as an irregularity file
Matteo's avatar
Matteo committed
18

Matteo's avatar
update    
Matteo committed
19
- [x] get the irregularity file from video analyzer
Matteo's avatar
Matteo committed
20

Matteo's avatar
update    
Matteo committed
21
22
- [x] merge the irregularity files
- [x] extract the audio from every irregularity
Matteo's avatar
Matteo committed
23
- [ ] for each audio irregularity, make a classification
Matteo's avatar
update    
Matteo committed
24
- [x] save everything in a single irregularity file
Matteo's avatar
Matteo committed
25
26
27
28
29
30
31
32
33
34
35
36
37
38

Sample irregularityFile from Audio to Video Analyzer:
```json
{
    "Offset": 0,
    "Irregularities": [
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "a",
            "TimeLabel": "00:00:00.000",
        },
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "a",
Matteo's avatar
update    
Matteo committed
39
            "TimeLabel": "00:00:02.000",
Matteo's avatar
Matteo committed
40
41
42
43
        },
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "a",
Matteo's avatar
update    
Matteo committed
44
            "TimeLabel": "00:00:05.000",
Matteo's avatar
Matteo committed
45
46
47
        }
    ]
}
Niccolò Pretto's avatar
Niccolò Pretto committed
48
49
```

Matteo's avatar
Matteo committed
50
51
52
53
54
55
56
Sample irregularityFile from Video to Audio Analyzer:
```json
{
    "Irregularities": [
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "v",
Matteo's avatar
update    
Matteo committed
57
            "TimeLabel": "00:00:10.000",
Matteo's avatar
Matteo committed
58
59
60
61
        },
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "v",
Matteo's avatar
update    
Matteo committed
62
            "TimeLabel": "00:00:20.000",
Matteo's avatar
Matteo committed
63
64
65
66
        },
        {
            "IrregularityID": "09859d16-3c73-4bb0-9c74-91b451e34925",
            "Source": "v",
Matteo's avatar
update    
Matteo committed
67
            "TimeLabel": "00:00:30.000",
Matteo's avatar
Matteo committed
68
69
70
71
        }
    ]
}
```