- 5 Kwiecień 2008
- 10 550
- 2 669
- 405
- Odznaki
- 205
- QNAP
- TS-x77
- Ethernet
- 1 GbE
Symptoms
Cause
Media studio recognises the speech of an audio track and turns it into a new subtitle track. Without an API key, the built-in Whisper engine does this on the NAS itself, and the audio never leaves the NAS. On the first run, the NAS downloads a small program and a speech recognition model and keeps both for the next time. The default model, large-v3-turbo, is 574 MB and needs about 1.1 GB of free memory. The small model is 190 MB and needs about 700 MB, but it mishears more words. A NAS whose processor has no AVX2, or an ARM processor, starts with small.
Resolution
Notice & Advise
Ref. links:
Rtorrent 16 guide: Media studio
- A film has no subtitles, and you want subtitles made from its dialogue.
Cause
Media studio recognises the speech of an audio track and turns it into a new subtitle track. Without an API key, the built-in Whisper engine does this on the NAS itself, and the audio never leaves the NAS. On the first run, the NAS downloads a small program and a speech recognition model and keeps both for the next time. The default model, large-v3-turbo, is 574 MB and needs about 1.1 GB of free memory. The small model is 190 MB and needs about 700 MB, but it mishears more words. A NAS whose processor has no AVX2, or an ARM processor, starts with small.
Resolution
- In Files, open the menu of a video file and choose Media studio in the Tools group.
- Right-click the header of an audio track, for example A1, and choose Create subtitles from speech. On a phone, hold the header. The same button is in the Info panel while an audio clip is selected.
- Under Language, pick the language spoken in the film, or Detect automatically. While the model is not on the NAS yet, the window says This model is not on the NAS yet. It downloads the first time it is used (…). It needs about … of free memory.
- If the NAS has little free memory, open Advanced and pick Whisper small under Model. This choice is for this run only.
- Press Create. The status line shows the progress, and Stop ends the job. When the job ends, the project gets a new subtitle track, for example C1.
- The film itself does not change. Save as MKV writes a new film file with this track, and Export in the subtitle track's header menu writes the subtitles alone to a file of their own, for example an
.srt.
Notice & Advise
- Once you save an API key of an outside service in Media library → AI translation and speech, that service recognises the speech by default and receives the clip's audio. The window then says where the audio goes. To use the built-in engine for one run, pick Built-in (on the NAS) under Engine in Advanced. To use it every time, pick it on the same page under Speech recognition (speech → subtitles).
- When the NAS has less free memory than the model needs, the job does not start and says how much it needs. Pick the small model, or stop other apps.
- You can translate the new track: right-click its header and choose Translate subtitles.
Ref. links:
Rtorrent 16 guide: Media studio