About Scene Deduplication

For a master file with different version files of itself, you can use the Deep Analysis feature to compare them and create a new file without the duplicated scenes. This process is called Scene Deduplication.

Workflow

To perform a Scene Deduplication analysis:

1. Open the title that contains the video file on which you want to run the scan.

2. Navigate to the Deep Analysis tab and click New comparison. The File comparison modal is displayed.

3. In the Comparison name field, enter a relevant name for your new comparison scan.

   Note

   Each comparison name is unique.

4. Under Comparison type, select Deduplication.

5. Under Video files available on title, select the files you want to compare by clicking Add to comparison list. The files are included in the Comparison list section.

   Note

   We recommend you tag your files to easily identify them for a clean workflow.

6. Specify which is the source to compare from, by selecting the Master toggle.

7. Optional: Under Advanced settings, you can select the type of Detection method and Analysis level you want to use.

   When selecting the Discrete Cosine Transform (DCT) detection method, you gain access to a set of fine-tuning options designed to refine your scene analysis.

   These options include:

   • DCT Threshold: The DCT threshold controls the sensitivity of scene comparisons. Adjusting this value impacts how slight differences between scenes are treated. A lower threshold enhances sensitivity, which can identify scenes with subtle variations as distinct. Conversely, a higher threshold reduces sensitivity, potentially categorizing different scenes as similar.
   • Small False Negatives: Enabling this option focuses on removing segments with frames falling within the threshold. This is done with a constraint on segment size. It assumes well-aligned frames and uses a permissive threshold to prevent misalignment. This option is optimized for rapid performance.
   • 2nd Edit Distance: This feature enhances the matching of frames by considering a larger threshold for different segments. Additionally, it merges segments if matched frames are within the maximum segment size. The 2nd edit distance approach reduces misalignment issues by employing a flexible threshold. Keep in mind that this option may increase processing time, especially for different versions.
   • Scene Mapping: The scene mapping option influences whether entire shots are returned as segments. This results in larger and fewer segments, enhancing readability and playback. It is recommended to keep this option enabled, as it contributes to faster performance.

8. Once you have added the master and all the version files you want to compare, click Start. The comparison process begins, and is displayed on the Deep Analysis tab.

9. Once the comparison process is completed, the scan results are displayed.

10. Click on the comparison analysis name to review the results.

    In the Comparison results components section, the files that were compared are displayed. You can easily navigate through the version files you compared with the master file by selecting them in the Compare Version drop-down.

    In the Identified variants section, the identified clips are displayed. For each clip you have the option to approve or reject the option by selecting or deselecting the Approve toggle.

    In the editor, the master and version files are displayed side by side which allows you to double check the comparison results.

    In the Variant editor section, you can adjust the marker settings per your needs.

    In addition, the timeline is synced so you can review the player for both the master and the version file.

11. Once you are satisfied with the results, click Generate Composition Playlist. The Generate Composition Playlist modal is displayed.

12. In the Workflow name field, enter a relevant name for your workflow.

13. Under MediaWarp profile select the profile you want to use.

    Note

    It is important to have a previously configured MediaWarp profile so you can create the IMF.

14. Select the essence(s) you want to use to generate the Composition Playlist.

15. Enter the Composition Playlist Name and S3 Path for each essence selected. Note: You can also select Suggest to automatically populate the S3 Path field.

16. Click Generate Composition Playlist. The Composition Playlist generation process begins.

    Note

    The Composition Playlist generation process is running in the background. If you want to see the progress, navigate to the Workflows menu and click on it.

17. Once the process is completed, the results are displayed on the title, under the Composition Playlists tab.