„… 34 Chapter 3Superpixels with Temporal Consistency This chapter describes a new system for creating …” „… the video domain, the tem- 36 Chapter 3 Superpixels with Temporal Consistency (a) (b) t (c) Figure 3.2 …” „… the color and the spatial domain. 38 Chapter 3 Superpixels with Temporal Consistency sp at ial ce nt …”

„… competitive spatio-temporal segmentation quality, it decreases the consistency of the superpixel flow with the …” „… that do not rely on label consistency. Finally, the advantage of the increased temporal length of the …” „… the video domain by extending the feature space with a temporal dimension. To integrate the temporal …”

„… a variant of the approach proposed in this thesis and same colors indicates temporal consistency …” „… oversegmentation can be classified as either generating superpixels with temporal consistency (e.g. [14, 82, 46 …” „… vectors between frames [34]. The relation between supervoxels and superpixels with temporal consistency …”

„… indicator for the temporal consistency of a segmentation, it has to be evaluated in conjunction with other …” „… all indication of the temporal consistency of a segmentation. Thereby, an independent superpixel …” „… metrics like the temporal extent and the label consistency. Therefore, a reliable evaluation in this case …”

„… 978-3-18-386110-1, ISSN 0178-9627, ¤ 48,00/VDI-Mitgliederpreis ¤ 43,20. Keywords: Superpixels – Temporal Consistency …” „… Horn/Schunck . . . . . . . . . . . . . . . 31 3 Superpixels with Temporal Consistency 34 3.1 System Overview …” „… ensure the consistency of the superpixel flow with the image movement while considering visual occlusion …”

„… displacement. To encourage more temporal consistency, the authors of [46] proposed to utilize optical flow to …” „… optimization, the sliding window is shifted by one frame along the temporal axis of the video volume. Thereby …” „… ). Same color means temporal connectedness. In the middle row, the superpixels are torn away by the motion …”

„… . (iii) Ensuring temporal consistency within the data association is difficult due to the limited …” „… natural representation of trajectories of the disjoint paths formulation. Ensuring temporal consistency by …” „… main approach presented in this thesis addresses a comprehensive integration of the spatio-temporal …”

„… linked across frames to form trajectories, ensuring consistency between all detections of an identity and …” „… consistency of an entire trajectory, which we call Higher-Order Multiple Object Tracking (HO-MOT). Problem …” „… (1.2), without further simplifications, is an explicit HO-MOT formulation, as the consistency of an …”

„… . Hence, we also enforce spatio-temporal consistency if two detections are associated with the same ID …” „… head and body detections by modeling non-maxima suppression as well as overlap consistency between …” „… we directly model the grouping of features to different persons; this ensures consistency within each …”

„… models that exploit temporal consistency only between detections that directly follow each other in a …” „… of the detector as well as wrongly assessed temporal consistencies between detections can lead to …” „… consecutive ones, contribute to the evaluation of the consistency of a trajectory. To comprehensively exploit …”

„… deviations of detections from the estimated motion trajectory. This enforces spatio-temporal consistency of …” „… object. This chapter presents an HO-MOT method that incorporates long-range temporal interactions and …” „… and allows an elegant mathematical formulation for long-range temporal interactions. Lifted edges 1 …”

„… problem, as it enables to naturally model the temporal information of a video recording. Definition 2.8. A …” „… Chapter 3 formulates implicit HO-MOT as a binary quadratic problem such that the consistency between all …” „… pairwise features. Early MOT methods relied mainly on hand-crafted spatio-temporal features [52, 61, 106 …”

„… (self-supervised) methods likeMoCo [129], BYOL [130], and SimCLR [131]. Consistency-enforcing meth-ods have also …” „… domain [117].The methods most similar to our problem are consistency-enforcingmethods for image …” „… relative pose consistencyIn an unsupervised domain adaptation scenario, data is available fromthe labeled …”

„… take. This includes consistency regularization, entropyregularization, label propagation, and …” „… more details on adversarial discriminativedomain adaptation and in Chapter 4 on consistency …” „… [45] or temporal information [26] can be used. Inthis review we will focus on the application we …”

„… for Head PoseEstimation Using Relative Pose Consistency.” In: IEEE Transactionson Biometrics, Behavior …” „… with Consistency and Confidence.”In: Advances in Neural Information Processing Systems 33 …” „… . Valpola. “Mean teachers are better role mod-els: Weight-averaged consistency targets improve …”

„… bone length consistency prior with a learned pose basis and temporal priors. Since a pretrained basis …” „… term was proposed. It regularizes the temporal bone length changes over time by a variance minimization …” „… plausible from implausible human poses. Additionally, to enforce consistency with the 2D detections a …”

„… formulation of temporal priors to resolve depth ambiguities. This is known as the Structure-from-Motion …” „… considered, temporal constraints are no longer possible. Instead, the only knowledge about the scene is the …” „… contributions look at the problem from two perspectives: 1. Human movements are subject to several temporal …”

„… reconstruction the main idea of this part is to exploit temporal properties of human motions in combination with …” „… . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 4 exploiting temporal properties 40 4.1 Periodic and Non-periodic Constraints …” „… resolve these inherent ambiguities the main idea of this part is to exploit temporal properties of human …”

„… “temporal” CSP (TCSP) variables represent time points or intervals (or more generally, totally ordered …” „… continuous variables) and the constraints represent temporal relations. A specific type of TCSP is obtained …” „… consistency of these “Binary TCSPs” (B-TCSP) is NP-complete [7]. One observes that the problem of selecting …”