Compact visualization techniques such as dense pixel displays find application in displaying spatio-temporal datasets in a space-efficient way. While mostly focusing on feature development, the depiction of spatial distributions of the movers in these techniques is often traded against better scalability towards the number of moving objects. We propose SpatialRugs, a technique that can be applied to reintroduce spatial positions in such approaches by applying 2D colormaps to determine object locations and which enables users to follow spatio-temporal developments even in non-spatial representations. Geared towards collective movement datasets, we evaluate the applicability of several color maps and discuss limitations. To mitigate perceptional artifacts, we also present and evaluate a custom, time-aware color smoothing method.