Similarity-based Random Partition Distribution for Clustering Functional Data

Random partition distribution is a crucial tool for model-based clustering. This study advances the field of random partition in the context of functional spatial data, focusing on the challenges posed by hourly population data across various regions and dates. We propose an extended generalized Dirichlet process, named the similarity-based generalized Dirichlet process (SGDP), to address the limitations of simple random partition distributions (e.g., those induced by the Dirichlet process), such as an overabundance of clusters. This model prevents producing excess clusters as well as incorporates pairwise similarity information to ensure a more accurate and meaningful grouping. The theoretical properties of SGDP are studied. Then, SGDP is applied to a real-world dataset of hourly population flows in 500$\rm{m}^2$ meshes in the central part of Tokyo. In this empirical context, SGDP excelled at detecting meaningful patterns in the data while accounting for spatial nuances. The results underscore the adaptability and utility of the method, showcasing its prowess in revealing intricate spatiotemporal dynamics. This study's findings contribute significantly to urban planning, transportation, and policy-making by providing a helpful tool for understanding population dynamics and their implications.