We introduce LongCat-Image, a pioneering open-source and bilingual (Chinese-English) foundation model for image generation, designed to address core challenges in multilingual text rendering, photorealism, deployment efficiency, and developer accessibility prevalent in current leading models. 1) We achieve this through rigorous data curation strategies across the pre-training, mid-training, and SFT stages, complemented by the coordinated use of curated reward models during the RL phase. This strategy establishes the model as a new state-of-the-art (SOTA), delivering superior text-rendering capabilities and remarkable photorealism, and significantly enhancing aesthetic quality. 2) Notably, it sets a new industry standard for Chinese character rendering. By supporting even complex and rare characters, it outperforms both major open-source and commercial solutions in coverage, while also achieving superior accuracy. 3) The model achieves remarkable efficiency through its compact design. With a core diffusion model of only 6B parameters, it is significantly smaller than the nearly 20B or larger Mixture-of-Experts (MoE) architectures common in the field. This ensures minimal VRAM usage and rapid inference, significantly reducing deployment costs. Beyond generation, LongCat-Image also excels in image editing, achieving SOTA results on standard benchmarks with superior editing consistency compared to other open-source works. 4) To fully empower the community, we have established the most comprehensive open-source ecosystem to date. We are releasing not only multiple model versions for text-to-image and image editing, including checkpoints after mid-training and post-training stages, but also the entire toolchain of training procedure. We believe that the openness of LongCat-Image will provide robust support for developers and researchers, pushing the frontiers of visual content creation.
翻译:我们推出LongCat-Image,这是一个开创性的开源双语(中文-英文)图像生成基础模型,旨在解决当前主流模型在多语言文本渲染、照片级真实感、部署效率和开发者可访问性方面的核心挑战。1)我们通过在预训练、中期训练和SFT阶段实施严格的数据筛选策略,并在强化学习阶段协调使用精选的奖励模型来实现这一目标。该策略使模型成为新的最先进(SOTA)技术,提供卓越的文本渲染能力和出色的照片级真实感,并显著提升了美学质量。2)值得注意的是,该模型为汉字渲染设定了新的行业标准。通过支持甚至复杂和罕见的字符,它在覆盖范围上超越了主要的开源和商业解决方案,同时实现了更高的准确性。3)该模型通过紧凑设计实现了显著的效率。其核心扩散模型仅包含60亿参数,远小于该领域常见的近200亿或更大规模的专家混合(MoE)架构。这确保了最小的显存使用和快速推理,显著降低了部署成本。除了生成功能,LongCat-Image在图像编辑方面也表现出色,在标准基准测试中取得了SOTA结果,与其他开源作品相比具有更优的编辑一致性。4)为了全面赋能社区,我们建立了迄今为止最全面的开源生态系统。我们不仅发布了用于文本到图像和图像编辑的多个模型版本(包括中期训练和后训练阶段的检查点),还公开了整个训练流程的工具链。我们相信LongCat-Image的开放性将为开发者和研究人员提供有力支持,推动视觉内容创作的前沿发展。