Typeface Generation through Style Descriptions With Generative Models

Pan Wang, Xun Zhang, Zhibin Zhou, Peter Childs, Kunpyo Lee, Maaike Kleinsmann, Stephen Jia Wang (Corresponding Author)

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

Typeface design plays a vital role in graphic and communication design. Different typefaces are suitable for different contexts and can convey different emotions and messages. Typeface design still relies on skilled designers to create unique styles for specific needs. Recently, generative adversarial networks (GANs) have been applied to typeface generation, but these methods face challenges due to the high annotation requirements of typeface generation datasets, which are difficult to obtain. Furthermore, machine-generated typefaces often fail to meet designers' specific requirements, as dataset annotations limit the diversity of the generated typefaces. In response to these limitations in current typeface generation models, we propose an alternative approach to the task. Instead of relying on dataset-provided annotations to define the typeface style vector, we introduce a transformer-based language model to learn the mapping between a typeface style description and the corresponding style vector. We evaluated the proposed model using both existing and newly created style descriptions. Results indicate that the model can generate high-quality, patent-free typefaces based on the input style descriptions provided by designers. The code is available at: https://github.com/tqxg2018/Description2Typeface.

Original languageEnglish
Title of host publicationProceedings
Subtitle of host publicationVRCAI 2024 - 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400713484
DOIs
Publication statusPublished - 19 Jan 2025
Event19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, VRCAI 2024 - Hybrid, Nanjing, China
Duration: 1 Dec 20242 Dec 2024

Publication series

NameProceedings: VRCAI 2024 - 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Conference

Conference19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, VRCAI 2024
Country/TerritoryChina
CityHybrid, Nanjing
Period1/12/242/12/24

Keywords

  • Artificial Intelligence
  • Computer vision
  • Generative Adversarial Networks
  • Typeface Design
  • Typeface generation

ASJC Scopus subject areas

  • Business, Management and Accounting (miscellaneous)
  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Typeface Generation through Style Descriptions With Generative Models'. Together they form a unique fingerprint.

Cite this