Skip to main content
SIGraDi 2022 | Critical Appropriations

Full Program »

53: 3D Generative Design for Non-Experts: Multiview Perceptual Similarity with Agent-Based Reinforcement Learning
Original title: 3D Generative Design for Non-Experts: Multiview Perceptual Similarity with Agent-Based Reinforcement Learning

Research in ENGLISH

Advances in additive manufacturing allow architectural elements to be fabricated with increasingly complex geometrical designs, however, corresponding 3D design software requires substantial knowledge and skill to operate, limiting adoption by non-experts or people with disabilities. Established non-expert approaches typically constrain geometry, topology, or character to a pre-established configuration, rather than aligning to figural and aesthetic characteristics defined by a user. A methodology is proposed that enables a user to develop multi-manifold designs from sketches or images in several 3d camera projections. An agent-based design approach responds to computer vision analysis (CVA) and Deep Reinforcement Learning (RL) to design outcomes with perceptual similarity to user input images evaluated by Structural Similarity Indexing (SSIM). Several CVA and RL ratios were explored in training models and tested on untrained images to evaluate their effectiveness. Results demonstrate a combination of CVA and RL motion behavior can produce meshes with perceptual similarity to image content.
Generative Design, Machine Learning, Agent-Based Systems, Non-Expert Design

Robert Stuart-Smith
rssmith@design.upenn.edu
University of Pennsylvania
United States

Patrick Danahy
pdanahy@design.upenn.edu
University of Pennsylvania
United States

 


Powered by OpenConf®
Copyright ©2002-2021 Zakon Group LLC