MIT CSAIL, Google and collaborators introduce InstructMesh, pairing TRELLIS with GPT-4 so novices can repair AI-generated 3D models and print them
Researchers at MIT CSAIL, Google and Northeastern University present InstructMesh, which combines Microsoft's TRELLIS 3D generator with the GPT-4 language model so users can edit 3D designs in natural language and with sliders inside the generative model's latent space; using TRELLIS to recreate popular Thingiverse models, the team found nearly 80 percent had structural flaws, while novices identified and fixed those issues about 90 percent of the time as reviewed by an expert, and they printed objects including a dragon-wrapped mug, butterfly-wing glasses, an octopus-like drink dispenser, a denim-look knee brace and a shrimp-shaped bristle bot.