Clay Characters Meet Augmented Reality

At Morphy Vision, we’re all about blending creativity with cutting-edge technology. Whether it’s experimenting with new ideas or bringing unique concepts to life, our studio is a playground where the digital and physical worlds collide.

This time, we took on a fun challenge: turning a handcrafted clay character into an interactive Augmented Reality (AR) experience for TikTok and Snapchat. And the cherry on top? The villain of our story, the Marshmallow Boss, was made using actual marshmallows!

How We Made It Happen

Here’s a quick look at the journey from clay to AR:

• Handcrafting the Character
  We sculpted our hero using children’s clay. While the process was exciting, we learned some valuable lessons along the way—like starting with a T-pose for easier scanning and animation later.
• 3D Scanning with Photogrammetry
  Using photogrammetry (we love Object Capture for iOS!), we transformed our clay model into a highly detailed 3D digital version. Every little detail from the claywork made it into the final model.
• Model Optimization
  Once scanned, we optimized the 3D model by refining textures, reducing polygons, and prepping it for smooth AR integration.
• Rigging and Animation
  To make the character come alive, we added a digital skeleton for animation. With playful, expressive movements, the character was ready to jump into action!
• Creating Game Assets
  We designed a vibrant world to match our character, complete with props, interactive triggers, and environmental elements for a truly immersive experience.
• Building the AR Game
  Finally, we brought everything together in Lens Studio (Snapchat) and Effect House (TikTok), where we coded the interactions, integrated animations, and fine-tuned the mechanics.

Clay-Mallow Battle: The AR Game

In this game, players control the clay character by moving their heads left and right to dodge attacks from the fiery Marshmallow Boss. By tapping the screen, the hero strikes back, dealing damage in a thrilling showdown!

This project perfectly captures what we love to do: combining traditional craftsmanship with innovative technology to create something truly unique. It’s this blend of the physical and digital worlds that drives our passion and inspires us to push boundaries.

Check out the results here: