Daily Developer Log

AI Voice Demo Game (Open in Quest Browser)

WebXR Microphone Troubleshooting Guide

AI voice support is complete. Server is located in Dallas. Tell me about your experiences in the comment.

To use AI voice feature, activate speech function on the start screen.

Voice Chat Demo in Quest

You can talk without the speech input box. (Note 3.2.1 next to the send button.) But I recommend you leave the Specch Menu on. Streaming or speech recognition fails often. You’d want to know what’s going on.

Action Speech Demo

 

---

My thoughts(or skepticism) about AI

• The worst part is latency. It takes up to 5 seconds to generate a conversation. It breaks the immersion. -> This issue is partly resolved by streaming. But sometimes a huge lag is still happening with streaming.
• The second-worst part is the TTS. It never feels human, and it sounds stupid too often.
• AI itself doesn’t make a content in 3d games.

AI language model is more suited for text chat services.

This can still be effective as an advertising scheme. I’m mainly doing this for advertising purposes.

For a starter, I’ll create a very simple talking AI pornstar prototype with a minimum of AI speech and AR.

It’ll be a combination of [placement, AR room, and AI voice]. Only walking and talking this time.

AI speech will have improvements from the last one, like streaming chats to reduce latency, and lip-syncing.

Dance Pack full games are updated with this stage.

I’ll add this stage to Pose Simulator when I have some time. Pose Simulator version will have all the spaces, including the storage room and bar.

Major updates are complete now. There are some minor improvements requested in user comments. I’ll take care of them soon.

I’m not sure about the AR feature. It’s complex and not reliable. It requires a lot of efforts from the user. I’ll provide a complete guide soon.

AR Depth Editing

In this video, you can see that headsets have tracking errors. Like we move 50 cm, but the headset reports only 48 cm of movement. As a result, my drawing and the real desk don’t match after I move around a bit.

In Quest 3, the drawing parts are supposedly automated and more detailed. But those things rarely work as expected. We’ll have to see it to be sure.

My method would have been okay too if it were not for the tracking errors.

UNDO/REDO on Posing

Only posing related changes are undo-able.

Quick One-Hand Rotate

I hear some of you hate two-hand lifting. Turn the two-hand lifting off as default to prevent mistakes.

*as of 2023-9-11,  “apply body” checkbox has been added.

From now on, if you upload to the Body Share gallery in the Pose Simulator, it will contain pose.

It doesn’t have the complete scene. This is similar to the “drag and copy pose” function.

This function will help you move pose between scenes.

When you download the body from the gallery, you need to check the “Apply Pose” option to get the pose.

 

Along with that, The “LIKE button” from the body share menu has been replaced by Run Count. It seems Run Count is getting more response because it means viewers are interested in that body mod.