Week 17

I hope you all had a great weekend! Time for a new Sunday Report!

Let's get to it!

2D->3D Spatial conversion

The next big thing for Vision Pro is releasing in week 17, which is pretty big in my opinion. The user interface still needs a little bit of polish, but the tech's ready and working great!

If you have a Vision Pro you can actually see actual spatial screenshots and videos taken on device, which will be regularly updated and which you can visit here; https://asobiapp.com/spatial-3d.html

Also, If there's games you'd like to see added to the gallery, let me know and I'll see if I can find the time.

Speaking about the Spatial Gallery; I'm looking into making this also viewable on the Meta Quest.

One other thing is that I'll make sure to let you make your own screenshots and videos as well. However, my question to you is; would you be interested into sharing your in-game spatial memories via Asobi? I'm asking because I'm considering setting up a user gallery to where you can upload your taken spatial pics and videos. Let me know in the comments!

After the Vision Pro version of the spatial conversion has been released, I'll try to bring it the other Apple platforms as well, so you can hook up a 3D monitor or for instance Xreal Pro glasses to play your game in 3D as well.

Hopefully this will all also come to the other platforms, but can't commit to that yet. I need to know more about the devices first. Either way, I'm looking into it.

Performance Overlay

So I've made some much needed updates to the performance overlay, since this might help figure out what issues end users run into.

With the next update it'll shows the following;

(Total) Total latency,
(Net) Connection latency,
(Visual) Visual latency,
(Res) Stream resolution
(RTT) Network round-trip time
(DT) Hardware decode time per frame
(FPS) Decoded frames per second
(BT) Incoming stream bitrate
(VL) Video packet loss %
(Drops) Decoder queue drops

To me the main one of interest is the "Total Latency", since this is after all a remote play/cloud play client, and latency is what determines playability, and the goal is to keep it as low as possible.

So the first thing you'll notice is that latency differs per device, from networking, decoding to visually representing it on screen (GPU). So for instance local remote play on competition mode, my M5 Vision Pro had ~5ms but my M1 Pro Mac Mac sits at around ~8ms.

The latency mode doesn't only take the server latency in account but also the visual (glass to glass) latency, the total number represents the combined total. Which means it gives you real numbers instead of (what most do) only server latency. So you'll know where the issue lies.

Cloud

There's changes coming in for PS Cloud to make it connect faster and more reliable from anywhere in the world. This does however still mean that from certain countries you'll still have high latency since I have zero influence on the server location.

I've also managed to discover all PS Now and PS Cloud server locations, which would bring server selection a possible future addition.