Streaming spectator mode support for analysis

[K R Srinidhi]

Hi
We are evaluating anbox-cloud for cloud gaming. We are also checking for the following features :

1)save and restore game state : Feature to save the game state in the middle of the game and later restore the state and start the game from the previous state. How can this be achieved with anbox-cloud.

2)Stream access for recording or event detection using ML model: We also need to access the stream during gameplay for recording / forwarding the stream to event detector (based on ML model) . How can this be achieved with anbox-cloud

regards
Srinidhi

[Simon Fels (morphis)]

Hey Srinidhi,

> 1)save and restore game state

Anbox Cloud does not provide explicit support for this and it's on you to implement backup/restore of any userdata you want to preserve from instances. We have lifecycle hooks you can use to implement backup/restore of any data inside the Android data partition. See https://anbox-cloud.io/docs/ref/hooks and https://anbox-cloud.io/docs/howto/addons/backup-and-restore

> 2)Stream access for recording or event detection using ML model

Each stream is individually being encoded for a user depending on his network conditions/resolution/etc. Do you want to access the same video stream or want to have a separate higher latency and (constant) quality one? If second, this will mean additional load on the encoder which will lower your density.

We have a plan to add a spectator mode in the future but this will introduce a second encoded video stream and not reuse the one of the actual player.

Can you provide us more details on what specifically you're looking for?

[K R Srinidhi (srinidhikrs)]

Hi,

We would like to have additional access to the same video stream (low latency) (one stream to the browser session and same duplicate stream to ML model for internal processing) , to process the stream using ML model to detect some events and take action.

Thanks
Srinidhi

[Simon Fels (morphis)]

Thanks!

We can put that on the feature request list, but not going to happen shortly unless our current priorities change. Your best bet for now is to record the screen output via something like screenrecord (which will cost CPU time as it encodes on the CPU) to extract a separate video stream.