I put together www.chessrapid.com for my own use. It's a version of Puzzle Rush / Puzzle Storm that has the added benefit of: 1) filtering by tactical themes and 2) seeing what themes you are frequently slow on / incorrect on. This way I can narrow in on the tactical themes that I need to improve pattern recognition on (e.g. I can take a break from Mate in 1 and Mate in 2; I really need to work on middle game).
Thanks for making this, just gave it a try. You might be able to work with the chess.com people in a way that might generate some $$. Or, better, work with the lichess folks (not for $$). I'd like to be working on something like this. Meanwhile, I think I'll run it some. Holes in my tactics especially in blitz showing up too often at the local chess Meetup.
I imagine something like a local text file / draft email (because I always have my email open)?
The problem I run into is that I'm either running from thing to thing so there doesn't seem to be much time to write things down as they happen OR I run out of steam at the end of the day and I don't prioritize "write things down".
We've explored a bit of the ASL space. The motion based ones are not something we've dug into. But some of the "static-but-location" based ones are things we've tried.
"Mom" is easier than "grandmother". We've tested out a version of "mute". "Tile" would be quite a bit harder (I think).
This is a really great point. We do have some early thoughts around the idea of the interface being responsive to "distance from user" as opposed to "screen size". The chat interface, for instance, will change in size depending on how far away from the device the user is.
This doesn't change the particular problem you noted, but the general issue is an interesting space to dig into.
Ten feet seemed too ambitious and five was too many letters =). We didn't think about the six feet under connection, but now we'll have to figure out what to do with that. Probably lean into it.
There was another comment that was less convinced about controlling with the phone. Is there something about that modality / use case that you are particularly moved by? When you imagine "controlling" by phone what spaces would you want to dig into more?
> - using my hand as a mouse in space-constrained situations where I can't have a physical mouse
Are you thinking that you would consider using something like this to interact with your entire computer generally (i.e. instead of solely in the context of a video streaming like shown in the demo)?
> - dance class, so the instructor can seek through music, especially for rewinding to the same starting spot over and over again. (This is from the days of in-person classes; it drove me nuts that the instructor had to keep walking back to his phone and then getting it a few beats off)
This is really validating feedback and affirms a lot of our experience in these types of classes (especially remote). Requiring the instructor to walk towards the device to basically do anything really messes with the flow of the class. And requiring the learners to walk towards the device to do anything basically reduces the social aspects of the class to zero.
We actually do have a built out music control system that we took out for the purposes of this demo.
We also have voice controls that can be used to control the music playing (among other things).
> - spellcasting game
This prompted a considerable amount of discussion during our most recent sync.
If you're available / interested, can you reach out to vince@wakasaba.com, we'd love to chat some more.
We're not too familiar with toastmasters (other than hearing that it's a great way to learn public speaking). Would you find this useful in the context of in-person or remote meetings or both?
And what would it be used for? Moving slides? Displaying / hiding the agenda? Sending lots of clap emojis?
Public speaking in general is best done standing but due to the pandemic, most toastmasters clubs end up using zoom for virtual meetings.
While many speakers do stand to deliver their speeches, it gets difficult to interact with the audience in a meaningful way when zoom is built around the expectation that people will be a foot away from computer camera.
Moving slides is a big thing that people can’t do today if they are standing to give a speech.
Your tech can help with Emojis and reactions.
Starting and stopping the timer is another useful feature that Toastmasters will use.
Yes! The sudden increase of webcam usage is one of the things that prompted us to think about opportunities around this type of interaction. Sometimes I wish I didn't have to talk to my Nest Hub in order to make it do something.
To clarify, are you describing something to the effect of: [whatever WakaSaba is doing] => Browser Extension => Webapp version of $EnterpriseVideoconferencingSuite?
This is not something we have explored. If you had to hazard a guess, what $EnterpriseVideoconferencingSuite would be most amenable to this sort of work?
Pretty much, yes. WakaSaba's major offering - at least, that's what the headline and demo video focused on - seems to be a new control toolkit for video meetings, and I feel like it should be possible to get a good chunk of that without doing all the hard to work to develop, host, and maintain your own videoconferencing suite. Like, say I wanted to advance my slideshow without walking over to the keyboard on the podium; I could build a fancy smart remote that talks to the cloud with its own GSM radio and interfaces with a novel presentation suite specifically designed to integrate with my remote, or I could make my remote a bluetooth keyboard that can only press the left and right arrow keys and then keep PowerPoint focused.
I don't know what enterprise conferencing suite would be easiest to talk to. It'd be straightforward if I wanted to use a local video stream, proxy `navigator.mediaDevices.getUserMedia` and generate synthetic click/keyboard events as necessary [1] or make like the remote and pretend to be a keyboard, but the really interesting thing would be to run WakaSaba on a second device and use it to control my "primary" presence. I took a quick spin through some different videoconferencing suites to see what looked doable:
FaceTime: No API, no client SDK, no browser client, dead end.
Google Meet: No API, no client SDK, but a web client. If they're using html5 video elements (which I haven't checked) you could probably intercept the streams, correlate them with the user information displayed on each card, and then associate them, but without an API or client SDK you wouldn't be able to do anything on the first device from the second device. Probably the easiest PoC for a first-device demo (that is, run the hypothetical WabaSaba extension on the same machine you're controlling), given that it's a webapp first and there're a ton of extensions that augment/tweak it to copy code from.
Discord: Very nice API - you can even implement audio clients! - but the video API isn't documented and looks like a hand-rolled solution in Elixir [2]. They do have a browser client, though, so if they're using HTML5 video elements and you can capture the source, might be your best bet. That said, I'm not sure the API lets you remote-control a second session. If you can capture the video stream this looks like your second-best bet for a first-device PoC.
Zoom: Like Discord - APIs and client SDKs that look like they'd permit remote-control, but can't see any support for video so you'd have to intercept video from their webapps.
Oh wow. Okay. I found a product that wants to do half of this - otter.ai does live transcription of meeting audio - and they seem to have given up on it entirely and just abused the analog loophole. Sooooo maybe the only way to get remote-control from a second device would be to reach out to a videoconferencing provider and ask for a privileged integration like otter seems to have gotten with Zoom, lol.
I put together www.chessrapid.com for my own use. It's a version of Puzzle Rush / Puzzle Storm that has the added benefit of: 1) filtering by tactical themes and 2) seeing what themes you are frequently slow on / incorrect on. This way I can narrow in on the tactical themes that I need to improve pattern recognition on (e.g. I can take a break from Mate in 1 and Mate in 2; I really need to work on middle game).