Versions Compared

Old Version 4

changes.mady.by.user Ali Ok

Saved on

compared with

New Version 5

changes.mady.by.user Jens Reimann

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Associated JBoss community project(s):


Idea Proposals


New Drogue IoT protocol endpoint

Summary of idea:

On feature of Drogue IoT Cloud is to normalize the transport protocol from IoT specific protocols to Cloud Events. We currently have endpoints for MQTT and HTTP. However, there are much more protocols out there that could be added, like CoAP for example.

Choosing a protocol you would like to implement must be done as part of the project proposal, and not as part of the project. There is no need to implement whatever protocol you choose from scratch. The focus should be on the integration of the protocol to the cloud deployment, not on implementing the protocol itself.

The current protocol endpoints are written in Rust. However, implementing your protocol endpoint in Rust is not a requirement. Still, it would be a chance for you to learn about an awesome programming language, if you are up for that challenge.

Knowledge prerequisite:

  • Kubernetes
  • Knative
  • Rust (optionally)

Github repo: https://github.com/drogue-iot/drogue-cloud

Skill level: Intermediate

Contact(s) / potential mentors(s): Jens Reimann (jreimann@redhat.com)

Associated JBoss community project(s): Drogue IoT


Implement "Hey Rodney" Drogue IoT demo using Tensorflow (Lite)

Summary of idea:

In Drogue IoT we have an example/demo/PoC, which implements a voice assistant based on our Drogue IoT cloud deployment. There is wake-word/keyword/trigger-word detection, which initiates the audio recording. Once the snippet is recorded it will be processed by a speech-to-text backend and is further processed.

For the wake-word detection we are currently using Pocketsphinx. However, the detection rate is pretty bad. Also it doesn't run on embedded devices.

The outcome of the project should be to use Tensforflow (Lite) to create a model for wake word detection. Additionally a program (script) which continuously listens to audio input (microphone). Once the trigger is detected, it records for up to X seconds, or until it detects silence. A single command is sufficient ("hey rodney"), no full speech-to-text model is required. It is perfectly fine to re-use existing data sets and scripts, as long as they are open source, and we can build this ourselves.

This should be able to run on a Raspberry Pi like device, with the prospect of being able to run on embedded devices (microcontroller) using Tensorflow Lite. Bonus points for actually porting that to a micro-controller, but that is not required.

Knowledge prerequisite:

  • AI/ML - Tensorflow
  • Python (probably)
  • Linux
  • Embedded programming (optionally)

Github repo: https://github.com/drogue-iot/drogue-cloud

Skill level: Advanced

Contact(s) / potential mentors(s): Jens Reimann (jreimann@redhat.com)

Associated JBoss community project(s): Drogue IoT