The other half of Ear for Omi

Audio goes to your own computer.The organized result comes back to your phone.

Ear for Omi does not organize anything by itself. What the pendant records is handled by two services you run yourself. The developer runs no server: every block below is in your hands, or uses your own keys.

Who does what

The pendant listens, the phone carries and shows, the recording backend transcribes: audio becomes a transcript, and what you say after pressing the button becomes a command. Then the second brain turns it into topics, to-dos and memories, and sends them back to your phone.

  • PendantRecords; has a button
  • Ear for OmiCarries audio, holds no keys, shows everything
  • Recording backendStores, splits, transcribes, handles commands
  • Second brainTopics, to-dos, memories
On youPendant and phoneYour own computere.g. an always-on Mac miniOutsideYour own keysThe phone holds only a cache andyour footprint. Deleting the appleaves the backend’s data alone.BluetoothAudio ⇄ ackTopicsTranscripts ⇄ to-dos, memoriesModelsused by bothWriteRead oncePendantMicrophoneRecords audioButtonPress, then speakOn boardStores when offlineEar for Omi (iPhone)RecordingConnection statusLive textDraft on the phoneBufferKept until confirmedOfflineSynced from pendantTopicsTopics, review, to-dosRepliesSpoken and on screenKeysHolds noneRecording backendIntakeConfirms only after writing to diskSplit and identifySentences, voiceprints, music checkTranscribeA model turns audio into textWrite to OmiEach conversation, onceButton commandsFinds the intent, answers or notes itWeb pagesStatus, conversations, commandsKeysOmi and model keys live hereSecond brainTopicsEach point must match the transcriptDaily reviewWritten when the day endsTo-dos, memoriesPeople too, pulled out of the topicsFor the appTopics side, search, editsWeb adminRead topics, edit notes, settingsModel serviceTranscribeTakes audioOrganizeTakes textKeyYour ownOmi cloudWrittenConversations, onceReadSummaries, onceLaterEdits stay yoursMarkdown folderYour files; opens in any editor

On you

Pendant and phone
Pendant
  • MicrophoneRecords audio
  • ButtonPress, then speak
  • On boardStores when offline
Ear for Omi (iPhone)
  • RecordingConnection status
  • Live textDraft on the phone
  • BufferKept until confirmed
  • OfflineSynced from pendant
  • TopicsTopics, review, to-dos
  • RepliesSpoken and on screen
  • KeysHolds none

Your own computer

e.g. an always-on Mac mini
Recording backend
  • IntakeConfirms only after writing to disk
  • Split and identifySentences, voiceprints, music check
  • TranscribeA model turns audio into text
  • Write to OmiEach conversation, once
  • Button commandsFinds the intent, answers or notes it
  • Web pagesStatus, conversations, commands
  • KeysOmi and model keys live here
Second brain
  • TopicsEach point must match the transcript
  • Daily reviewWritten when the day ends
  • To-dos, memoriesPeople too, pulled out of the topics
  • For the appTopics side, search, edits
  • Web adminRead topics, edit notes, settings

Markdown folderYour files; opens in any editor

Outside

Your own keys
Model service
  • TranscribeTakes audio
  • OrganizeTakes text
  • KeyYour own
Omi cloud
  • WrittenConversations, once
  • ReadSummaries, once
  • LaterEdits stay yours
The audio pathSecond brainOtherDashed box = outside services, with your own keysClick any block to keep only its connections.

Where the data lives

Sources flow into the second brain, which organizes them into one Markdown folder. All of it is on your computer.

SourcesMarkdown folderUsed byPendant recordingsAsks the backend every minuteOmi’s summaryRead once per conversationFootprintSynced every hourYour own diaryOptional; read, never changedYour edits in the folderRead back, not overwrittenTopicsDaily reviewsTo-dosMemories, notesPeople, goalsFootprintThe phoneWeb adminVoice commandsSecond brainOrganize · check · index

Sources

  • Pendant recordingsAsks the backend every minute
  • Omi’s summaryRead once per conversation
  • FootprintSynced every hour
  • Your own diaryOptional; read, never changed
  • Your edits in the folderRead back, not overwritten
Second brainOrganize · check · index

Markdown folder

  • Topics
  • Daily reviews
  • To-dos
  • Memories, notes
  • People, goals
  • Footprint

Used by

  • The phone
  • Web admin
  • Voice commands

Recordings and transcripts

In the recording backend’s own folder: each conversation’s recording and transcript, and the voiceprints it has learned.

Topics and notes

A folder of Markdown files that opens in Obsidian or any text editor.

  • 主題/ topics
  • 每日/ daily
  • 待辦/ to-dos
  • 記憶/ memories
  • 人物/ people
  • 目標/ goals
  • 記事/ notes
  • You can edit these files directly; the second brain will not overwrite what you changed.
  • Deleting moves a file to a trash folder, so it can be restored.
  • Deleting the app does not touch the backend’s data; the phone only holds a cache and your footprint.

What you need

  1. 1
    An always-on computerFor example a Mac mini that stays on and does not sleep. The setup guide is written for a Mac mini.
  2. 2
    An Omi developer keyCreated on Omi’s web app, with write access. The backend uses it to write conversations to Omi.
  3. 3
    A key for a model serviceAn OpenAI-compatible API. You need one model that can take audio (transcription) and one for text; they can be the same. The model service bills you for usage.
  4. 4
    A way for the phone to reach that computerPut the phone and the computer on the same private network, or serve the backend over HTTPS. Each phone pairs once by scanning a QR code from the backend, and unpaired devices cannot get in from outside; the admin pages open only to trusted networks. Even so, it is best to let only networks you trust reach the backend.
  5. 5
    Comfort with a terminal, or an AI assistant to install itThe setup guide is written for an AI assistant to follow, with a command and a check for every step. It installs directly on macOS (a Mac mini, for example) and starts on boot.

How to get it

The backend does not come with the app and is not on the App Store. Email us and we will send you the backend’s code and the setup guide. You receive source code; model files and packages are downloaded from their official sources during setup. The guide and the backend’s web pages are currently in Traditional Chinese.

Email us for the backend sona.orbit.hi@gmail.com