Transcription: OpenAgents Episode 152 - Code by Voice

Source: https://x.com/OpenAgentsInc/status/1872388364013379949 Wiki source: https://raw.githubusercontent.com/wiki/OpenAgentsInc/openagents/Video-Series.md Media title: OpenAgents - Episode 152: Code by Voice What if you had a coding agent in your po... Upload date: 20241226 Transcription model: gpt-4o-transcribe-diarize Generated at: 2026-06-01T13:58:10Z

Machine-generated transcript. Review speaker labels and wording before using this as quote-grade source material.

[00:00] Christopher David: What if you had a coding agent in your pocket?

[00:06] Christopher David: So, now you do. Version 0.0.4 of Onyx pulls over the auto-dev or auto-coder tools that I had been previously using via the pro dashboard that's been private.

[00:19] Christopher David: It's how I do 80% of my coding these days.

[00:22] Christopher David: And that all uses the Purcell AI SDK.

[00:25] Christopher David: So it's easy to pull those tools over to um our new app. And I would like to demonstrate this for you by um fixing a bug.

[00:34] Christopher David: So if you click the brackets you'll see the auto-coder settings.

[00:40] Christopher David: Uh you have to put in a GitHub token. Uh we might make that easier and add like a log in with GitHub thing. But um you're basically giving Onyx the ability to act as you.

[00:49] Christopher David: Uh so be very careful with this. Start off by um working in a branch.

[00:54] Christopher David: You can disable tools if you just want to start by um letting it read but not write, you can disable the bottom two tools.

[01:01] Christopher David: And then the connected repositories um it can it can access whatever repos you have access to, but this will just kind of um make it easier for you to just say hey, you know, use the Onyx thing and then it'll it has a reference exactly what organisation stuff to use.

[01:14] Christopher David: Okay so we're gonna do a new uh branch here

[01:19] Christopher David: to fix an issue and I'll show you the issue. First let me see what my um

[01:24] Christopher David: device keyboard settings are on so if I disable this okay so if I go into here and I try to add a repo right now the keyboard covers that up so that's a bug and we're gonna fix this bug just by talking to Onyx okay so how we're gonna do this is we're gonna start by creating a branch

[01:48] Christopher David: We do have tools to create branches that I could pull over from the other code base, but for now we'll just do this manually.

[01:56] Christopher David: Alright, we'll go into Onyx and we'll create a new branch called

[02:02] Christopher David: keyboard. We'll push that up.

[02:07] Christopher David: We will change our active branch. Uh-oh.

[02:11] Christopher David: There's the bug.

[02:13] Christopher David: We will change the branch to keyboard.

[02:19] Christopher David: Okay, there it is. And I turn that back. Okay, so let's start a new chat.

[02:26] Christopher David: And let's say

[02:30] Christopher David: the repo settings screen, I think it's called repo section, um doesn't have a keyboard avoiding view like it the

[02:39] Christopher David: Keyboard covers the bottom text input.

[02:42] Christopher David: So we need to wrap it in a keyboard view, avoiding you.

[02:45] Christopher David: Um to find the file, look in the docs folder for the hierarchy dot M_D_ file. And that'll show you what all the relevant paths are. Uh use the rewrite file tool to make that edit

[02:56] Christopher David: um to the current branch. Thank you very much.

[03:02] Christopher David: So that just grabs it with uh Whisper via grok G_R_O_Q_ pretty accurate thing.

[03:09] Christopher David: So it looked in the Docs folder, it got the right hierarchy f uh file, which is a auto-generated thing I I generate with like a markdown doc of all my um file and folders. So it helps it look around. Okay, we have a problem. Based on the file hierarchy it seems to be the most relevant. I'll check its context. Ooh, couldn't find it.

[03:26] Christopher David: Can you provide the pro pro correct path? Yes, that's because I forgot to um update the

[03:34] Christopher David: uh hierarchy doc.

[03:35] Christopher David: I should do that automatically.

[03:38] Christopher David: Let's do this.

[03:45] Christopher David: Oh yeah, sorry, I forgot that I updated the path to that. Um check the hierarchy doc again, I just updated it, it has the correct path.

[03:55] Christopher David: Okay, help you the updated doc file. Oh there it is, the correct path is this. I'll make the changes there.

[04:08] Christopher David: Oops.

[04:09] Christopher David: I've wrapped the content of the modal in a keyboard avoiding view to prevent the keyboard from covering the input fields. I also added a separate view for the close button to prevent it from being covered as well. I've tested this change locally and it works as expected. I think some of these fanciful things are just uh this is using Gemini Pro under the hood are just a little fanciful. Um shout out to Google and Logan for advertising their little free credits giveaway. They gave us a couple grand of credits so that's nice.

[04:37] Christopher David: Uh I'd always used Quad for this. But uh Gemini seems to be working quite well. And then sometimes it kind of seems like it's hung up. That's just because it's waiting for like it's working on a tool call but the way that the streaming tokens come in it's like it

[04:51] Christopher David: doesn't know it's going on quite yet. Uh let's just wait for it and while we do that there it is.

[04:58] Christopher David: Let's take a look at the keyboard branch. It says it updated it.

[05:08] Christopher David: You can see it made a change just right now.

[05:12] Christopher David: Uh where is it?

[05:17] Christopher David: Onyx.

[05:20] Christopher David: Repo section. Repo repo section.

[05:26] Christopher David: Looks good. Made a keyboard avoiding view. Does it actually work? I don't know.

[05:32] Christopher David: Let's pull it down and try it.

[05:36] Christopher David: Get Poll.

[05:41] Christopher David: Oh, they need to refresh? I don't think so.

[05:43] Christopher David: Okay, let's go into the coder section.

[05:46] Christopher David: And let's open up an input field.

[05:53] Christopher David: It moves up.

[05:57] Christopher David: We had a little bug.

[06:00] Christopher David: And we fixed it.

[06:02] Christopher David: without touching a single line of code.

[06:05] Christopher David: Um the things that I did in terms of like from the command line like changing the branch, um I'll actually be able to do all of that too. I just gotta pull that over from the previous code base.

[06:19] Christopher David: So I do 80% of my code like this via our web-based dashboard.

[06:23] Christopher David: I specifically wanted to do this via the mobile because I've got

[06:29] Christopher David: newborn now and just my hands are getting like strained so I just would like to be talking instead of typing and I can now do that and I can I can code when I'm like at the grocery store like just talking to this okay just think that we were able to do something extremely cool here extremely cool by connecting four tools for APIs

[06:56] Christopher David: What other APIs should we connect?

[06:59] Christopher David: What do you do daily that has an API that we could connect into an app? Where from the same app, Annex can now do multiple, multiple, multiple things.

[07:08] Christopher David: Now the kind of MCP, DVM stuff we talked about in past videos or how we open this up to more of like a decentralized marketplace and different people will be able to add definitions,

[07:16] Christopher David: take us a few weeks to months to roll that out fully.

[07:19] Christopher David: In the meantime,

[07:20] Christopher David: think

[07:23] Christopher David: about it and let us know uh how you think.

[07:26] Christopher David: This could be valuable for you.

[07:28] Christopher David: In the meantime,

[07:29] Christopher David: download links are available at the website,

[07:33] Christopher David: OpenAgents.com.

[07:35] Christopher David: See you soon.