Pim de Witte, software engineer and CEO of Medal, has a message for developers who want to use AI in their apps.
“If you’re an AI app, you’ve got to get out of the browser,” de Witte told The New Stack. “The point is that there needs to be this private intermediary that is not the browser, because the browsers are owned by the major companies… .”
De Witte heads the screen capture platform Medal, which allows gamers to record, clip, edit and share their gaming. The company currently has 1.3 million daily active users and 4 million monthly active users, he said. Medal leveraged its scraping technology — it scrapes but does not retain the information — to create a new way to interface with AI via a product it calls Highlight.
Highlight: A Different AI Interface
Internally, Medal refers to Highlight as a prompt engine, because it will take natural language and optimize it for a prompt, which is then sent to the AI of your choice. Highlight currently can leverage OpenAI’s GPT, Perplexity and Anthropic’s Claude, as well as Google Search.
It might help to think of it as an interface for AI that sits on your desktop, rather than in the browser. TechCrunch called it a “contextual AI assistant,” which is helpful but incomplete. It awaits instructions such as “Summarize this article” or even “Create a meme that represents this discussion.” Then it generates a prompt along with a screen capture and sends it all to one of the large language models. It provides the AI’s answer within its own interface without bringing you to the browser.
“We say we’re actually an interface company,” de Witte explained. “We are developing some of our own models, but fundamentally, we think this is an interface problem. This is not necessarily an AI problem. What we’ve done is we’ve removed the need for people to understand how to prompt.”
But it’s doing more than just launching an API query to those sites. It can also combine what it “knows” about you from your computer applications with those results.
For instance, when demoing Highlight, de Witte showed how it draws from its memory that he works at Medal and that the company prides itself on fostering a supportive, innovative culture, he explained. This allows it to do things that can’t be done within a browser environment, he added.
“Basically, it completely switches the way you interact with technology, because it already packages what it needs to know about you to provide the answers,” he said. “I can say pitch Ken to work at my company. It takes all of [those] native concepts from the browser in a way that a Chrome extension could never do. It then pairs that with what Highlight knows about me as a person.”
“…fundamentally, we think this is an interface problem. This is not necessarily an AI problem. What we’ve done is we’ve removed the need for people to understand how to prompt.”
– Pim de Witte, CEO of Medal
It sounds great for users — and it is. I tested Highlight for a week and soon found myself clicking on the Highlight icon — which hovers over any apps you’re in for easy access — more and more. In fact, it’s user base is growing an average of 15-20% each day, according to de Witte. It now has about 6,000 daily active users.
The Highlight interface. Image provided by Medal.
But what about developers? What’s the value add for web developers?
Highlight as a Development Platform
Highlight isn’t just a UI for pinging large language models. It’s a developer platform that allows developers to build AI apps for the desktop using simple web technologies, de Witte explained. Currently, it’s available for Windows and Mac, with the company working to add support for Linux soon. There’s a demo with code available on GitHub if you’re curious about what this looks like.
Medal is also building out an application store so that web developers can build their apps to run through Highlight’s interface. It provides access to the user’s context (what they’re doing on their machine) along with a set of APIs that allow developers to interact at an OS level, he said.
There are various note applications and chat assistant interfaces available on the app store, as well as a few surprising offerings, de Witte shared. For instance, one study app allows you to generate flashcards from material you’re reading on screen. There’s also an app that generates memes based on what’s currently on your screen, he said.
“You can just be looking at something and it will pull up the perfect meme for the situation without you having to go describe it,” he said.
Developer Grants Available
To build out its application store, Highlight is offering developers grants to create apps. If the developer is willing to work out of the Medal office to “really ramp up your company,” there is a $30,000 grant available, de Witte said. He added that Medal does not take equity from your company.
There are also remote grants available of up to $10,000, with half delivered when you start developing and the remainder if Highlight approves the app.
It’s easy to get up and running, he said: All the Highlight platform requires to work with a web application is a bit of code added to the npm package and your context, he said. There’s even instructions for how to create a Hello World app with Next.js.
A Highlight code sample with Next.js.
“You can run your exact browser interfaces that you would run inside your normal browser, and then you just have additional events,” de Witte said. “You just add the npm package. You say, Hey, here’s the context, and then it gives you access to stuff that browsers just won’t give you access to.”
The post Non-Browser UI Platform for AI Offers Grants to Developers appeared first on The New Stack.
A new platform provides a user interface for AI outside the browser. The company hopes to entice app developers to the platform with grants.