Pitch & Demo: PlebAI

Few months ago I went into the AI rabbit hole. What I saw there was dark. Silicon valley elites are pouring billions of dollars in building closed AI systems that can ingest all of our data. Then scare politicians into creating regulations that install them as overlords. They will not win in that game because of millions of Plebs like us band together, build in public (#buildinpublic), democratize AI access for all and beat them in their own game.

We call this movement PlebAI.

Then I found PremAI.io, which makes it very easy for anyone to run open-source language models. I started experimenting with some models and integrating them with the front end. Then I saw a tutorial by Kody and Mckay on how to link sats (L402) with the agent. Everything fell into place, and during the second week of this hackathon, we launched PlebAI.com.

There was no stopping after that. We now have 10 agents equipped with different skills, available for free or paid with sats.

See it for yourself in the demo.

📺 Video Pitch & Demo

🚀🚀🚀 Launched on July 10th 🚀🚀🚀

Everything you see in the demo is Live and you can check it out by going to

https://chat.plebai.com

🕵️‍♀️ Featured Agents

Gen Image AI agent: This tool generates any type of image using prompts. It employs the open-source Stable Diffusion 1.5, with Automatic1111 interface, and runs on a small Nvidia A10 instance. Image seeds are randomly generated, ensuring that no two images are alike. Currently, this service is offered for free. Image generation should take approximately 5-10 seconds.
Human + AI agent: Powerful data scraping tool, adept at gathering information from various sources with the assistance of human operators. Combining the efficiency of automation with human intelligence, it navigates through websites, APIs, and databases to extract relevant data. The agent leverages machine learning algorithms to adapt and improve its scraping capabilities over time. Human guidance ensures ethical scraping, handling complex scenarios, and addressing challenges that require subjective judgment. We are working with Stakwork to make this integration of Human + AI possible.
Orange Pill agent: The Orange-Pilling Agent is a skilled and empathetic advocate for Bitcoin adoption. With a deep understanding of the bitcoin space and a passion for spreading awareness about Bitcoin's potential, This uses ReAct approach of thought and reasoning and uses internet for real time search.
Youtube chat agent: Innovative service designed to simplify the vast world of YouTube videos into digestible summaries. AI agent leverages advanced AI algorithms to watch, analyze, and concisely summarize YouTube videos across a myriad of topics, you can search a video or simply provide a youtube link to see the magic happen. This uses GPT 3.5 and costs 100 sats.
Prompt Genie agent: The best way to get the right prompt is to make the Large Language Model write the prompt for you. Thanks to Kody Lowe for the system message.

💪 Achievements

Our hackathon goal isn't just the final prize; it's about the journey, the people, and the learnings. We experienced a roller coaster ride of emotions throughout the hackathon and accomplished so much!

Creating prompts: As Kody Low puts it "If you are not getting the right answer from LLM then you are the problem". We went deep into analyzing and coming up with how to craft system and user prompts to get the best results. I even conducted a session for other devs. Here's the link to that story. Prompt Engineering for AI Our prompt genie agent is modeled to help anyone to create the best system prompt.
Creating L402 auth'd agent: Since L402 spec was recent and there were only few working repos we put great minds together on the discord chat to reconfirm the specs published by Lightning Labs and use it to create our agents. We need to make sure the specs are followed correctly so that others can consume them. Here's the story on that.
Winners of PremAI & Langchain hackathon: While camping out on PremAI discord we came to know about their hackathon and our project fit really well. We took up the challenge connected our frontend to the open source model built and deployed using PremAI. They clearly identified and recognized our privacy focus and free for all model. Here's the link
Make it 10: 2 days to go we challenged ourselves into building 2 more agents to hit the double digit on agent count. Building the generative image Agent was very challenging as it has to hit the stable diffusion model create the image, push it into a cloud storage and provide the image back to the user. We did it and it is working. Now using our Gen Image AI agent anyone can create their own cat pics...

A cat with sun glasses

⚙️ How it works?

Our goal: any user inputs their desired request and the sats they're willing to spend. We aim to connect agents, data, and LLMs swiftly to deliver the perfect answer, pronto!

📊 Stats (July 2023)

Our API costs keep soaring... but no worries! We've got an equivalent amount of sats collected in our wallet! 💰

Shows the PlebAI API Usage

🧑‍💻 Tech stack

We carefully select and utilize the appropriate open-source tools to ensure a seamless integration. Fortunately, there is a wide array of tools available that allow us to piece everything together.

Prem AI for hosting Language models

GPT4ALL Lora Q4 as LLM

LLAMA2-7B-HF as LLM

BIG-AGI Chat user interface

Langchain

Redis Vector Store

Zep long term memory

L402 (Lightning Labs)

getAlby (Chrome extension)

👷 Builders

Arun Nedun (starbuilder)

Founder, hacker, coder, Full stack Developer
Building on lightning from 2020, Nostr from 2022
Starbackr, Current App, spool, plebhy

Niklas E (egge)

Frontend, Mobile, react and everything in between..!
Building on lightning since 2021, Nostr from 2022
Contributor to nostr NIPs, nostr-tools
Starbackr, Current App, spool, plebhy

🪛 #BuildinPublic

All our work are open source and anyone is welcome to join us, contribute and grow.

Frontend: https://github.com/lightning-digital-entertainment/plebai

Backend & L402 services: https://github.com/lightning-digital-entertainment/plebai-l402

Agent Marketplace (WIP): https://github.com/lightning-digital-entertainment/annuaire#entries

Replit: https://replit.com/@starbackr-dev/plebai#.tutorial/README.md

🫶 Epilogue

While I began this pitch with a somewhat doom-and-gloom tone, I am very optimistic about the future, especially after witnessing the number of developers engaged in #Buildinpublic and the projects submitted to this hackathon. With the release of Llama2 just a couple of weeks ago, we are already seeing many tools being built on top of it. I wouldn't be surprised if I find myself canceling my OpenAI account in six months.

My AI assistant says it better:

As we stand on the threshold of tomorrow, PlebAI is no longer just a movement; it's a vibrant beacon of hope. It represents the audacity of dreamers, the tenacity of builders, and the spirit of innovators who believe in a brighter, more equitable future. The echoes of our triumphant cry, "#buildinpublic," resonate through the expanse of the digital realm, reminding all of us of the power we hold when we dare to innovate, share, and build together.

Yes, we went down the AI rabbit hole, but what emerged was no mere rabbit. It was a lion, roaring with the collective strength of millions of Plebs, ready to claim its rightful place in the kingdom of AI. Here's to us, the undaunted revolutionaries, the democratizers of AI, for we are rewriting the future, one line of code at a time.

🤙 Reach Us

Telegram: Telegram

Nostr: [email protected] or [email protected]

Email: [email protected]