TaskTiger: Finding highlights in long form videos

Progress update!

For the past week we have been hard at work trying to figure out one thing: Can AI be leveraged to automagically convert a long form video into snippets of highlight? Well, we had some success!

By leveraging Speech To Text (STT) and GPT's ability to summarize and highlight large amount of text, we were able to breakdown this 2.5 hour podcast into 37 short snippets. This is all done by simply feeding a youtube url to the system. Pretty cool huh!

There had been a ton of challenges getting this to work, with the biggest one being OpenAI GPT's inability to follow exact instructions. Lots of time(and money) was spent engineering the prompt and the result is still not the most satisfying yet. One thing that definitely helps is reducing the input context - meaning GPT start to follow the instruction better when the amount of text sent in a request is reduced.

That said, we want to continue pushing this feature forward. Next step is to get this feature/workflow production level and deploy it as a "Video Highlighting" job to tasktiger.io . That way anyone could input a video url, pay some sats and get back a bunch of video highlights!

What do you think? Do you know anyone that would find this feature useful? Any suggestions? Would love some feedback from the real world 😬