How to add lightning fast AI to your Bubble app with Groq

Introduction to Groq

If you're building an AI no-code app, the first thing you need to do is click the link down in the description because you can access all of our tutorials and courses about building a startup and particularly building a no-code startup. But second is you need to check out Groq. Not to be confused with Grok - this is Elon Musk's Twitter X's Grok. Not what I'm talking about. I am talking about Groq spelt with a Q because it is seriously fast. One of the areas that AI applications and in the Bubble coaching that I run, I noticed a lot of the time of people is that AI gives amazing results, but it seems to take too long to get the responses back.

Quick Demo of Groq

So let me give you a really quick demo and then we will even launch and add this right into a Bubble application. So I've written a system prompt here that you are a social media content creation AI, take the video transcript sent by the user and write a high-performing SEO YouTube description. So I'm going to add in my transcript. Here we go. So this is the transcript of a seven minute video that I recorded last week. It's not big, but it also is not small. How quick do you think it's going to take Groq to reply? Well, let's see. I'm going to click submit and there we go.

Comparing Groq to Other AI Models

Now that's something that I think you would agree will have taken GPT 3.5 turbo, GPT 4 or even Claude 3. It would have taken much longer to reply back. So this is seriously something worth experimenting with both in terms of quality and in terms of speed because when AI gets as quick as basically clicking a button and there is your answer, then you can just what you can do with it. You know the horizons. Oh, yeah, you can say I'm just excited by this.

Adding Groq to a Bubble Application

So how would we go about adding this into a Bubble application? I'm going to click few codes and I've got C URL. There we go. So I just take this and I add it into Bubble. So let's go into my Bubble app and go into the API connector And add in a connection and we're going to say PrivateKey and header. How do I know that? Well, if I go back to the playground I see I've got to add an authorization bearer and then my API key. I need this endpoint here and I need it to be a POST command.

Setting Up the API Connection

So let's expand this out and we'll say chat. We'll just say chat. We'll just say chat. Paste in the endpoint change it to POST change this to action. That means I'd be able to access it in a workflow in the future if I wanted. And then it basically follows a very similar In fact, I think they have intentionally made this very similar to OpenAI.

Configuring the API Request

So let's copy this Into here. Oh and that's my It's got the whole conversation so Let's get rid of this. In fact, you know what? Just so that it's a little sense in copying this across to you guys I'm going to remove the conversation and just save you code now. Okay, because now all it has got is my system prompt Let's copy that Paste it in. Paste it in. There we go Then I want to add in my user prompt, so I'm just going to copy this Add in a comma paste it in change this to user And then make this bit here Dynamic using triangle brackets tells me how to do so there. So I'll say user message Perfect.

Testing the API Connection

Okay, so I'm just gonna for the bubs of this demo I'm just gonna say you are a general AI assistant and We could say list all the USA presidents from present To past okay Basically, I'm just wanting to show how quick it is. I need my API key. Let me grab that So I've entered in my API key with the word bearer in front as requested in the documentation and now let's initialize and test it Okay, I have an error and I just worked out why that is it's because I've said that stream is true and Bubble can't yet stream in No word by word from a AI API. So let's change that to false and now let's try There we go. And let's look at the full content. Here are some lists of presidents Biden Trump Obama. Okay. Yeah, there we go. And we've even got days now. How fast was that true run again? So here we go. Let's run again. Three, two, one.

Understanding Groq's Speed Advantage

Now part of what make rock makes rock so fast is that Maybe you've bought Nvidia stocks in the last couple of years because you need this serious computing power to run an LLM and to run It well, but what grock have done is they've developed their own hardware specifically for AI LLMs and so unlike the fact that a lot of LLMs will run on hardware Which may have initially been intended for gaming like video graphics cards Grock have got this speed because they have built their own AI But using AI models that are freely available such as ones from meta But they've built their own AI hardware. That's what I'm getting at and so it's the combination with these new exciting models In fact, let's go back into the playground and just see we're using llama From meta and they've got some good documentation here about the pros and cons of each one You can find that elsewhere on their site But yeah, they have the hardware advantage because they've built their own compute power Instances that are built specifically for running on AI and that's why it's so quick.

Conclusion and Call to Action

So remember if you're wanting to build a startup and you wanted to do it with no code then click the link down in The description but also I'd love you to share your thoughts on what could be achieved As AI gets faster and faster where you can generate paragraphs of content You can input a three a you know, seven minute video script And it basically gives you a response back in a second. In fact, it tells me down there how quick it was So that's from this again Look so quick indeed in fact, it gives me a breakdown of all of the time They've got quarter of a second And I've missed I've mixed up my system prompt Let's just do the full thing. So you are an AI assistant Let's remove this right. How long does it take to list? List all the US presidents from present to past Boom done how long that take that took Less than three quarters of a second to list all of the presidents now I don't know enough about American history to know if that's all true or not But you can't deny it is very quick indeed.