Skip to main content

How to set up the AI Assistant

Connect Agon to an AI provider of your choice, and the AI Support Assistant, AI Action Mode and the business-advisor answers start working. The quickest way is a free Google Gemini API key, and it takes about 3 minutes.

How the AI Assistant works in Agon​

Agon runs on your own computer, and so does its AI Assistant setup. The assistant uses an AI provider key that belongs to your studio: you create the key with the provider, paste it into Agon, and Agon talks to that provider directly. Agon does not run an AI service of its own, and no AI service comes bundled with Agon.

You have three options:

OptionWhat you needGood for
Google Gemini (recommended to start)A Google accountGetting started in minutes
GroqA Groq accountAn alternative provider with fast responses
A local model with OllamaA reasonably powerful computerKeeping every prompt on your own machine

If you don't set anything up, the assistant still works in basic mode (see below).

What is basic mode?​

Without an AI provider, the assistant panel turns into a documentation search. You type a few keywords and Agon shows the help articles that best match, straight from this documentation. Basic mode:

  • runs entirely on your computer, with no internet connection and no AI involved;
  • can't answer free-form questions, perform AI actions or give business advice;
  • shows a Set up AI in Settings button that brings you back to this setup.

Settings → AI Assistant shows Not configured · basic mode while no provider is connected.

Before you start​

  • Only the studio manager account can set up the AI Assistant.
  • Read Privacy: where your prompts go below, especially if you plan to mention client details in the chat.
  • Treat an API key like a password. Anyone who has it can use your provider account.

Create a Gemini API key in 3 minutes​

  1. Open Google AI Studio's API key page in your browser and sign in with your Google account.
  2. Click Create API key (Google may call it Get API key). If Google asks you to choose or create a project, accept the default.
  3. Click the copy icon next to your new key. It's a long string of letters and numbers.
  4. In Agon, open Settings → AI Assistant. [SCREENSHOT: Settings → AI Assistant with the provider list and the API Key field]
  5. Under AI Provider, choose Google Gemini.
  6. Paste the key into the API Key field and click Verify & Save.
  7. Agon tests the key with Google straight away. When it works, you see API key saved and verified. and a Key active · Google Gemini badge.

That's it: open the assistant and ask it a question.

Google's screens change from time to time. If a button has a different name, look for "API keys" in Google AI Studio's menu. The Get a Google Gemini API key link next to the provider list in Agon always opens the right page.

Use Groq instead​

  1. Open the Groq console's API keys page and sign in or create an account.
  2. Click Create API Key, give it a name (for example "Agon"), and copy the key. Groq shows it only once.
  3. In Agon, open Settings → AI Assistant, choose Groq under AI Provider, paste the key into API Key and click Verify & Save.

A Key active · Groq badge confirms it's working.

Use a local model with Ollama​

With Ollama the AI model runs on your own computer, so prompts never leave it. You need a computer with enough memory to run a model. Responses are usually slower than a cloud provider's, and answer quality depends on the model you choose. This is an advanced option. No API key is needed, and you never need to edit any file or restart Agon.

  1. Download and install Ollama from ollama.com, then download at least one model, for example by running ollama pull llama3.1 in a terminal. Ollama must be running whenever you use the assistant.
  2. In Agon, open Settings → AI Assistant. [SCREENSHOT: Settings → AI Assistant with Ollama (local) selected and the model picker]
  3. Under AI Provider, choose Ollama (local).
  4. Agon checks whether Ollama is reachable on your computer:
    • If Ollama isn't reachable, the page says so and offers an Install Ollama link. This is the normal message for anyone who hasn't installed or started Ollama yet — it's guidance, not an error. Install Ollama (or make sure it's running), then come back to this page.
    • If Ollama is running but no model has been pulled yet, the page tells you to open a terminal and run ollama pull <model> (for example ollama pull llama3.1), then come back.
  5. Once at least one model is installed, pick it from the Model dropdown — it replaces the API Key field for this provider — and click Verify & Save.

That's it: no .env file, no quitting Agon, no restart. The change takes effect immediately, the same as saving a Gemini or Groq key.

Settings → AI Assistant now shows Configured · Ollama (local). If you later save a provider key with Use your own provider key instead, that key takes priority over the local model.

Privacy: where your prompts go​

  • Directly from your computer to the provider you chose. When you use Gemini or Groq, your question and the information the assistant needs to answer it travel straight from the computer running Agon to that provider. They never pass through Agon's developer or any server run for Agon.
  • With Ollama, nothing leaves your computer.
  • Your key stays on your computer. Agon stores it encrypted in your studio's local database and never shows it again after you save it. Remove key in Settings → AI Assistant deletes it at any time.
  • Free tiers may use your data. Some providers' free tiers may use the data you send to train or improve their models. For questions that include your clients' data, use a paid tier or a local model. Terms change over time, so check your provider's current terms and privacy policy before you start: Gemini API terms · Groq privacy policy.
  • Your studio is in control. Your studio has the agreement with the provider, so under GDPR that provider is a processor for your studio. The GDPR guide explains what that means for you.

A good habit: don't paste sensitive client details (health notes, for example) into the chat unless you're comfortable with your provider's terms.

If you expect heavy use​

Every provider limits how many requests a key can make per minute and per day. Free tiers have low limits. If several people use the assistant at the same time, or you use AI Action Mode during busy hours, you may see a message saying your AI provider is rate-limiting requests.

To fix it, raise your limits with the provider:

  • Google Gemini: enable billing on the Google Cloud project that owns your key. Google AI Studio shows your current tier and how to upgrade.
  • Groq: check your limits and upgrade options in the Groq console.

The same key keeps working in Agon after you upgrade. You don't need a new key and there's nothing to change in Agon. The provider bills you directly for anything beyond its free tier. A paid tier is also the recommended choice for client data (see the privacy section above).

What if something goes wrong?​

Agon says my key is invalid Check that you copied the whole key with no extra spaces, and that the provider you picked matches the key: a Groq key won't work as a Gemini key. Make sure the key wasn't deleted in the provider's console. A brand-new key can take a minute to start working, so wait and click Verify & Save again.

The assistant says my AI provider is rate-limiting requests You've reached your provider's limit. Wait a minute and try again, or raise your limits (see If you expect heavy use).

The assistant only shows help articles The assistant is in basic mode because no provider is connected. Follow the steps above to add a key. Settings → AI Assistant shows Not configured · basic mode when no provider is active.

I get "AI actions need an AI provider" in the middle of an action AI Action Mode can't finish a request without a provider. Add a key in Settings → AI Assistant, then ask again.

My key was working and now the assistant fails The key may have been deleted, expired or run out of quota on the provider's side. Create a new key and save it with Change in Settings → AI Assistant.

I want to switch provider or replace my key In Settings → AI Assistant, click Change next to the Key active badge, pick the provider, paste the new key and click Verify & Save.

I want to stop using my key In Settings → AI Assistant, click Remove key and confirm. Agon deletes the key from your studio's database and the assistant switches to basic mode straight away, with no restart. If you think the key may have leaked, also delete (revoke) it in your provider's console (Google AI Studio or the Groq console) so nobody else can use it.

Settings → AI Assistant says Ollama (local) isn't reachable Ollama isn't installed or isn't running. Install it from ollama.com (or start it if it's already installed), then reopen Settings → AI Assistant — it checks again automatically, with nothing to restart.

No models appear in the dropdown Open a terminal and run ollama pull <model> (for example ollama pull llama3.1) to download a model, then reopen the AI Provider dropdown, or leave and revisit Settings → AI Assistant, so it can find the model you just pulled.

Frequently asked questions​

Does the AI Assistant cost anything? Agon doesn't charge for it. Your provider may: free tiers have usage limits, and anything beyond them is billed by the provider directly to you.

Can Agon's developer see my questions? No. Prompts go from your computer straight to the provider you chose, or stay on your computer with Ollama.

Which provider should I choose? Gemini is the quickest to set up. For client data, a paid tier of any provider or a local model is the safer choice.