Using SQL-Powered RAG to Better Analyze Database Data with GenAI

You know your organization needs to start leveraging generative AI (GenAI). But how do you get started? With data stored in databases holding your company’s critical information, applying large language models (LLMs) to that data might seem complex. However, you can actually start using LLMs to analyze your data in Oracle Autonomous Database in just minutes using SQL-powered retrieval-augmented generation (RAG).

What Is Retrieval-Augmented Generation (RAG)?

RAG allows you to apply the power of LLMs (e.g., creativity, deep understanding of language nuances) to information that the models know little or nothing about. That lack of knowledge might be because the information is private (e.g., in your database) or more recent than the model’s training data. By augmenting AI-generated content with authoritative information, RAG can help improve the accuracy, relevance, and reliability of GenAI output.

RAG is generally associated with vector databases, which help provide context to an LLM by allowing super-fast retrieval of similar data from storage engines (e.g., unstructured data, PDFs, documents), rather than just exact keyword matches. To gain insights using RAG:

1. Define your task using natural language.
2. Perform a vector similarity search against your data to get context.
3. Pass that information to the LLM.

You can now answer a natural language question like: “My customer thinks this condo is beautiful. What other condos in the Boston area look like that one and are in her price range?” That returns similar-looking homes that she can afford based on image similarity and her private financial information contained in the database.

What Is SQL-Powered RAG?

There are other ways to provide context to an LLM that are simpler but perhaps not as powerful as what’s described above. This approach works with the data that’s accessible to your Autonomous Database deployment (e.g., internal tables, data lakes, linked tables). To use RAG with Autonomous Database:

1. Define your task using natural language.
2. Provide a SQL query against your data to get context.
3. Pass that information to the LLM.

Conceptually, this looks very similar to using RAG with vector databases. Here’s an example of applying those steps in Autonomous Database using a sample Oracle APEX app.

Using SQL-Powered RAG

Autonomous Database provides a capability called Select AI that allows you to use LLMs with your data. A popular way to use Select AI is for natural language queries (see Autonomous Database speaks “Human” and Conversations Are the Next Generation in Natural Language Queries).

This is a little different than natural language queries; instead of generating a query, it combines the results of a SQL query with task instructions to produce a prompt. That prompt is passed to an LLM and processed, producing a recommendation, a summary or whatever your project asked it to do. To make this work:

1. Connect Autonomous Database to an LLM, such as Cohere on OCI Generative AI.
2. Use natural language to tell the LLM what you want to accomplish.
3. Define a query that has the information you want to analyze.
4. Package the data and the instructions into an “augmented” prompt.
5. Send the augmented prompt to the LLM and get your results.

Following are code examples for each of these steps. Check out this LiveLabs workshop if you want to run the steps on your own.

1. Connect Autonomous Database to an LLM

Select AI uses an AI profile to encapsulate connection information to an AI provider. Create a profile using the DBMS_CLOUD_AI.create_profile PLSQL procedure:

• This profile connects to OCI Generative AI, but you can connect to other providers such as OpenAI and Azure OpenAI.
• OCI Generative AI supports multiple models; the above connects to the cohere.command LLM.
• A credential is used to sign the request. This uses an Autonomous Database resource principal, which means your database instance needs access to the OCI Generative AI service using an identity management (IAM) policy. For services like Azure OpenAI, the credential must be created using your secret API key.

2. Use Natural Language to Tell the LLM What You Want to Do

There is an emerging science around prompt engineering trying to answer the question: “What is the best way to give instructions to the LLM?” You will want to test different prompts to see what gives the best results. Here’s an example:

---

Pick 5 great things to do at the location

1. Encourage the customer to do these recommendations.
2. Take into account all the information about the customer that’s provided, including family or dog situations, whether or not they have a car and their income level.
3. Format the result with emojis and make it fun.

---

3. Define a Query with the Information You Want to Analyze

The LLM has no knowledge about the person traveling to that location. Supply a database query that augments the instructions with the traveler’s profile:

4. Package the Data and Instructions into an Augmented Prompt

You want to provide clear instructions to the LLM to help it produce the best results. Supplying a JSON document is a great way to organize those instructions, and it’s incredibly easy to package SQL queries as JSON using Autonomous Database’s built-in JSON_OBJECT function:

This query returns a well-structured JSON document:

5. Send the Augmented Prompt to the LLM and Get Your Results

Select AI provides a simple function, DBMS_CLOUD_AI.GENERATE, to communicate with the LLM. It uses the profile(s) created previously, making it easy to test results from different providers:

Check out the results for Jennine:

---

Here are five activity recommendations for you in Paris, taking into account your preferences and situation:

1. 🥂 Visit the Eiffel Tower and indulge in a romantic picnic with your spouse. 🍽️ Enjoy the breathtaking views of the City of Love while snacking on some French delicacies. Don’t forget to snap some pictures for your memories!

2. ✨ Immerse yourself in the art scene at the Louvre Museum. 🎨 Explore the vast collection of masterpieces and get lost in the corridors that house iconic artworks like the Mona Lisa. Take your time appreciating the diverse range of art forms and gain a deeper understanding of the history and culture of France.

3. 🚶 Experience the charm of Montmartre and stroll along the cobblestone streets. ✨ Discover the vibrant neighborhood adored by artists like Picasso and Van Gogh. Take in the stunning views of the city from the top of the Sacré-Cœur Basilica while appreciating the charming ambiance of this unique Parisian district.

4. ☕️ Treat yourself to a luxurious coffee break at a quaint café. 🧐 While exploring the city, take a break at a charming café and indulge in the finest French pastries and aromatic coffee. Enjoy people-watching and get a glimpse of the local lifestyle.

5. 🐶 If you’re an animal lover, consider visiting the Jardin du Luxembourg. 🐶 This lush park is not only a great spot to relax and appreciate nature but also has a dedicated area where you can admire the adorable stray cats that roam around. You can also bring your own snacks to feed the cats if you’d like.

I hope these suggestions help! If you have any preferences or additional information you’d like me to consider, please let me know, and I’ll be glad to provide more personalized recommendations.

Have a wonderful time in Paris!

Kindly note that while the above suggestions are primarily for your enjoyment, it’s always a good idea to do thorough research and make reservations or bookings in advance to ensure a smooth experience during your visit to Paris.

Safe travels and enjoy your stay!

---

I think Jennine is going to have a great time in Paris!

Summary

GenAI is mind-blowingly powerful, and with the right tools, you can easily apply it to your organization’s data. Take it for a spin! Check out the links to get hands-on experience.

• Learn more about RAG
• LiveLab: Develop Apps using GenAI, Autonomous Database and React
• Livelab: Chat with Your Data in Autonomous Database Using Generative AI

The post Using SQL-Powered RAG to Better Analyze Database Data with GenAI appeared first on The New Stack.

Combining retrieval-augmented generation (RAG) with SQL makes it easier to apply LLMs to wring more insights from your company data.