Posts

Showing posts from May, 2024

Visualising AI Embeddings in APEX

Image
" To deal with hyper-planes in a 14-dimensional space, visualize a 3-D space and say 'fourteen' to yourself very loudly. Everyone does it."     - Geoffrey Hinton , 2018 Turing Award winner. Within the wonderful world of  Generative AI , one concept that is all the rage is RAG, or  Retrieval Augmented Generation , which is an  AI framework that combines the strengths of traditional information retrieval systems (such as databases) with the capabilities of generative large language models (LLM s) . RAG's goal is to improve the accuracy, relevance, and timeliness of information  generation  - such as  documents, text and images -  by optimizing LLM output.  When creating a RAG system, it’s essential to store information in a format that a LLM can retrieve. This is where  data is converted into embeddings through a process that uses pre-trained m

Oracle Select AI and APEX

Image
Yes, yes, I know, it's my first blog post in 10 years.  A s Oracle is doing some really interesting stuff with AI I thought I'd break cover and do a post showing a little something I've been working on. It's probably not escaped your attention that Oracle recently announced the release of Oracle Database 23ai (on OCI/Azure now but not yet on-prem), with a host of new features to allow developers to incorporate generative AI (genAI) into their work which will ultimately help end users be more productive. One AI feature that was released in 2023 prior to this announcement is Select AI , or Autonomous Database Select AI to give it the proper title.   This is a feature of the Autonomous Database that enables data to be queried using natural language, generating (ANSI) SQL from genAI large language models (LLMs) such as  OpenAI,  Cohere and Azure OpenAI.   There's a great  demo put together by the Oracle APEX team demonstrating Select AI working with APEX.  In the demo