AI interview: Chunk wisely to avoid RAG hell

DataStax's Ed Anuff on the finer points of AI app development

John Leonard
clock • 4 min read
AI interview: Chunk wisely to avoid RAG hell
Image:

AI interview: Chunk wisely to avoid RAG hell

"Almost any developer worth their salt could build a RAG application with an LLM, once they understand the basics of it," said chief product officer at DataStax, Ed Anuff.

"And then chunking hits and your results start to get really wonky. Now you're in RAG hell, and you have to go off and Google." Most of us, we suspect, would have gone off and Googled well befor...

To continue reading this article...

Join Computing

  • Unlimited access to real-time news, analysis and opinion from the technology industry
  • Receive important and breaking news in our daily newsletter
  • Be the first to hear about our events and awards programmes
  • Join live member only interviews with IT leaders at the ‘IT Lounge’; your chance to ask your burning tech questions and have them answered
  • Access to the Computing Delta hub providing market intelligence and research
  • Receive our members-only newsletter with exclusive opinion pieces from senior IT Leaders

Join now

 

Already a Computing member?

Login

You may also like
Dell confirms data breach affecting 49m people

Hacking

No financial info stolen, but names and addresses were leaked

clock 10 May 2024 • 2 min read
Russian network found using genAI to spread disinformation

Threats and Risks

CopyCop aims to fuel discord and weaken support for Ukraine

clock 10 May 2024 • 2 min read
'Levelling up cybersecurity is a team effort,' says Jacob DePriest of GitHub

Open Source

But security starts with developers, and AI isn’t going to replace them

clock 09 May 2024 • 5 min read

More on Developer

Stack Overflow subscribers rebel over OpenAI deal

Stack Overflow subscribers rebel over OpenAI deal

Reverse ferret on GenAI hasn’t gone down well with developers

Penny Horwood
clock 09 May 2024 • 3 min read
AI interview: Chunk wisely to avoid RAG hell

AI interview: Chunk wisely to avoid RAG hell

DataStax's Ed Anuff on the finer points of AI app development

John Leonard
clock 15 March 2024 • 4 min read
 Github releases results of first empirical study of DevEx

Github releases results of first empirical study of DevEx

Results show that improving developer experience matters more than you might think

Penny Horwood
clock 24 January 2024 • 4 min read