by Maria Deutscher
Graphon Inc., a startup with technology that makes artificial intelligence models better at processing large datasets, launched today with $8.3 million in funding.
Novera Ventures led the seed round. It was joined by more than a half dozen others including the venture capital arms of Perplexity AI Inc., Samsung Electronics Co and Hitachi Ltd.
Today’s most advanced large language models have a context window of 1 million tokens. That means a single prompt can only contain up to 1 million tokens worth of data, which corresponds to a few thousand pages of text. LLMs’ context window limits their ability to process larger datasets.
AI developers get around the context window limit using RAG, or retrieval-augmented generation, tools. Those are software modules that can analyze a dataset with more than 1 million tokens, extract key records and make them available to an LLM.
