[Z3-zemantic] Scalability, part 2

[Michel Pelletier]

On Wednesday 09 March 2005 07:10 am, Michel Pelletier wrote:

>
> Definitely, one thing to note, their system has text indexing on literals,
> but they do it in a broken way, they "tokenize" the literals and index
> them, but tokenization is a language specific concept, they don't explain
> how to abstract out languages that cannot be tokenized on simple spaces. 
> My guess is they copped out of that problem (ie, what Vocabularies do for
> ZCatalog).

After reading that I should be more fair, it possible they implemented true 
tokenizing some other way that they don't describe.

-Michel