[Z3-zemantic] Re: big zemantic storage / some changes

[David Pratt]

Hi Reinout.  Yes, I have read your blog on your pursuits with the 
library and found it very interesting.  In fact, when I look at 
zemantic and what you have accomplished it gives me good reason to 
believe a product for zope2 can come out of this. Tres has sent me some 
starting code on a ZemanticIndex product for Zope 2 indexing he has 
worked out.  I would also like to see if it is possible to store the 
triples in another container besides zodb.  My goal is to see if 
postgres could be used as a datastore for rdf metadata and query from 
it to keep it out of the zodb since it could slow things down big time 
if you had millions of triples.

You have some interesting experience with the library.  Tres has 
advised that his time is really limited and he is looking to have a 
person take it over since he wouldn't be able to get back to it again 
for a while.  I realize that I am limited in the sense that I am just 
at the stage of beginning stages but am very interested and willing to 
commit some time.  Would you be willing to help too?  I can forward 
what Tres has sent. Tarek has also indicated he has been able to get 
zemantic to work in Zope2 in zodb but read of the long response to 
large zemantic storage in zodb which is the reason I am interested in 
exploring postgres for storage and queries . Perhaps with a few of us, 
we can make it happen.

I realize also that 2.8 is around the bend but wonder how large the RAM 
footprint will be to have Zope2, Five and Zope3 together since this is 
the other big issue for me as far as serving since I can't afford beefy 
machines.  My feeling is that this is a necessary transition product 
but there is a huge base of Zope2 users that are a ways away from 
moving to Zope3 and a ZemanticIndex or a ZemanticExternalRepository 
product would be really interesting addition.

Regards,
David

On Saturday, May 7, 2005, at 04:18 PM, Reinout van Rees wrote:

> On Sat, 7 May 2005, David Pratt wrote:
>
>> I am currently working with Zope 2.7 and am wondering whether there
>> is something that I could try to work at the Zope 2.7 level this way
>> because I am trying to figure a way to tie together the rdf
>> resources generated in multiple sites into a single store and
>> something that could work as a product.  What version of rdflib are
>> you working with at present?
>>
>> I found a scrap that suggested that someone was working on something
>> that might work for Zope2
>
> The scrap you saw might have been my rdflib 1.x + zope 2.7
> combination. Just in case:
>
> http://vanrees.org/weblog/1111398880
>
> Note that I actively discourage you from really using it :-) But at
> least I got all the new-style classes out of rdflib, because they
> don't work with zope 2.7's zodb storage.
>
> I'm happy that zope2.8 is almost finished, that'll allow me to use
> semantic ;-)
>
> Reinout
>
> -- 
> Reinout van Rees                  r.van.rees at zestsoftware.nl
> http://vanrees.org/weblog/            http://zestsoftware.nl
> "engineer: a mechanism for converting caffeine into designs"
> _______________________________________________
> Z3-zemantic mailing list
> Z3-zemantic at codespeak.net
> http://codespeak.net/mailman/listinfo/z3-zemantic
>