[Z3-zemantic] Re: big zemantic storage / some changes

[Tarek Ziadé]

David Pratt wrote:

> Hi Reinout.  Yes, I have read your blog on your pursuits with the 
> library and found it very interesting.  In fact, when I look at 
> zemantic and what you have accomplished it gives me good reason to 
> believe a product for zope2 can come out of this. Tres has sent me 
> some starting code on a ZemanticIndex product for Zope 2 indexing he 
> has worked out.  I would also like to see if it is possible to store 
> the triples in another container besides zodb.  My goal is to see if 
> postgres could be used as a datastore for rdf metadata and query from 
> it to keep it out of the zodb since it could slow things down big time 
> if you had millions of triples.
>
> You have some interesting experience with the library.  Tres has 
> advised that his time is really limited and he is looking to have a 
> person take it over since he wouldn't be able to get back to it again 
> for a while.  I realize that I am limited in the sense that I am just 
> at the stage of beginning stages but am very interested and willing to 
> commit some time.  Would you be willing to help too?  I can forward 
> what Tres has sent. Tarek has also indicated he has been able to get 
> zemantic to work in Zope2 in zodb but read of the long response to 
> large zemantic storage in zodb which is the reason I am interested in 
> exploring postgres for storage and queries . Perhaps with a few of us, 
> we can make it happen.

Zemantic comes with a really nice backend, called by rdflib (ZODBBackEnd 
and others in the lib folder). I think you should be able to code your 
own backend for postgresql and instanciate the triplestore with it, so 
imho I guess there's no need for a ZemanticExternalRepository.

I am very interesting in this, tell me if you start something

>
> I realize also that 2.8 is around the bend but wonder how large the 
> RAM footprint will be to have Zope2, Five and Zope3 together since 
> this is the other big issue for me as far as serving since I can't 
> afford beefy machines.  

Zope 3 is not launched through Five, it's just a link to its code so it 
is usable within a Zope 2 instance.

> [snip]
>


-- 
Tarek ZIADE, Nuxeo SARL: Zope Service Provider.
Mail: tz at nuxeo.com - Tel: +33 (0)6 30 37 02 63
Nuxeo Collaborative Portal Server: http://www.nuxeo.com/cps
Gestion de contenu web / portail collaboratif / groupware / open source