[Z3-zemantic] Re: big zemantic storage / some changes

[David Pratt]

Hi Michel.

Thank you for your replies to the thread.  This is very helpful.  Is 
there interest in a sql backend for Zemantic?

The comments about large storage is real concern with the zodb only 
option in my view when you think how much metadata can be collected per 
record.  My feeling is it could lead to big RAM being needed for the 
application (this is unacceptable to me since not everyone can afford 
beefy servers to make this work)  Second the repository for me is 
something that I believe ought be able to be used more generally 
instead of tied specifically to the zope application so that is 
possible potentially for other applications to interact with it.  My 
hope is to use it as a container for other rdf data you wish to store 
and query as well from other sources than just the zope application. 
The archetypes ids for me are not important since I don't work with 
Plone but CMF due to GPL but I can see its potential role in Plone.   
Let me know when you are starting this rewrite since I have a strong 
interest in this and may have also tried some sql storage ideas by then.

Thanks for the advice on DMOZ file.  This is exactly what I was looking 
for.  I'll contact you back if I have trouble locating it.

Regards,
David


On Friday, May 13, 2005, at 09:12 PM, Michel Pelletier wrote:

> On Sat, 2005-05-14 at 01:21 +0200, Tarek Ziadé wrote:
>> David Pratt wrote:
>>
>>> [snip]
>>> Thanks for the pointers.  I will be attempting this and hoping I can
>>> get something started shortly.  I think I will play with rdflib by
>>> itself for a couple days first so I can get a feel for it on a stand
>>> alone basis.  Can I send Tres's work to you to examine for yourself?
>>> He has provided a good starting point.  I am hoping we can get this 
>>> to
>>> integrate with the library by building on what he has started.  The
>>> more the merrier if anyone else would be willing to help.  What I
>>> could really use is just a data set to work with of some files.
>>> Anyone have a small store of files that I can play with?  What would
>>> be good is some sample data for the library example of maybe half a
>>> dozen or so files.
>>
>> Are you talking about semantic content ? Maybe you should use existing
>> online rdf databases
>
> Right, David I'd recommend you check out sites like www.schemaweb.info
> for sample ontologies in RDF and personally I like the DMOZ RDF export
> file for pure scale testing (it's about 60MB of compressed RDF).  See
> dmoz.org for more info.  At the paris sprint Tarek also pointed out
> swoogle to me, which looks quite cool although I've had little time to
> play with it since.
>
> -Michel
>