Mindoo Blog - Cutting edge technologies - About Java, Lotus Notes and iPhone

  • English slides for my Entwicklercamp 2012 session about NoSQL databases

    Karsten Lehmann  5 April 2012 00:07:41
    As promised, here are the translated files for my NoSQL session at this year's Entwicklercamp (developer camp) conference in Gelsenkirchen, Germany.

    Image:English slides for my Entwicklercamp 2012 session about NoSQL databases

    I am still searching for time to polish the two demos: MongoDb integration in XPages apps and NoSQL integration in XPages apps.
    Next week is blocked for German holidays. Need to work on the demos afterwards.

    Comments

    1Toby Samples  05.04.2012 05:35:23  English slides for my Entwicklercamp 2012 session about NoSQL databases

    Nice Presentation, I'd love to see your demo nsf's, Also curious if you looked at orient db?

    It appeared to have some nice features.

    { Link }

    2Julian Buss  05.04.2012 09:29:02  English slides for my Entwicklercamp 2012 session about NoSQL databases

    nice one, thanks Karten, I learned a lot from your presentation.

    3Karsten Lehmann  05.04.2012 10:00:59  English slides for my Entwicklercamp 2012 session about NoSQL databases

    Thanks!

    @Toby: Yes, I looked at Orient Db and I had a few things about it in my Mindmap. Had to remove them for the presentation, because 60 slides were already a lot of stuff for a 90 minutes session with two demos.

    Orient Db has an interesting object inheritance mechanism to define hierarchies of object types.

    4Henning Heinz  05.04.2012 13:22:00  English slides for my Entwicklercamp 2012 session about NoSQL databases

    Very nice presentation. Thank you.

    I think the 64GB hard limit of nsf has recently been removed but still only 64GB are supported.

    I also think MongoDb has raised the 4MB limit to 16MB (at the document level) without GridFS.

    If I remember correct CouchDb also had the possibility to store attachments within documents but as you have written the future of CouchDb is uncertain (I would even extend this to CouchBase).

    Your slides remembered me that nsf would kick ass if it would have been allowed to grow (and it still has its advantages after all these years).

    5Karsten Lehmann  05.04.2012 14:08:56  English slides for my Entwicklercamp 2012 session about NoSQL databases

    @4: You're right, the doc size limit now is 16 MB as mentioned here:

    { Link }

    But 4 MB (the old limit) was already a lot if you just save text, as discussed here:

    { Link }

    6Karsten Lehmann  05.04.2012 14:11:18  English slides for my Entwicklercamp 2012 session about NoSQL databases

    We talked about NSF improvements with IBMers a few days ago. They said that the NSF code is about 15 years old, so everything that can be developed on top of the existing codebase (like the XPages extension library or new Java API functions that call existing C API methods) is a welcome feature request and likely to be implemented.

    But there are no realistic plans to improve the on disk structure a lot.

    At least, further query capabilities for Notes/Domino can be achieved by adding an external indexer like Apache Lucene to a Domino server. We have done this in a project recently.

    As discussed here

    { Link }

    Lucene has geo spatial index support built-in.

    And the combination of Apache Solr and Lucene are also quite scalable:

    { Link }

    But of course this means extra work, both for the developer and for the admin.

    7Henning Heinz  05.04.2012 16:52:52  English slides for my Entwicklercamp 2012 session about NoSQL databases

    I don't think this will work in the long run.NSF is the heart of Notes and Domino. If it is not going to be fundamentally improved/changed, even more companies will stop using the platform. We will see. Life with Notes and Domino never gets boring.

    8Erik Brooks  13.04.2012 18:27:04  English slides for my Entwicklercamp 2012 session about NoSQL databases

    It worked in 8.5.1+, but IBM officially supports NSF > 64GB with DOAS running as of 8.5.3.

    9Karsten Lehmann  13.04.2012 18:40:06  English slides for my Entwicklercamp 2012 session about NoSQL databases

    "Big Data" means storing several TBs of data in a server cluster, which is not impossible with Notes (by splitting data into several databases manually), but a lot more work than for example with MongoDB, especially because you have to develop the query engine and do result merging on your own. I'd love to see support for this in Notes, but that's not very likely to happen.

    10Adrian Reason  02.10.2012 15:08:06  English slides for my Entwicklercamp 2012 session about NoSQL databases

    @9 Sun & Son have already worked with the IBM CIO office solving the key issues around Data integration and Data Query - we are also working ( with Philippe Riand and the X Pages team support) on a peformant Notes JDBC solution that is integrated with our Data Modeler and Data Bridge) We have also designed with the Support of the IBM CIO Office a Virtual NSF solution that does not require Lotus to touch the NSF but uses the proven S & S Relational Data Bridge technology to move Notes indexing to DB2. We fully support Cognos, IBM IIS, IBM QMF 10, IBM Data Quant and DB2 Query for iSeries. We have already worked with the IBM BIG Data team on positioning the architecture - so Lotus NOSQL world is brought fully into the mainstream - to find out more please feel free to contact me at areason@sunandson.com