Archive for the ‘MaJorToM’ Category

Scalability of Topic Map Systems

Saturday, April 28th, 2012

Scalability of Topic Map Systems, thesis by Marcel Hoyer.

Abstract:

The purpose of this thesis was to find approaches solving major performance and scalability issues for Topic Maps-related data access and the merging process. Especially regarding the management of multiple, heterogeneous topic maps with different sizes and structures. Hence the scope of the research was mainly focused on the Maiana web application with its underlying MaJorToM and TMQL4J back-end.

In the first instance the actual problems were determined by profiling the application runtime, creating benchmarks and discussing the current architecture of the Maiana stack. By presenting different distribution technologies afterwards the issues around a single-process instance, slow data access and concurrent request handling were investigated to determine possible solutions. Next to technological aspects (i. e. frameworks or applications) this discussion included fundamental reflection of design patterns for distributed environments that indicated requirements for changes in the use of the Topic Maps API and data flow between components. With the development of the JSON Topic Maps Query Result format and simple query-focused interfaces the essential concept for an prototypical implementation was established. To concentrate on scalability for query processing basic principles and benefits of message-oriented middleware were presented. Those were used in combination with previous results to create a distributed Topic Maps query service and to present ideas about optimizing virtual merging of topic maps.

Finally this work gave multiple insights to improve the architecture and performance of Topic Maps-related applications by depicting concrete bottlenecks and providing prototypical implementations that show the feasibility of the approaches. But it also pointed out remaining performance issues in the persisting data layer.

I have just started reading Marcel’s thesis but I am already impressed by the evaluation of Maiana. I am sure this work will be useful in planning options for future topic map stacks.

Commend it to you for reading and discussion, perhaps on the relatively quiet topic map discussion lists?

MaJorToM server v. 1.0.0 released

Wednesday, April 27th, 2011

MaJorToM server v. 1.0.0 released

From the post:

The MaJorToM server is a Spring application which provides a TMQL HTTP interface to query topic maps. The server is intended as back end for Topic Maps based applications.

Today the Topic Maps Lab has released the version 1.0.0 of the MaJorToM server. The server acts as TMQL endpoint for Topic Maps based applications. You can play around with an instance of the server here.

The sources of the MaJorToM server are available at Google code. In the installation instructions you will learn how you can build and deploy your own instances of the MaJorToM server. Once you have deployed the server for your own, you will have an administration interface and a TMQL interface. But the server is not only a TMQL endpoint for the data. It also provides full text search (based on Beru) and a SPARQL enpoint to the hosted topic maps.

With the next release Maiana will act as a frontend for topic maps delivered by remote MaJorToM server. Besides the Maiana integration the MaJorToM server is very well integrated with TM2O – the OData provider for Topic Maps.