Hierarchical Cluster Engine Project

HCE project aim and main idea

The main idea of this project – to implement the solution that can be used to: construct custom network structures (mesh or distributed network cluster) with several relations types between nodes, formalize the data flow processing goes from upper node level central source point to down nodes and backward, formalize the management requests handling from multiple source points, support native reducing of multiple nodes results (aggregation, duplicates elimination, sorting and so on), internally support powerful full-text search engine and data storage, provide transactions-less and transactional requests processing, support flexible run-time changes of cluster infrastructure, have many languages bindings for client-side integration APIs in one product build on C++ language…

But now bindings for the PHP and Python languages and applied services Distributed Crawler (DC) and Distributed Tasks Manager (DTM) is a most of dynamically development progress parts.

This project became the successor of Associative Search Machine (ASM) full-text web search engine project that was developed from 2006 to 2012 by IOIX Ukraine.

Architecture

HCE implements hierarchical networking and parallel data processing with MOM-oriented pattern of inter- and inproc requests handling architecture.

Core of HCE implemented as binary executable written on pure C++ with usage of modern patterns and libraries like POCO C++ Framework, STL C++11, ZMQ, and so on…

Management tools, API and scenarios for administration of typical operations are implemented on several languages like PHP and Python using structural and OOP styles.

License

All parts of HCE provided according with GPL2 license.

Externals

Discussion forum opened at sourceforge.net.

Discussion blog opened at hierarchical-cluster-engine.blogspot.com.

Articles at codeproject.com

SlideShare 1, 2, 3.

Wiki pages

Essentials

POCOPROJECT

SPHINX SEARCH

ZEROMQ

 

Copyright © 2013-2014, IOIX Ukraine.