Gearpump：基于 Akka 的大數據實時處理引擎

jopen 10年前發布 | 15K 次閱讀 大數據 分布式/云計算/大數據 AKKA

Gearpump is a real-time big data streaming engine.

It is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks.

Gearpump is event/message based and featured as low latency handling, high performance, exactly once semantics,

dynamic topology update, Apache Storm compatibility, etc.

The name Gearpump is a reference to the engineering term “gear pump,” which is a super simplepump that consists of only two gears, but is very powerful at streaming water.

Gearpump Technical Highlights

Gearpump is a modern big data real-time streaming engine which has many unique features:

Extremely high performance

Low latency

Configurable message delivery guarantee (at least once, exactly once).

Highly extensible

Dynamic DAG

Storm compatibility

Samoa compatibility

widely IoT connectivity

Both high level and low level API

Gearpump Performance

Per initial benchmarks we are able to process 18 million messages/second (100 bytes per message) with a 8ms latency on a 4-node cluster.

Gearpump and Akka

Gearpump is a 100% Akka based platform. We model big data streaming within the Akka actor hierarchy.

Gearpump

來自： http://www.thebigdata.cn/QiTa/28965.html

 本文由用戶 jopen 自行上傳分享，僅供網友學習交流。所有權歸原作者，若您的權利被侵害，請聯系管理員。
 轉載本站原創文章，請注明出處，并保留原始鏈接、圖片水印。
 本站是一個以用戶分享為主的開源技術平臺，歡迎各類分享！