Spring XD 1.1 RC1 發布
Spring XD 1.1 RC1 發布,此版本現已提供下載, 包括一些新特性和 bug 修復,主要是 Stream 處理。Spring XD 1.1. M2 中處理模塊引入了對 Reactor 的 Stream API 的支持。在 1.1 RC1 支持使用 RxJava 的 Observable API 和 Spark Streaming(支持現有的 Spark job)進行流處理。通過提供一系列的選項,你可以選擇最適合任務的函數式編程模塊。
Spark Streaming 集成特性如下:
-
XD Processor modules that act as drivers for workloads on the Spark Cluster.
-
An XD processor’s input DStream is generated from data received on the XD Message Bus, and the RDDs from its output DStream are sent to the bus.
-
The Spark Streaming driver process is automatically restarted if it dies due to the inherent module redeployment features of XD.
-
Simplify development and testing of Spark applications by decoupling your Spark computation code from code to setup input and output data.
RxJava 集成特性如下:
-
Development of processor modules using RxJava’s Observable API
-
Support for mapping input messages to one or multiple Observerble Stream instances
-
Refer to the rxjava-moving-average project for an example of using RxJava’s Observable API.
其他特性
-
Refactored Kafka Based Message Bus and Kafka Source based on the new Spring Integration Kafka client library.
-
Gemfire source and sink support for multiple locators.
-
Improved tooling and updated examples for custom module development.
相關鏈接:
-
StackOverflow
spring-xdtag
更多內容請看發行說明。
Spring XD 是一個統一的,分布式,可擴展的系統用于數據攝取,實時分析,批量處理和數據導出。該項目的目標是簡化大數據應用的開發。