簡化大數據應用開發 ,Spring XD 1.0.0.M5 發布
Spring XD是一個統一的,分布式,可擴展的系統用于 data ingestion,實時分析,批量處理和數據導出。該項目的目標是簡化大數據應用的開發。
Spring XD 團隊發布了 Spring XD 1.0.0 Milestone 5 版本,現已提供下載。
新特性:
-
Pre-defined batch jobs for JDBC to HDFS
</li> -
Many additional job shell commands for controlling and reporting on batch jobs.
</li> -
Hadoop Dataset Avro sink that uses the Kite SDK
</li> -
HDFS sink now supports codecs (gzip, snappy, bzip2, lzo) and fine-grained control over file naming
</li> -
JMS source module now support Topics in addition to Queues
</li> -
Improved support for use of Gemfire Locators
</li> -
Aggregator module for batching that also supports a backing message store for checkpointing the event stream to memory, Redis, or a relational database.
</li> -
Support for separate control and data transport protocols
</li> -
XD servers are now built on top of Spring Boot
</li> </ul>此版本解決了 140+ 個 Jira 問題,更多信息請前往: changelog 和 reference manual。
同時也提供了簡單的示例和部署到 EC2 上面的腳本。
如果你是個 Mac 用戶或者是 Homebrew 行家,可以像下面這樣安裝:
1
$ brew tap pivotal/tap
1
$ brew install springxd
本文由用戶 jopen 自行上傳分享,僅供網友學習交流。所有權歸原作者,若您的權利被侵害,請聯系管理員。轉載本站原創文章,請注明出處,并保留原始鏈接、圖片水印。本站是一個以用戶分享為主的開源技術平臺,歡迎各類分享!