Apache Storm?v1.0.2發布,一個分布式實時計算系統

jopen 8年前發布 | 23K 次閱讀 Hadoop Apache Storm

Apache Storm 的前身是 推ter Storm 平臺,目前已經歸于 Apache 基金會管轄。

Apache Storm 是一個免費開源的分布式實時計算系統。簡化了流數據的可靠處理,像 Hadoop 一樣實現實時批處理。Storm 很簡單,可用于任意編程語言。

Storm 有很多應用場景,包括實時數據分析、聯機學習、持續計算、分布式 RPC、ETL 等。Storm 速度非常快,一個測試在單節點上實現每秒一百萬的組處理。

目前已經有包括阿里百度在內的數家大型互聯網公司在使用該平臺。

更新日志

  • STORM-1939: Frequent InterruptedException raised by ShellBoltMessageQueue.poll
  • STORM-1968: Storm logviewer does not work for nimbus.log in secure cluster
  • STORM-1928: ShellSpout should check heartbeat while ShellSpout is waiting for subprocess to sync
  • STORM-1922: Supervisor summary default order by host
  • STORM-1956: Disabling Backpressure by default
  • STORM-1934: Fix race condition between sync-supervisor and sync-processes
  • STORM-1895: blobstore replication-factor argument
  • STORM-118: Docs: typo in transactional-commit-flow.png
  • STORM-1633: Document blobstore to command-line-client.md
  • STORM-1899: Release HBase connection when topology shutdown
  • STORM-1844: Some tests are flaky due to low timeout
  • STORM-1946: initialize lastHeartbeatTimestamp before starting heartbeat task
  • STORM-1941 Nimbus discovery can fail when zookeeper reconnect happens
  • STORM-1937 Fix WindowTridentProcessor cause NullPointerException
  • STORM-1924: Add a config file parameter to HDFS test topologies
  • STORM-1705: Cap number of retries for a failed message
  • STORM-1884: Prioritize pendingPrepare over pendingCommit
  • STORM-1575: fix 推terSampleSpout NPE on close
  • STORM-1874: Update logger private permissions
  • STORM-1865: update command line client document
  • STORM-1771: HiveState should flushAndClose before closing old or idle Hive connections
  • STORM-1882: Expose TextFileReader public
  • STORM-1864 : StormSubmitter should throw respective exceptions and log respective errors for registered submitter hook invocation
  • STORM-1887: Fixed help message for set_log_level command
  • STORM-1878: Flux can now handle IStatefulBolts
  • STORM-1861: Storm submit command returns exit code of 0 even when it fails.
  • STORM-1755: Revert the kafka client version upgrade in storm-kafka module
  • STORM-1853: Replace ClassLoaderObjectInputStream with ObjectInputStream
  • STORM-1868: Modify TridentKafkaWordCount to run in distributed mode
  • STORM-1859: Ack late tuples in windowed mode
  • STORM-1851: Fix default nimbus impersonation authorizer config
  • STORM-1848: Make KafkaMessageId and Partition serializable to support event logging
  • STORM-1862: Flux ShellSpout and ShellBolt can't emit to named streams
  • Storm-1728: TransactionalTridentKafkaSpout error
  • STORM-1850: State Checkpointing Documentation update
  • STORM-1674: Idle KafkaSpout consumes more bandwidth than needed
  • STORM-1842: Forward references in storm.thrift cause tooling issues
  • STORM-1745: Add partition to log output in PartitionManager
  • STORM-1735: Nimbus should log that replication succeeded when min replicas was reached exactly
  • STORM-1835: add lock info in thread dump
  • STORM-1749: Fix storm-starter github links
  • STORM-1764: Pacemaker is throwing some stack traces
  • STORM-1761: Storm-Solr Example Throws ArrayIndexOutOfBoundsException in Remote Cluster Mode
  • STORM-1756: Explicitly null KafkaServer reference in KafkaTestBroker to prevent out of memory on large test classes.
  • STORM-1750: Ensure worker dies when report-error-and-die is called.
  • STORM-1715: using Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST
  • STORM-1713: Replace NotImplementedException with UnsupportedOperationException
  • STORM-1678: abstract batch processing to common api BatchHelper
  • STORM-1773: Utils.javaDeserialize() doesn't work with primitive types
  • STORM-1661: Introduce a config to turn off blobstore acl validation in insecure mode

下載

 

本站原創,轉載時保留以下信息:
本文轉自:深度開源(open-open.com)
原文地址:http://www.baiduhome.net/news/view/65c4aab6

 

 本文由用戶 jopen 自行上傳分享,僅供網友學習交流。所有權歸原作者,若您的權利被侵害,請聯系管理員。
 轉載本站原創文章,請注明出處,并保留原始鏈接、圖片水印。
 本站是一個以用戶分享為主的開源技術平臺,歡迎各類分享!