Apache NiFi v0.7.0 發布，一個易于使用、功能強大而且可靠的數據處理和分發系統

jopen 9年前發布 | 15K 次閱讀 HTTPS SSH SSL Apache NiFi

Apache NiFi 是一個易于使用、功能強大而且可靠的數據處理和分發系統。Apache NiFi 是為數據流設計。它支持高度可配置的數據路由有向圖、轉換和系統中介邏輯。它包含了以下特性：

  • 基于web的用戶界面

    • 無縫體驗設計、控制和監視

    </li>

  • 高度可配置的

    • 數據丟失容錯和保證交付

    • 低延遲和高吞吐量

    • 動態優先級

    • 流可以在運行時修改

    • 背壓 Back presure

      • </ul> </li>

    • 數據來源

      • 從始至終跟蹤數據流

        • </ul> </li>

      • 為擴展設計

        • 構建自己數據處理器

        • 支持快速開發和有效的測試

          • </ul> </li>

        • 安全

          • SSL,SSH,HTTPS加密內容,等等……

          • 可插拔的基于角色的驗證/授權

            • </ul> </li> </ul>

            架構：

            集群管理器：

            主界面：

            更新日志

            • New Application Features
              • NiFi now supports exposing key/value pairs set in "nifi.properties" to Expression Language.
              </li>
            • Improvements to Existing Capabilities
              • Added the ability to bulk using Index or Update to PutElasticSearch.
              • Allow concurrent execution of ExecuteScript.
              • Expression language now has a random number function.
                • </ul> </li>
              • New Extensions
                • New processors to Get data from SNMP agents and execute SNMP set requests.
                • Added new processor to Put to Slack.
                • New processors to Get and Put data to an MQTT broker.
                • Added processor to listen for messages using the Lumberjack protocol.
                • New ExtractMediaMetadata processor to extract metadata from various file types using Apache Tika.
                • New processors to Delete, Put and Get AWS DynamoDB.
                • Added processor to poll notification events provided by HDFS Inotify interface.
                • Add ReportingTask for sending Provenance events over Site-To-Site.
                  • </ul> </li>
                • Important Stability Improvements
                  • Fixed instance where archiver was not respecting nifi.content.repository.archive.max.usage.percentage.
                  • Resolved issue where incoming connection could be deleted while processor was still running.
                  • Fixed issue where FileSystemRepository could leave open file handles to data that had already been archived and/or deleted.
                    • </ul> </li>
                  • New Documentation