統一數據分析接口，Apache Lens 2.4.0-beta 發布
Lens 提供了一個統一數據分析接口。通過提供一個跨多個數據存儲的單一視圖來實現數據分析任務切分，同時優化了執行的環境。無縫的集成 Hadoop 實現類似傳統數據倉庫的功能。
該項目主要特性：
-
簡單元數據層為數據存儲提供抽象視圖層
</li> -
單一的共享模式服務器，基于 Hive 元存儲。模式通過數據管道 HCatalog 和分析應用進行共享：
</li>-
OLAP Cube QL 類似 SQL 的高級語言用來查詢和描述存放在不同數據立方體 (Cubes) 中的數據集
</li> -
JDBC 驅動和 Java 客戶端庫來處理查詢
</li> -
Lens 應用服務器 - 這是一個 REST 服務器允許用戶查詢數據，更改數據模型，調度查詢和查詢的配額限制
</li> -
基于驅動的架構 允許在報表系統中進行嵌入，例如 Hive、列數據存儲、Redshift 等
</li> -
基于成本算法的引擎選擇 - 該算法可優化資源的使用，通過對查詢的復雜度自動選擇最佳執行引擎
</li> </ul> </ul>Apache Lens 的架構如下：
Apache Lens 2.4.0-beta 發布，此版本更新內容如下：
子任務
-
[LENS-113] - Document how to document a feature in contributor guide
</li> -
[LENS-399] - TestRewriting test is failing with powermock incompatibility with jdk8
</li> -
[LENS-607] - Test Failures on java8
</li> -
[LENS-724] - Bump version in master to 2.4
</li> -
[LENS-732] - exclude patchprocess directory from licence check.
</li> -
[LENS-748] - Change version number to 2.4.0-beta-SNAPSHOT in master
</li> -
[LENS-790] - UI Module failing if maven version is < 3.1
</li> -
[LENS-802] - Merge master with current-release-line for 2.4
</li> -
[LENS-803] - Bump version in master to 2.5
</li> -
[LENS-804] - Verify Lens 2.4 issues
</li> -
[LENS-805] - Update 2.4 release documentation
</li> -
[LENS-806] - Update gpg keys in dist repo
</li> </ul>Bug 修復
-
[LENS-224] - FinishedLensQuery is not storing selectedDriver
</li> -
[LENS-446] - server params should not be passed to session and drivers
</li> -
[LENS-576] - Cannot retrieve query results on lens server restart
</li> -
[LENS-734] - Query output files should have the query name
</li> -
[LENS-745] - Drop partition is assigning latest=null if latest partition is being dropped
</li> -
[LENS-756] - Example query on customer_city_name failing
</li> -
[LENS-762] - Partition Created for querystats is not honouring "lens.server.statistics.warehouse.dir"
</li> -
[LENS-765] - null Error Message on Lens Server logs
</li> -
[LENS-774] - Unable to override "lens.server.session.expiry.service.interval.secs" because of spelling mistake
</li> -
[LENS-775] - NPE on closing HadoopFileFormatter
</li> -
[LENS-777] - Query remains in queue even when driver is free
</li> -
[LENS-792] - StatusPoller logs are useless
</li> -
[LENS-795] - Look ahead is failing with partition not found if any process time partitions are absent
</li> -
[LENS-816] - ThreadSafeEstimatedQueryCollection is ignoring driver argument in getQueries and getQueryCount
</li> -
[LENS-826] - lens.client.query.poll.interval needs doc update
</li> -
[LENS-847] - Columnar JDBC Rewriter in incorrectly pushing filter against wrong alias when fact columns map to a single dimension
</li> -
[LENS-852] - lens-ship-jars in current-release-line branch should have parent version 2.4.0-beta-SNAPSHOT instead of 2.5.0-beta-SNAPSHOT
</li> </ul>改進
-
[LENS-341] - Lens is not building against on JAVA-8
</li> -
[LENS-392] - Look ahead timerange should not look for all finer granularity partitions to be present
</li> -
[LENS-533] - Critical metrics for lens
</li> -
[LENS-559] - Add inline values to be specified for XDimAttribute in xsd
</li> -
[LENS-629] - A new, improved web client.
</li> -
[LENS-693] - Queries get purged to DB as soon as they finish
</li> -
[LENS-710] - Allow column name mapping for few/all columns in underlying storage tables
</li> -
[LENS-716] - Support for !=, in and not in predicates in elastic search driver
</li> -
[LENS-731] - Enhance cube.xsd to accept Hierarchical dimattribute and inline dimattribute
</li> -
[LENS-737] - Throw single error out with LensMultiException
</li> -
[LENS-739] - Generate udf jar for lens-regression
</li> -
[LENS-753] - Queue number for queries
</li> -
[LENS-755] - rename LogicalTableCrudCommand to ConceptualTableCrudCommand and PhysicalTableCrudCommand to LogicalTableCrudCommand
</li> -
[LENS-757] - Examples should continue to run in case submission failures
</li> -
[LENS-772] - Both time and size based rolling for logs
</li> -
[LENS-782] - UI support for the saved, parametrized query feature.
</li> -
[LENS-796] - Slow response times for /metastore/nativetables API
</li> -
[LENS-797] - Improve CLI documentation to mention the helpful role of pressing tab while writing commands
</li> -
[LENS-831] - Create a single jar for shipping with hive queries
</li> </ul>新特性
-
[LENS-742] - Saved query and parameterization
</li> -
[LENS-752] - Support flattening of columns selected through bridge-tables(many-to-many relationships)
</li> </ul>任務
-
[LENS-108] - Improve developer documentation
</li> -
[LENS-187] - Move cube specific error message codes from InMobi's Hive code to Lens
</li> -
[LENS-758] - Remove feather logo from the repository, use already existing image to display on website
</li> -
[LENS-784] - setup build job with java8 on jenkins
</li> -
[LENS-801] - Release Lens 2.4.0-beta
</li> </ul>更多內容請看發行說明。
來自：http://www.oschina.net/news/68340/apache-lens-2-4-0-beta
本文由用戶 c8yy 自行上傳分享，僅供網友學習交流。所有權歸原作者，若您的權利被侵害，請聯系管理員。轉載本站原創文章，請注明出處，并保留原始鏈接、圖片水印。本站是一個以用戶分享為主的開源技術平臺，歡迎各類分享！
-
-
-
-
-
-