集群管理器，Apache Mesos 0.24.1 發布

jopen 9年前發布 | 22K 次閱讀 Apache Mesos

Apache Mesos是一個集群管理器，提供了有效的、跨分布式應用或框架的資源隔離和共享，可以運行Hadoop、MPI、Hypertable、Spark。

Apache Mesos由四個組件組成，分別是Mesos-master，mesos-slave，framework和executor。

Mesos-master是整個系統的核心，負責管理接入mesos的各個framework（由frameworks_manager管理）和 slave（由slaves_manager管理），并將slave上的資源按照某種策略分配給framework（由獨立插拔模塊Allocator管 理）。

Mesos-slave負責接收并執行來自mesos-master的命令、管理節點上的mesos-task，并為各個task分配資源。 mesos-slave將自己的資源量發送給mesos-master，由mesos-master中的Allocator模塊決定將資源分配給哪個 framework，當前考慮的資源有CPU和內存兩種，也就是說，mesos-slave會將CPU個數和內存量發送給mesos-master，而用 戶提交作業時，需要指定每個任務需要的CPU個數和內存量，這樣，當任務運行時，mesos-slave會將任務放到包含固定資源的linux container中運行，以達到資源隔離的效果。很明顯，master存在單點故障問題，為此，mesos采用了zookeeper解決該問題。

Apache Mesos 0.24.1 發布，此版本主要是功能改進和 bug 修復：

Bug 修復

  • [MESOS-2166] -  PerfEventIsolatorTest.ROOT_CGROUPS_Sample requires 'perf' to be installed

  • [MESOS-2337] - __init__.py not getting installed in $PREFIX/lib/pythonX.Y/site-packages/mesos

  • [MESOS-2480] - Protobuf jar is required for unbundled protobuf regardless of --disable-java flag.

  • [MESOS-2493] - google glog link is incorrect

  • [MESOS-2497] - Create synchronous validations for Calls

  • [MESOS-2552] - C++ Scheduler library should send HTTP Calls to master

  • [MESOS-2559] - Do not use RunTaskMessage.framework_id.

  • [MESOS-2660] - ROOT_CGROUPS_Listen and ROOT_IncreaseRSS tests are flaky

  • [MESOS-2862] - mesos-fetcher won't fetch uris which begin with a " "

  • [MESOS-2868] - --attributes flag in slave cannot take a value with ':'

  • [MESOS-2882] - Duplicate name-value env-vars in '-e' option of docker run

  • [MESOS-2900] - Display capabilities in state.json

  • [MESOS-2989] - Changing to "framework" from "framwork"

  • [MESOS-3001] - Create a "demo" HTTP API client

  • [MESOS-3002] - Rename Option<T>::get(const T& _t) to getOrElse() broke network isolator

  • [MESOS-3027] - Compiler warning in stout subcommand tests

  • [MESOS-3053] - Failing DockerContainerizerTest.ROOT_DOCKER_Launch_Executor_Bridged

  • [MESOS-3058] - Cgroup tests relies on cgroups::get() returning in a specific order

  • [MESOS-3079] - `sudo make distcheck` fails on Ubuntu 14.04 (and possibly other OSes too)

  • [MESOS-3121] - Always disable SSLV2

  • [MESOS-3124] - Updating persistent volumes after slave restart is problematic.

  • [MESOS-3138] - PersistentVolumeTest.SlaveRecovery test fails on OSX

  • [MESOS-3141] - Compiler warning when mocking function type has an enum return type.

  • [MESOS-3143] - Disable endpoints rule fails to recognize HTTP path delegates

  • [MESOS-3148] - Resolve issue with hanging tests with Zookeeper

  • [MESOS-3168] - MesosZooKeeperTest fixture can have side effects across tests

  • [MESOS-3170] - 0.23 Build fails when compiling against -lsasl2 which has been statically linked

  • [MESOS-3175] - subprocess_tests.cpp:598 delete used but allocated with new[]

  • [MESOS-3178] - Perform a self bind mount of rootfs itself in fs::chroot::enter.

  • [MESOS-3192] - ContainerInfo::Image::AppC::id should be optional

  • [MESOS-3195] - Fix master metrics for scheduler calls

  • [MESOS-3197] - MemIsolatorTest/{0,1}.MemUsage fails on OS X

  • [MESOS-3201] - Libev handle_async can deadlock with run_in_event_loop

  • [MESOS-3203] - MasterAuthorizationTest.DuplicateRegistration test is flaky

  • [MESOS-3204] - PortMappingIsolatorProcess shell script can silently fail

  • [MESOS-3207] - C++ style guide is not rendered correctly (code section syntax disregarded)

  • [MESOS-3209] - parameterize allocator benchmark by framework count

  • [MESOS-3234] - enable automake maintainer mode

  • [MESOS-3237] - HTTP requests with nested path are not properly handled by libprocess

  • [MESOS-3238] - Master endpoint help message is incorrect

  • [MESOS-3260] - SchedulerTest.* are broken on OSX and CentOS

  • [MESOS-3262] - HTTPTest.NestedGet is flaky

  • [MESOS-3263] - SchedulerTask.KillTest fails for JSON Requests

  • [MESOS-3267] - JSON serialization/deserialization of bytes is incorrect

  • [MESOS-3274] - Build error with port mapping isolator

  • [MESOS-3275] - ContentType/HttpApiTest.UpdatePidToHttpSchedulerWithoutForce is flaky

  • [MESOS-3284] - JSON representation of Protobuf should use base64 encoding for 'bytes' fields.

  • [MESOS-3287] - downloadWithHadoop tries to access Error() for a valid Try<bool>

  • [MESOS-3290] - Master should drop HTTP calls when it's recovering

  • [MESOS-3294] - Failing ROOT_ tests on CentOS 7.1 - UserCgroupIsolatorTest

  • [MESOS-3296] - Failing ROOT_ tests on CentOS 7.1 - LinuxFilesystemIsolatorTest

  • [MESOS-3297] - Failing ROOT_ tests on CentOS 7.1 - MesosContainerizerLaunchTest

  • [MESOS-3311] - SlaveTest.HTTPSchedulerSlaveRestart

  • [MESOS-3321] - Spurious fetcher message about extracting an archive

改進

  • [MESOS-809] - External control of the ip that Mesos components publish to zookeeper

  • [MESOS-2350] - Add support for MesosContainerizerLaunch to chroot to a specified path

  • [MESOS-2736] - Upgrade the design of MasterInfo

  • [MESOS-2794] - Implement filesystem isolators

  • [MESOS-2795] - Introduce filesystem provisioner abstraction

  • [MESOS-2798] - Export statistics on "unevictable" memory

  • [MESOS-2800] - Rename Option<T>::get(const T& _t) to getOrElse() and refactor the original function

  • [MESOS-2841] - FrameworkInfo should include a Labels field to support arbitrary, lightweight metadata

  • [MESOS-2880] - Add Frameworkinfo.capabilities on framework re-registration

  • [MESOS-2902] - Enable Mesos to use arbitrary script / module to figure out IP, HOSTNAME

  • [MESOS-2946] - Authorizer Module: Interface design

  • [MESOS-2947] - Authorizer Module: Implementation, Integration & Tests

  • [MESOS-2951] - Inefficient container usage collection

  • [MESOS-2965] - Add implicit cast to string operator to Path.

  • [MESOS-2967] - Missing doxygen documentation for libprocess socket interface

  • [MESOS-3020] - Expose major, minor and patch components from stout Version

  • [MESOS-3054] - update gitignore

  • [MESOS-3093] - Support HTTPS requests in libprocess

  • [MESOS-3112] - Fetcher should perform cache eviction based on cache file usage patterns.

  • [MESOS-3118] - Remove pthread specific code from Stout

  • [MESOS-3119] - Remove pthread specific code from Libprocess

  • [MESOS-3120] - Remove pthread specific code from Mesos

  • [MESOS-3127] - Improve task reconciliation documentation.

  • [MESOS-3173] - Mark Path::basename, Path::dirname as const functions.

  • [MESOS-3182] - Make Master::registerFramework() and Master::reregisterFramework() call into Master::subscribe()

下載：http://www.apache.org/dyn/mirrors/mirrors.cgi/mesos/0.24.1/。

 本文由用戶 jopen 自行上傳分享，僅供網友學習交流。所有權歸原作者，若您的權利被侵害，請聯系管理員。
 轉載本站原創文章，請注明出處，并保留原始鏈接、圖片水印。
 本站是一個以用戶分享為主的開源技術平臺，歡迎各類分享！
  本文地址：http://www.baiduhome.net/news/view/6020fe