Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Page not found. Your pixels are in another canvas.
This is a page not in th emain menu
Posts
less than 1 minute read
Published:
蒙特卡洛树搜索
基本概念
less than 1 minute read
Published:
常量池
less than 1 minute read
Published:
Step1:类加载检查
less than 1 minute read
Published:
Kafka 基本概念
less than 1 minute read
Published:
Java 集合, 也叫作容器,主要是由两大接口派生而来:一个是 Collection
接口,主要用于存放单一元素;另一个是 Map
接口,主要用于存放键值对。对于Collection
接口,下面又有三个主要的子接口:List
、Set
和 Queue
。
less than 1 minute read
Published:
Yarn
任务提交流程
资源调度模型
Yarn中有三种调度器可以选择:FIFO、Capacity、Fair。 apache版本默认使用capacity。CHD版本默认使用fair。
- FIFO Scheduler 先来先服务
- FIFO Scheduler 把应用按提交的顺序排成一个队列,这是一个先进先出队列,在进行资源分配的时候,先给队列中最头上的应用进行分配资源,待最头上的应用需求满足后再给下一个分配,以此类推。
- FIFO Scheduler 是最简单也是最容易理解的调度器,也不需要任何配置,但它并不适用于共享集群。大的应用可能会占用所有集群资源,这就导致其它应用被阻塞,比如有个大任务在执行,占用了全部的资源,再提交一个小任务,则此小任务会一直被阻塞。
- Capacity Scheduler 能力调度器
- Fair Scheduler 公平调度器
less than 1 minute read
Published:
MapReduce
less than 1 minute read
Published:
HDFS
1 minute read
Published:
函数
less than 1 minute read
Published:
输入与输出
less than 1 minute read
Published:
字符串
1 minute read
Published:
字典和集合
less than 1 minute read
Published:
列表和元组
portfolio
常用电子书及资料文档
Short description of portfolio item number 2
publications
talks
teaching