Hello community, This week we'll going to have Tao Li (tomscut) speaking about the experience of operating HDFS at BIGO. See you on Thursday!
题目:《HDFS在BIGO的实践》 概要:HDFS作为大数据底层存储服务,在BIGO的发展中起到了非常重要的作用。随着业务的发展和数据的爆发式增长,HDFS单个集群的瓶颈愈发凸显,我们借助Router,将多个HDFS集群整合成一个Namespace,增强集群的扩展能力;改造Router,使其支持Alluxio和自定义策略,并开启HDFS EC,实现热、温、冷数据分层存储。同时,通过对HDFS集群慢节点和慢盘的处理,提升了HDFS的读写性能。本次分享主要讲述BIGO对Router的实践经验,以及对慢节点和慢盘的处理经验。 关键词:Router,Slow Node,Slow Disk 演讲者:Tao Li (Apache id: tomscut) Date/Time: Jan 6 2PM Beijing Time. Zoom link: https://cloudera.zoom.us/j/97264903288 One tap mobile +16465588656,,880548968# US (New York) +17207072699,,880548968# US Download Center <https://cloudera.zoom.us/j/880548968> Dial by your location +1 646 558 8656 US (New York) +1 720 707 2699 US 877 853 5257 US Toll-free 888 475 4499 US Toll-free Meeting ID: 972 6490 3288 Find your local number: https://zoom.us/u/acaGRDfMVl