关键词: Hadoop, 大数据, 安全机制, 安全组件, 细粒度, 高度模块化

Abstract: Hadoop has become the most popular analysis framework which is used to open source of cloud computing and big data , at the same time,its security mechanism has also been treated as a critical item. This paper first gives an overview on Hadoop design principle, architecture, major threat, security mechanism, and design challenge which include the security solutions of enterprise and the security mechanism of Hadoop. The research on security mechanism of Hadoop are active, which present trusted platform, encryption algorithm,mixed encryption algorithm,TDEA and parallel encrypt algorithm and so on. Since Hadoop ecosystem involves many components, and different components have different security mechanisms, the current research focus is to enhance finegrained, highly modular, expandability and other aspects, while taking the performance, cost, usability and other issues into account.

Key words: Hadoop, big data, security mechanism, security component, finegrained, highly modular