关键词: 大数据, 并行计算, 水平扩展, 大数据安全, 大数据存储

Abstract: Based on the current domestic DBMS, the "BIGDATA" adaptation solution is put forward to improve the traditional DBMS. Designed and implemented the storage engine using the hybrid column compression technology to solve disk I/O problem of the "BIGDATA". Designed and implemented the intelligent indexing, hash index, substring indexes and custom word indexing technology to solve the performance problem of the key-search queries on the "BIGDATA" environment. Designed and implemented the multi-machine parallel (MPP) computing technology, multi-CPU core parallel (SMP) computing technology to solve the performance problem of the statistical analysis on the "BIGDATA" environment. Designed and implemented the data lifecycle management solutions to make purpose of the most valuable data using the most advantage of hardware resources. Designed and implemented the Share-Nothing architecture using auto extends online technology to solve the problem of the data become larger and larger over time. Through the cloud-based big data security framework, a distributed big data security solution is designed. To sum up in a word. Achieved a " big Data " storage platform in application transformation solution. Through testing and application effect analysis, verified the rationality of technical solutions. Specification of the Platform close to the target of similar foreign products.

Key words: big data, parallel computing, horizontal expansion, secure reliable bigdata, bigdata storage