程学旗*,刘盛华,张儒清.大数据分析处理技术新体系的思考[J].中国科学院院刊,2022,37(1):60-67.
大数据分析处理技术新体系的思考
Thinking on New System for Big Data Technology
大数据分析处理技术新体系的思考
Thinking on New System for Big Data Technology
作者
程学旗*
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
CHENG Xueqi*
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
刘盛华
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
LIU Shenghua
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
张儒清
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
ZHANG Ruqing
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
CHENG Xueqi*
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
刘盛华
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
LIU Shenghua
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
张儒清
中国科学院计算技术研究所 北京 100190;中国科学院大学 计算机科学与技术学院 北京 100049
ZHANG Ruqing
Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China
中文关键词
大数据;技术架构;系统栈;新模式;新范式;安全可信
英文关键词
big data;technology architecture;software system stack;new model;new paradigm;security and trustworthy
中文摘要
近年来，大数据技术与系统在性能和效率方面已经取得了显著的提升，大数据应用到各个行业，赋能产业智能化发展，成为信息社会进入智能化阶段的关键要素。然而，大数据技术发展也面临着更深层次的挑战，如数据泛滥与高价值数据缺失并存、大数据分析研判复杂不确定、数据流通共享与数据可信安全使用难以兼顾等。这些挑战将推动大数据分析处理技术的创新变革，促进新技术体系的建立与发展。文章面向大数据分析处理面临的新架构、新模式、新范式和安全可信需求，提出构建新一代大数据分析处理系统栈，探索大数据价值利用新范式，并展望新技术体系下的牵引性需求与重大应用。
英文摘要
In recent years, there are such significant improvements on the performance and efficiency of big data technology and system. As it is widely applied in various fields, big data has empowered industrial intelligence, and is the key step into the intelligent stage of information society. Therefore, we are facing greater challenges nowadays, such as the paradox of data flooding and high-value data lacking, the complexity and uncertainty of big data analysis, and the difficulty to balance the data on sharing and circulation, and trustworthiness and security. Moreover, these challenges will not only promote the innovation and change of big data technology, but also develop and establish a new technology system. With respect to the requirements of new architecture, new paradigm, new model and security and trustworthiness, this study proposes to build a new big data analyzing and processing system stack, explore the new paradigm of extracting big data value, and outlook on the pioneer applications as the traction to a broad range of fields.
DOI10.16418/j.issn.1000-3045.20211117005
作者简介
程学旗 中国科学院计算技术研究所副所长、研究员,国家杰出青年科学基金、国务院特殊津贴获得者。担任中国计算机学会(CCF)大数据专家委员会秘书长、中国工业与应用数学学会 (CSIAM)大数据与人工智能专委会副主任、中国中文信息学会信息检索专委会主任。在大数据分析系统、Web信息检索与数据挖掘等领域发表学术论文 200余篇,获授权发明专利 60余项。获国家科技进步奖二等奖 3项、国家技术发明奖二等奖 1项。
E-mail:cxq@ict.ac.cn
CHENG Xueqi Professor and Deputy Director of the Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS). He was funded by the National Science Fund for Distinguished Young Scholars of National Natural Science Foundation of China and enjoys the State Council Special Allowance. He is the Secretary General of the CCF Task Force on Big Data, the Deputy Chair of the CSIAM Activity Group on Big Data and Artificial Intelligence, and the Chair of the Technical Committee on Information Retrieval, Chinese Information Processing Society of China. He has published more than 200 papers, and has more than 60 authorized patents on big data analysis system, web information retrieval and data mining. He has awarded three times of second prize of National Science and Technology Progress Award and one second prize of National Technology Invention Award.
E-mail:cxq@ict.ac.cn
E-mail:cxq@ict.ac.cn
CHENG Xueqi Professor and Deputy Director of the Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS). He was funded by the National Science Fund for Distinguished Young Scholars of National Natural Science Foundation of China and enjoys the State Council Special Allowance. He is the Secretary General of the CCF Task Force on Big Data, the Deputy Chair of the CSIAM Activity Group on Big Data and Artificial Intelligence, and the Chair of the Technical Committee on Information Retrieval, Chinese Information Processing Society of China. He has published more than 200 papers, and has more than 60 authorized patents on big data analysis system, web information retrieval and data mining. He has awarded three times of second prize of National Science and Technology Progress Award and one second prize of National Technology Invention Award.
E-mail:cxq@ict.ac.cn
