So, why the big data has become the focus of everyone's attention? Big data brings the essence of what kind of change? To this end, we and China Computer Federation Big Data academic leaders, Dean of the School of Information, Renmin University of China Du Xiaoyong conducted interviews .
Large data (Big data) is generally used to describe large volumes of unstructured and semi-structured data to create the digital age. Big Data is undoubtedly one of the future development of all walks of life affect most watched technology.
2009, worldwide data on large research projects is still very limited, starting in 2011, more and more managers began to realize that big data will be the future development can not avoid the issue, by the end of 2012, the world Fortune 500 companies, 90% of companies have launched a big data project. IDC research shows that by 2015, the prospect of big data market will reach $ 16.9 billion in size. All current enterprise business data every 1.2 years will be incremented doubled. Undoubtedly, the explosion of data continues to remind us, the future will change because Big Data technologies.
So, why the big data has become the focus of everyone's attention? Big data brings the essence of what kind of change? To this end, we and China Computer Federation Big Data academic leaders, Dean of the School of Information, Renmin University of China Du Xiaoyong conducted interviews .
Professor Xiaoyong Du believes that big data brings three fundamental changes: first, Big Data to get people out of dependence on algorithms and models, and the data itself can help people close to the truth of the matter; second, big data weakened the causal relationship . Big Data Analytics can mine the correlation between the different elements. People do not know why these elements can be associated with its results in the intricate complex of modern information society, such an application would greatly improve efficiency; third, compared with the previous database technology, big data can be processed or semi-structured unstructured data. This will enable the rapid expansion of computers to analyze the data range.
Professor Du Xiaoyong with examples further elaborated this view:
First, computer science before the emergence of big data, is very dependent on the model and algorithm.
If people want to get accurate conclusion, it is necessary to establish the model to describe the problem and the need to rationalize the logic, understand cause and effect, exquisite design algorithm to draw realistic conclusions. Therefore, a question, can get the best solution, depending on whether it is reasonable modeling, algorithms Competition has become the key to determine success or failure. However, the emergence of big data completely changed the way people depend for modeling and algorithms. For example, if there are algorithms to solve a problem and algorithm B. A In operation a small amount of data, the results of the algorithm Algorithm A is significantly better than B. That is, in the algorithm itself, the algorithm A can lead to better results; however, it was discovered that when the amount of data continues to increase, the result of the algorithm B runs at better than a lot of data in the algorithm A small amount of data the results of running. This finding to computer science and computer-derived disciplines have brought a landmark revelation: When data is growing, (algorithms and models, rather than research data used) data itself guarantee the validity of the results of the data analysis. Even the lack of precise algorithm, as long as have enough data, but also to get closer to the truth of the conclusion. Data thus hailed as the new productivity.
Second, when enough data when the need to know the specific cause and effect relationship can be concluded.
For example, Google translation in helping users, not to set various grammar and translation rules. But to use all the Google database user wording collected habits more recommended. Google to check all users writing habits, the most common and the most frequent mode of translation appears recommended to the user. In this process, the computer can not understand the logic of the problem, but when the data recorded user behavior rises, the computer can not understand the problem under the logic of the situation, to provide the most reliable results. Visible, massive data processing and data analysis tools, in order to understand the world to provide a complete new way.
Third, it is possible to handle a variety of data structures, big data can be analyzed using the recorded data of human behavior on the Internet to the maximum extent.
Large data occurs before the data can be processed by the computer needs to process pre-structured, and recorded in the appropriate database. But the technical data required for the structure of the data greatly reduced, various dimensions of information on the Internet that people leave social information, geographic information, behavior information, preferences and other information can be processed in real time, a complete three-dimensional sketch of each various characteristics of the individual.
Recommended Reading articles
40 + annual salary of big data development [W] tutorial, all here!
Zero-based Big Data Quick Start Tutorial
web front-end development based tutorial
Big Data era need to know six things
Big Data framework hadoop Top 10 Myths
Experience big data development engineer salary 30K summary?