Future Super Intelligent System

On the main interface of the system, there is an extra column of rewards. After Liu Fan clicks on rewards, two options are displayed vertically.

"Deep Application of Big Data Processing": After clicking to use, it will be directly integrated into the brain.

"Intellectual Development Manual": It cannot be materialized, and can be viewed at any time by clicking.

There are only two rewards, which are simple and clear, and Liu Fan didn't get entangled, so he clicked "In-depth Application of Big Data Processing" in order.

After the finger touched, the sense of form of the system came again, and I saw a book scrolling rapidly on the screen of the mobile phone, and then gradually slowed down until it disappeared.

Almost at the same time that the book on the mobile phone disappeared, Liu Fan's brain felt a familiar sense of comfort, and a feeling of trickling into the sea appeared in Liu Fan's mind. It disappeared completely, and then Liu Fan found a pile of knowledge appeared in his brain.

This knowledge exists in the brain like the ninety-nine multiplication table that Liu Fan is familiar with. It is very harmonious and there is no sense of abruptness. It seems to be part of what I have learned since I was a child. It is so harmonious that I am mentally prepared for the power of the system. Liu Fan couldn't help being shocked again.

After digesting the shock for a while, Liu Fan quickly gained a better understanding of what the system rewards. The "In-depth Application of Big Data Processing" given by the system is a bit like a system architecture, but it is very detailed and very popular.

In analogy, it is like a home improvement design plan with the details of the whole process operation. With it, you know what the electrician will do, what the mason will do, what the carpenter will do, how to integrate it in the end, what the overall effect will be, and at the same time , materials, and tools are all prepared for you, and what you need to do is to find masters such as electricians, carpenters, and masons. In the end, the quality and effect of the house decoration will be determined by the abilities of these masters you find. Decide.

In the field of big data processing, electrical engineering and carpentry etc. correspond to the knowledge of "Discrete Mathematics" and "Probability". In other words, Liu Fan already knows how to design a big data processing tool, but the processing ability of the tool he designed depends on his knowledge of "Discrete Mathematics", "Probability" and other related subjects Reserved and understood.

This also means that the processing power of this tool is logically unlimited.

At this time, Liu Fan finally understood why the system selected these three courses as tasks, because "Discrete Mathematics" and "Probability" are important basic subjects for developing related systems, and "Complex Variable Function" can optimize Auxiliary, of course, there are some very important subjects that are not in the teaching plan for this semester, such as "Linear Algebra".

In addition, Liu Fan also noticed that the knowledge of programming is attached to the rewards of the system, which is equivalent to the tools mentioned in the previous analogy, but the basic mathematics is left for Liu Fan to develop. .

This has to remind Liu Fan of the sentence written in the system summary: I hope you can further understand the meaning of the task after receiving the task reward.

The system actually gave me rewards that were higher than my prayer needs, but at the same time, I needed to continue to work hard. The harder I worked, the more room for the rewards to play. What exactly did the system want me to understand?

Liu Fan still can't figure it out.

If you don't understand it, don't think too much about it, and plan to look at another reward first.

Click on the "Intellectual Development Manual", and four words come out: Geng Qin Nai Zhi.

Then a series of explanations popped up. To put it simply, Liu Fan can help his intellectual development by practicing according to the manual in a planned way, but this will be a long process and will not be accomplished overnight.

Liu Fan understood what was going on, so he didn't waste time. With the system rewards, he naturally started to do business. Now, first of all, he has to study several mainstream big data processing tools on the market, and then according to the wooden barrel principle, It is necessary to study "Linear Algebra" and other subjects that were not tested this year.

Finally, design your own tools.

With the basic idea, Liu Fan quickly entered the state.

All the roommates went back during the summer vacation, which just gave Liu Fan the environment to practice in seclusion, without spending unreasonable money to rent a house or something.

Time flies, and the time flies by.

At 3:30 in the morning on August 10th, Liu Fan paced back and forth in the dormitory unkempt, with an excited expression that could not calm down for a long time.

For more than a month, Liu Fan hardly stayed at home, but he could feel his rapid growth. On the one hand, it is an in-depth study of basic mathematics, and on the other hand, it is a long-term plan for the commercial use of big data processing tools.

The original choice of big data processing as the starting point was just a direction, and the specific content was planned in this more than a month.

The big data processing tool developed by Liu Fan naturally cannot only complete common functions such as automatic sorting or exception reminders. More preparedly, it is a comprehensive big data service platform for enterprises, covering enterprise internal management and customer management.

Therefore, Liu Fan's final result is essentially a framework, which needs to input the individual needs of the enterprise to provide personalized big data processing services.

Liu Fan also considered whether it is possible to make a general-purpose tool. After all, this can save a lot of implementation costs in the future, but this kind of thing is unrealistic when you think about it carefully. The situation of each enterprise is different. The needs are also different. To be universal is to meet the possible needs of all enterprises in the world. The current self can't do it at all.

Although Liu Fan has no technical breakthroughs in general issues, the big data processing tools developed by Liu Fan have made great breakthroughs in two other areas.

The first is the issue of efficiency. Although Liu Fan still uses the random forest rule as the basis of the algorithm, there is no way to do it. With his current ability, he cannot change the current algorithmic environment of deep learning. After all, I didn't consider the algorithm as the entry point for my own development when I considered security issues at the beginning, so naturally I still have to use the current algorithm as the basis. But although Liu Fan has no ability to change, he has the ability to optimize.

Liu Fan compared OpenRefine with 100 experiments, and the average computing efficiency of his own system can reach more than 3 times. Again, this is a qualitative leap for enterprises with huge data. Take Penguin as an example, the amount of data generated by WeChat and Koukou alone is hundreds of terabytes every day.

What's more, the amount of data is increasing every day, because the speed of data processing cannot keep up, more and more data can only be queued there all the time, and many decisions of enterprises will have timeliness problems.

The second breakthrough is the diversity of data mining. The most important thing for the development of big data technology for enterprises is its data analysis and data mining capabilities.

Just like one of the most classic cases in the big data industry: the sales of beer next to diapers are the highest. This is the substantial value that big data analysis brings to enterprises.

Enterprises just want big data processing tools to tell themselves what I should do to make more money.

But on this issue, the current big data mining capabilities of the entire market are actually still at a relatively early stage, because big data is easy to analyze for things with rules, but more companies want to start from the rules without rules. It is difficult to analyze a result from the data. Because there are too many variables involved.

And Liu Fan thought of adding a data association inverse calculation algorithm to the algorithm through the introduction of system knowledge, so that the messy data can establish a functional relationship between itself, and then perform a second in-depth mining on the function to derive an effective function, and finally Physical analysis of valid functions.

This turns a lot of information that is judged useless in the current algorithmic environment into treasure. Although Liu Fan's algorithm cannot guarantee that the company can directly give an answer to how to make money through messy data, it can allow the company to have a more comprehensive grasp of product conditions, market conditions, and company conditions, which are ignored by more traditional tools. The details will be presented with a high probability.

Today, when the homogeneity of all walks of life is becoming more and more serious, it is conceivable how important the utilization rate of information and the control of details are.

As far as the current flaw of this tool is concerned, the greater the amount of data, the more obvious its advantages. If the amount of data is too small, it may not be able to show any advantages at all. This affects the problem of establishing target customers in the later stage.

After more than a month of study, research and development, comparison, and improvement, Liu Fan feels that the current big data processing can be unveiled as the first product.

Firstly, in terms of performance, Liu Fan believes that he has enough competitiveness. Secondly, for this system, Liu Fan also rents servers for experiments and spends money to buy data. The 20,000 yuan is almost gone.

Gotta make some money now.

As for the name of this set of tools, Liu Fan also thought about it. At that time, he picked up the system because it looked like a wooden dragon, so Liu Fan planned to use the wooden dragon as the name for the technology, chip, and company in the future.

This big data processing tool will also be the first product of Wood Dragon Technology: Wood Dragon Big Data Processing Tool 1.0.