Abstract: A few days ago, Alibaba Cloud announced at the "2017 Hangzhou Yunqi Conference" that the log service and Splunk have cooperated, and the real-time log analysis function for billions of dollars has been launched. Compatible with the SQL92 standard and the JDBC protocol, it can centrally solve the one-stop needs of various environmental logs, including collection, storage, delivery and query analysis, etc., and improve log analysis to a new level, reaching the leading domestic level.
The activities of people and things in daily life will generate a large amount of data, and a log is a common carrier for recording such activities. Through log processing and analysis, we can help us find the operating laws behind big data, and achieve intelligent operation, maintenance and operation of the business. Log analysis is the final result, but in the process, it is often necessary to build a log processing system through a combination of software (such as kafka, ELK, Flume), which brings many problems and troubles to the use of log analysis. The Alibaba Cloud Log Service is an unmanaged solution, which does not require users to care about trivial data collection, expansion, maintenance, error handling, etc., and focus on "analysis" results.
In the solution of foreign cloud vendors, it is generally necessary to connect and combine several products to build a log processing solution. Just like driving a car, you have to buy several components, and you need to write some handlers at some connection points to run it. During use, you need to pay attention to the water level in different products to ensure service availability. Alibaba Cloud Log Service provides a complete solution with better overall usability.
It is understood that within one year of commercialization of Alibaba Cloud Log Service, about 30+ new functions have been launched, and log analysis has also been raised to a new level. Fast takes close to a minute. Today, the LogAnalytics function under the Log Service can complete all functions of data collection + storage + 1 billion queries + 100 million calculations within 1 second, which means that the real-time log analysis has reached an unprecedented speed. 2. Strong: Traditional solutions generally only support limited query + aggregation analysis. But LogAnaltyics fully supports SQL 92 syntax and can analyze your logs just like analyzing report data. 3. Wide: In addition to docking with Docker, Storm, Spark Streaming, Hadoop, Hive, Presto + Alibaba Cloud big data, it also supports Grafana and other famous open source data visualization plug-ins to facilitate integration with upper-level business systems. 4. Province: The cost is close to 10% of self-built, it is so willful. For details, see Self-built cost comparison, https://help.aliyun.com/document_detail/59070.html.
According to the person in charge of Alibaba Cloud Log Service, there are currently three main functions: LogHub, LogShipper, and LogAnalytics. Compared with other solutions, the cost of using LogHub can save more than 60% of the time and cost, which greatly saves the investment of the log system. At present, the LogShipper function provided by Alibaba Cloud can also be used for free, which can provide users with a massive, high-concurrency, and cost-effective log processing system. If you collect 10 GB of compressed data per day from users on the public Internet, if you use the self-built solution, it will cost 16 yuan per day, while using LogHub only costs 2 yuan, which is about 10% of the former, and does not require any investment in operation and maintenance. The price of LogAnalytics is 10% of the self-built solution under the same scale and performance conditions. For example, write 50GB of data a day (27GB of which is the actual content) and save it for 90 days. The average monthly consumption is as follows:
With the same performance, the cost ratio of using LogSearch/Analytics to ELK (SSD) is 13.6%.
阿里云日志产品使用起来也非常简单，主要分为两个步骤：一是接入日志数据；二是在控制台配置并进行分析。之后无论是对接实时计算，还是数仓，或仪表盘还是报警都非常方便。
据了解，该产品适合对日志处理、分析有需求的用户场景。例如电子商务，媒体直播，游戏，广告，IoT和App开发用户。这些场景上都有大量用户、设备产生的数据需要进行实时分析。而使用阿里云日志产品，则能更快更省更好地处理分析。
原文链接：https://yq.aliyun.com/articles/223453