Big Data Development Kit (Data IDE) is important to increase the number of cloud Ali Paas platform products, "DataWorks" the most important core components. Provide fully managed workflow service, one-stop development and management interface to help companies focus on mining and exploration data value.
Big Data development kit based on MaxCompute calculated as the core of the storage engine that provides off-line processing of massive data analysis, data mining capabilities. Large data development kit, the data can be data transmission, data conversion, and other related operations, the data conversion process from the introduction of different data storage data, and finally extracting the data into other data systems.
Ali cloud big data development platform is a set of data development, data management, scheduling off-line, on-line operation and maintenance and data integration tools for the integration of the online operation and maintenance of large data development platform, not only can solve the various problems the figure above, you can also users can save a lot of energy and money.
Data IDE's original intention was to help Ali cloud customers, entrepreneurs, practitioners of data, so that they are better able to make an inventory of their data, so that data value play rather than a burden.
Therefore Data IDE by data development, offline scheduling, data management, data integration out of the box to provide a user-to-use IDE development platform and online operation and maintenance b / s architecture, and provides a high security multi-tenant model ensures that the user's data Safety:
- Can quickly be integrated multiple heterogeneous data sources quickly summarize the data, move the cloud;
- Data can be developed through the joint development of people, collaboration efficiency and accuracy of data development and resource management through the release of more than guarantee;
- With offline task scheduling can be timed to provide a mega concurrent scheduling and management capabilities, and real-time status monitoring tasks, error first time issued a warning;
- You can better manage data uploaded through data management to the cloud, clearer control over data by permission of blood;
Data IDE application scenario including the site log analysis, and development of complex data mining model output timing of the report.
In practice, compared to other products, Data IDE has the following advantages:
- Termination costs, depending MaxCompute of computing and storage capacity, with respect to self Hadoop has an absolute cost advantage.
- Quick and easy! One-stop development platform, version management, coordination multiplayer, online operation and maintenance, monitoring, alarm, with out of the box after all the tasks encountered in the development and deployment problems have to deal with the corresponding function.
- Data Security! Multi-tenant model and project isolation, the data flow system of rights, privileges can be traced back.
For details on Big Data Development Kit DataIDE: The Big Data Development Kit DataIDE Tutorial