Development and implementation of the business intelligence platform for Small and Medium Enterprises (data warehouse, Bi system, and real project practices)
Course category: data and data warehouse
Suitable audience: elementary
Lesson count: 76 lessons
Technologies used: Data Warehouse, Bi system, and real project practice
Involved projects: business intelligence platform for small and medium-sized enterprises
Consult QQ: 1840215592
Course content Introduction:
This course uses the management of hypertension in the public health field as an actual application scenario to establish a data warehouse for the hypertension management system for data analysis. This course is divided into four chapters, 76 lectures. Chapter 1 describes the development of the business intelligence system, from the subject scope, evolution history, application cases of business intelligence to the natural evolutionary architecture, as well as the problems it faces, let's talk about data warehouses and development methods. The second chapter mainly analyzes some main terms of data warehouse, such as partition, granularity, dimension, measurement value, multi-dimensional data model, and dw2.0. Chapter 3 describes how to design a data warehouse and introduces the concept of metadata. Chapter 4 is the most part of the course class. It took a lot of time to build a Bi system from start to end and finally provided a Web Service for third-party calls.
The development and realization of the business intelligence platform for Small and Medium Enterprises
Course outline:
I. Theoretical Explanation:
1. Development of business intelligence systems-concept, subject scope, Evolution History and application cases of business intelligence
2. Development of business intelligence systems-Information Extraction, natural evolutionary architecture, and problems
3. Development of business intelligence systems-first knowledge of Data Warehouses
4. Development of business intelligence systems-Data Warehouse Development Method
5. Glossary of Data Warehouse-concept of Data Warehouse
6. Term Analysis of Data Warehouse-major design issues of data warehouse-Granularity
7. Analysis of Main terms of Data Warehouse-dual granularity, live Sample Database
8. Glossary of Data Warehouse-main design issues of data warehouse-Data Partition
9. Glossary of Data Warehouse-FAQs about Data Warehouse
10. Term Analysis of data warehouses-data cubes, dimensions, facts, and multidimensional databases
11. Glossary of Data Warehouse-metric, dimension, and OLAP operations
12. Glossary of Data Warehouse-Data Warehouse variants, dw2.0 Introduction
13. Glossary of Data Warehouse-Introduction to dw2.0 (Continued 1)
14. Glossary of Data Warehouse-Introduction to dw2.0 (Continued 2)
15. Glossary of Data Warehouse-Introduction to dw2.0 (Continued 3)
16. How to design a data warehouse-two main tasks of constructing a data warehouse (Design of operational system interfaces)
17. How to design a data warehouse-two main tasks of constructing a data warehouse (design of the data warehouse itself)
18. How to design a data warehouse-data model and iterative development, standardization, and reverse Standardization
19. How to Design Data Warehouses-snapshots and metadata in Data Warehouses
20. How to design a data warehouse-data cycle, trigger of data warehouse records, and summary records
Ii. Project Practice:
1. Data Warehouse Construction Practice-preparation and analysis of operational databases
2. Data Warehouse Construction practices-creating relationships between tables, importing and exporting databases, and adding data content
3. Data Warehouse Construction Practice-import data from external files, design data warehouse, and create dimension tables
4. Data Warehouse Construction Practice-create a simple time dimension table
5. Build a data warehouse-create a complete time dimension table
6. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table
7. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table (Continued 1)
8. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table (Continued 2)
9. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table (Continued 3)
10. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table (Continued 4)
11. Data Warehouse Construction Practice-Write the stored procedure to add data to the complete time dimension table (Continued 5)
12. Data Warehouse Construction Practice-write a applet to add data to a complete time dimension table
13. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 1)
14. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 2)
15. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 3)
16. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 4)
17. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 5)
18. Data Warehouse Construction Practice-write a applet to add data to the complete time dimension table (Continued 6)
19. Data Warehouse Construction Practice-create other dimension tables
20. Data Warehouse Construction Practice-analysis and comparison of the advantages and disadvantages of the two methods
21. Data Warehouse Construction Practice-create other dimension tables (Continued 1) and create cube
22. Data Warehouse Construction Practice-analyze data conditions in operational databases, determine partitions and granularities, and create fact tables
23. Data Warehouse Construction practices-added gender, gzys, and age dimensions
24. Data Warehouse Construction Practice-add data to the newly added dimension table
25. Data Warehouse Construction Practice-add data to the newly added dimension table (Continued 1)
26. Data Warehouse Construction Practice-build the extract, transform, and load-SP frameworks
27. Data Warehouse Construction practices-writing extract, transform, and load-SP
28. Data Warehouse Construction Practice-writing of extract, transform, and load-SP (Continued 1)
29. Build a data warehouse-construct a transform table
30. Data Warehouse Construction Practice-construct a transform table (Continued 1)
31. Data Warehouse Construction Practice-construct a transform table (Continued 2)
32. Data Warehouse Construction Practice-writing extract, transform, and load-SP (Continued 2)
33. Data Warehouse Construction Practice-writing of extract, transform, and load-SP (Continued 3)
34. Data Warehouse Construction practices-extract, transform, and load-SP compiling (Continued 4)
35. Data Warehouse Construction practices-extract, transform, and load-SP compiling (Continued 5)
36. Data Warehouse Construction Practice-extract, transform, and load-SP compiling (Continued 6)
37. Data Warehouse Construction practices-extract, transform, and load-SP compiling (Continued 7)
38. Data Warehouse Construction practices-extract, transform, and load-SP compiling (Continued 8)
39. Practice of Data Warehouse Construction-writing of extract, transform, and load-SP (Continued 9: Debugging)
40. Data Warehouse Construction practices-extract, transform, and load-SP writing (continued 10: handling incremental data)
41. Data Warehouse Construction Practice-add topic names in log_etl_summary and log_tel_error_detail
42. Data Warehouse Construction Practice-adding ODS tables
43. Data Warehouse Construction Practice-add data to ODS tables
44. Data Warehouse Construction Practice-add data to ODS tables (Continued 1: Considering Incremental data)
45. Data Warehouse Construction Practice-add data to the ODS table (Continued 2: Increase the number of records)
46. Data Warehouse Construction Practice-Modify the ETL Stored Procedure for ODS
47. Data Warehouse Construction Practice-debugging the ETL storage process
48. Data Warehouse Construction Practice-debug the ETL storage process (Continued 1: Verify the increment) and regularly execute the ETL storage process
49. Data Warehouse Construction Practice-add Verification Mechanism (ODS <--> mapping (source part ))
50. Data Warehouse Construction Practice-Add the verification mechanism (target ing (target part) <--> dim)
51. Data Warehouse Construction practices-improved ETL after adding the verification mechanism
52. Data Warehouse Construction Practice-improved ETL after adding the verification mechanism (Continued 1)
53. Practice of Data Warehouse Construction-ETL after debugging the verification mechanism
54. Data Warehouse Construction Practice-debug the ETL (Continued 1) after the verification mechanism is added, and create a Web Service
55. Data Warehouse Construction Practice-ETL (Continued 2) after debugging and adding the verification mechanism, Web Service creation (Continued 1)
56. Data Warehouse Construction Practice-ETL (Continued 3) after debugging and adding the verification mechanism and Web Service (Continued 2)
Development and implementation of the business intelligence platform for Small and Medium Enterprises (data warehouse, Bi system, and real project practices)