Oracle Enterprise Edition must be installed on all machines in the main library and from the library.2. The main library must be running in archive mode.3. The main library and the operating system from the library must be the same (allowing versions to be different), and the library can use a different directory structure from the main library.4. The architecture of the master-slave library hardware system must be the same. For example: The main library is running on a 64-bit sun SPARC system,
relationship management, and other activities to improve the agility of enterprises.
Master Data Management: master data management is an advanced form of data management. It must be built on ETL, enterprise information integration, and other technologies, therefore, many primary data management platforms include functions such as data extraction, data loading, data conversion, data quality management, data replication, and data synchronization.
:
Log-based, real-time crawling
Message Bus
Goal:
0 Downtime migration upgrade, disaster recovery emergency: New Db/os/hw/app
Flexible high Availability: a fully active distribution database
Query Offload/split: Reporting Database
Oracle's ETL scenario, ODI
Real-time bi/real-time Dw:edw
Data distribution: Multiple da
In the previous section, we crawled nearly 70 thousand pieces of second-hand house data using crawler tools. This section pre-processes the data, that is, the so-called ETL (extract-transform-load)
I. Necessity of ETL tools
Data cleansing is a prerequisite for data analysis. No matter how high the algorithm is, when an error data is encountered, an exception is thrown out, and it is absolutely dead. Howeve
Tags: TP server jump parsing BSP Bubuko ZIP compression TPS ODI infFirst, data integration business Scenario1.1 BackgroundBecause of a system of GA to adjust, resulting in the original from the system backup database obtained from the corresponding data resources can not be properly obtained, the subsequent data unified by the GA a system daily ztry photo data from the previous day is compressed and uploaded to the designated FTP server, need to downl
MySQL authorization and status query CREATEDATABASEodi; -- create an ODI database GRANTALLPRIVILEGESON *. * TOodi @
Create database odi for MySQL authorization and status query; -- CREATE an odi database grant all privileges on *. * TO odi @
MySQL authorization and status query
Create database
of application programs and technologies for gathering, storing, analyzing and providing access to data to help enterprise users make better business decisions. A dw is a collection of data designed to support management demo-making. according to Bill inmon, a DW is a "subject-oriented, integrated, time-variant, nonvolatile collection of data in support of demo-- making. "DWS tend to have these distinguishing features:
Use a subject-oriented dimen1_data model,
Contain publishable
For a small etl scheduling, colleagues need to return the execution status of the stored procedure and control whether the subsequent dependency is executed, I only returned the output parameters of the stored procedure in the shell script that calls and executes the stored procedure, and did not write a specific control process for everyone. If you continue development in this way, that is a small etl sche
correctly set. Run dbms_metadata_util.load_stylesheets with SYSDBA
[oracle@DB-Server admin]$ oerr ora 39213 39213, 00000, "Metadata processing is not available" // *Cause: The Data Pump could not use the Metadata API. Typically, // this is caused by the XSL stylesheets not being set up properly. // *Action: Connect AS SYSDBA and execute dbms_metadata_util.load_stylesheets // to reload the stylesheets.
SQL> exec dbms_metadata_util.load_stylesheets
Case 3:
The error is as follows:
Pump cannot use the Metadata API because XSL stylesheets is not correctly set. Run dbms_metadata_util.load_stylesheets with SYSDBA
[oracle@DB-Server admin]$ oerr ora 39213
39213, 00000, "Metadata processing is not available"
// *Cause: The Data Pump could not use the Metadata API. Typically,
// this is caused by the XSL stylesheets not being set up properly.
// *Action: Connect AS SYSDBA and execute dbms_metadata_util.load_stylesheets
// to reload the stylesheets.
SQL> exec db
use the metadata API because the XSL stylesheets is not set properly. Need to perform dbms_metadata_util.load_stylesheets with SYSDBA
-->
[Oracle@db-server admin]$ oerr ora 39213 39213, 00000
, "Metadata processing is not available"
//*cause:the Data Pump could not use the Metadata API. Typically,
//This are caused by the XSL stylesheets not being set up properly.
*action:connect as SYSDBA and execute dbms_metadata_util.load_stylesheets
//to reload the stylesheets.
Sql>e
The data loading strategy mentioned in this paper is the OLTP system as the source system, and
The general data loading strategy used by ETL data to be loaded into OLAP system.
Depending on the specific nature of this approach, the ETL data load generally has the following four kinds of parties
Case:
1. Time Stamp mode
You need to uniformly add time fields as timestamps in the business tables in the OLTP sy
Four types of BI open source tools introduction-spagobi,openi,jaspersoft,pentaho1 Brief Introduction to BI systemsFrom a technical point of view BI includes ETL, DW, OLAP, DM and other links. Simply put, the transaction system has already occurred data, through the ETL tool extracted to the subject of a clear data warehouse, after the OLAP generation cube or report, through the portal to show users, users u
transaction sequence commit, reasonable checkpoint mechanism, and reliable data transmission mechanism, ensuring data integrity and reliability.
GlodenGateThe main concerns are:
1. To achieve data synchronization, you must install GoldenGate media on the source and target databases respectively. In some data integration environments, the source database may be restricted.
2. To support GoldenGate, you need to set parameters for the source database (for example, to enable archiving logs and t
most complete and integrated SOA platform. Is an integrated standard component-based suite for development, integration, deployment, and management of SOA. The suite includes: oracle BPEL Process Manager Oracle Business Activity Monitoring Oracle service bus Oracle Complex Event Processing Oracle B2B engine SOA suite is an option of Weblogic suite.
Oracle Data Integration suite
Odi suite includes a series of data management components for building
Open-source Bi SYSTEM
Directory
Open-source Bi system Classification
Bi application tools
ETL tools
Table tools
Eclipse Birt
OLAP tools
Open source database
Open-source Bi suite
Bizgre
Openi
Pentaho
Spagobi
Open-source Bi system Classification
Bi applicatio
Summary
As the saying goes: "Ten years to grind a sword", Microsoft through 5 years of careful build, in 2005 heavily launched SQL Server 2005, this is from SQL Server 2000 after another. This enterprise-class database solution consists of the following aspects: Database Engine Services, data mining, Analysis Services, Integration Services, Reporting services, Among them integration Services (that is, SSIS), is the intermediary between them, the link between the various sources of data, through
BI Financial DBDIFF Analysis Issue,
Core formula: DB --> ETL --> DW vs REF file
Cause of error:
1. DB/DW Connection Issue
2. SQL Issue
3. Product Bug
4, REF file not updated
Physical requirement analysis:
1. Source DB: EBS, PSFT, Fusion... DB Instance
2. DW: Ignore the storage form of the data source and store the data in the same form.
Logic requirement analysis:
1. ETL process: The data stored in Sourc
number of works on any of the best-selling lists. Of course, this is not the case if Garfield 1/3 is listed in the best-selling book list.According to the system of Shishuo Xinyu, I have categorized and revised many quotations of Garfield. The two seem different, but it makes sense to do so. Wang Xiaozhi's East bed has a carefree posture and is quite garfi's style. Bi Mao shiyun: "A Hand Held crab wine, a hand held wine glass, floating liquor pool, it will be enough for a lifetime ." This kind
I have been involved in a DW Project (Sony China tri-one project) in Sony recently ),
It is mainly responsible for ETL the user's production and analysis data from SAP to the pool built in Oracle, and provides corresponding data interfaces for other systems. In addition, this pool is designed and built based on user requirements.Objectively speaking, part of our work is the foundation and key core of this branch project in the DW project. Of course, p
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.