The trend of ETL and ELT products viewed from Oracle acquisition sunopsisDate:2008-6-17 Source:amteam I want to comment Big| Medium |Small
Submission
Print
Introduction: This article mainly from Oracle Acquisition sunopsis analysis of ETL and ELT products trends and explain that the ELT tools than ETL tools can handle large data volume more effi
Ods-bi in the construction of ETL to occupy 1/3 of the time, deep feelings. The modeling of BI, from the physical data layer, the logical data layer, the business logic layer at all levels, there are many automated tools to handle.However, the process in ETL must be designed according to the performance. Summarize the next few parts.1. Data source/Data target managementTo determine the table, file, or restf
GroupCompany (embedded ETL tool) Financial Reporting SystemSolution Solutionsa,Project background:a Group company is a company with more than a large group of subsidiaries, its subsidiaries involved in various industries, including: gold, copper, real estate, chemical fiber and so on. Due to the differences in the business of subsidiaries, the financial statements of subsidiaries have many differences. Therefore, each subsidiary needs to make the rep
The main indexes of this article series are as follows:First, ETL sharp weapon Kettle Practical Application Analysis Series one "Kettle Use introduction"Second, ETL sharp weapon Kettle Practical Application Analysis Series two "application Scenarios and actual combat demo Download"Three, ETL sharp weapon Kettle Practical Application Analysis Series three "
I think many people have talked about the ETL process. Recently, I have been comparing SSIs, owb, and infomatica. Combined with previous projects, I have deepened my understanding and understanding of the ETL process.In fact, these three tools have their own advantages and disadvantages, except for the application platform. Today, I would like to share my experience in terms of expansion and maintenance.
1:
Customer Perspective: Oracle ETL Tool ODIData integration has become the enterprise in the pursuit of market share of the key technology components, and rely on manual coding in different ways, more and more enterprises choose a complete data integration solution to support its IT strategy, from big data analysis to cloud platform integration.A recent study by Dao Research compares the differences between several of the world's leading data integratio
There are already several articles for IEnumerable, this article describes how to use IEnumerable to implement ETL. ETL, an abbreviation of English extract-transform-load, is used to describe the process of extracting data from the source (Extract), transpose (Transform), loading (load) to the destination. Typically, the data collected from the original end has many problems, and the business requirements m
This document describes the ETL testing process and general project conditions to describe the ETL testing method.
ETL test Flowchart
Test phase
1,Requirement Analysis
Familiar with business processes and business rules, analyze the ing relationship between the source table and the target table as required, and parse the business data flow diagram:
1,Test Ana
ETLIs the abbreviation of extract-transform-load. It is used to describe the process from the source end to extract (extract), transpose (Transform), load (load) to the target end.ETLThe term is commonly used in data warehouses, but its objects are not limited to data warehouses.
Directory[Hide]
1 ETL and ELT
2 tools
3. See
4. External Connection
[Edit] ETL and
ETL is a process of extracting, cleaning, and transforming data from a business system and loading it into a data warehouse. It aims to integrate scattered, disorderly, and standardized data in an enterprise, providing analysis basis for enterprise decision-makingETLYesBiThe most important part of a project, usuallyETLIt takes 1/3 of the total project time,ETLThe quality of the design depends on the success or failure of the Bi project.ETLIt is also a
ETL is responsible for the scattered, heterogeneous data sources such as relational data, flat data files, such as the extraction of the temporary middle layer after the cleaning, transformation, integration, and finally loaded into the data warehouse or data mart, as the basis for online analysis processing, data mining. The term ETL often appears in the Data warehouse, but its object is not confined to th
During the three-day holiday on May Day, some ETL logic problems occurred, resulting in the daily incremental data to be loaded into DW is not loaded as designed. Therefore, you need to check the generated incremental data after ETL to avoid the problem of passive processing when the incremental data is lost one day.
Requirement: if there is a problem with the incremental data of
What does the ETL data conversion system bring to customers?With the development of society and computer technology, people began to reprocess the data in the original database to form a comprehensive and analysis-oriented environment to support the emergence of scientific decision-making. As a result, the ideas, technologies, and products of data warehouses are gradually formed. The purpose of building a data warehouse is to establish a systematic da
Label:Data integration has become the enterprise in the pursuit of market share of the key technology components, and rely on manual coding in different ways, more and more enterprises choose a complete data integration solution to support its IT strategy, from big data analysis to cloud platform integration.A recent study by Dao Research compares the differences between several of the world's leading data integration solutions and the impact of these product technologies on the real business. T
For everything, supervision is an effective way to improve itself, as is BI. In my personal experience, BI supervision can be divided into two types (Welcome to the discussion ):Runtime supervision(Runtime Monitoring)AndMonitoring of data warehouse health status(DW Healthy Monitoring):1. Runtime supervisionThe so-called runtime supervision refers to the process of monitoring data from the data source to the data warehouse. In general, it is to supervise the
decision-makers should be able to manipulate the data of the enterprise flexibly, observe the state of the enterprise from many aspects and multi-angle, and understand the change of the enterprise in multi-dimensional form. Using OLAP tools, we can make a connection between the dimension table and the fact table, and then do the aggregation operation to save the cube to achieve the objective of multi-angle analysis.Front-end display tools: Front-End display tool is to assist users to multi-angl
1, the definition of ETLETL is "Extract"," Transform","Load" the initials of three words namely "extract "," Conversion "," Loading ", but we are often referred to as the daily data extraction. ETL is the core and soul of BI/DW (Business intelligence/Data Warehouse), integrating and improving the value of data according to the unified Rules , is responsible for the completion of data from the data source to the target data Warehouse conversion proces
required to handle the second type of modification
Mini Dimension (minidimension):
Extract a few fields from a common large dimension to form a small field dimension that can be used in a query with a field in a mini dimension
This design significantly improves query efficiency
type of fact:
Granularity fact table (additive Fact)
Cycle Snapshot fact table (semi-additive Fact)
Aggregation Snapshot fact table (non-additive Fact)
Non-factual fact table (factless Fact table)
Granularity fact table
1, Ali Open source software: datax
Datax is a heterogeneous data source offline Synchronization tool that is dedicated to achieving stable and efficient data synchronization between heterogeneous data sources including relational databases (MySQL, Oracle, etc.), HDFS, Hive, ODPS, HBase, FTP, and more. (Excerpt from Wikipedia)
2. Apache Open source software: Sqoop
Sqoop (pronunciation: skup) is an open source tool that is used primarily in Hadoop (Hive) and traditional databases (MySQL, PostgreSQ
These years, almost all work with ETL, have been exposed to a variety of ETL tools. These tools are now organized to share with you.
An ETL Tool
Foreign
1. DataStage
Reviews: The most professional ETL tools, expensive, the use of the general difficulty
Download Address: Ftp://ftp.seu.edu.cn/Pub/Develop ... tastag
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.