Trafodion:transactional SQL on HBase

trafodion:transactional SQL on HBase

Real-time Distributed transaction processing on HBase

Introduced

HBase's SQL capabilities have been inadequate. Phoenix lacks the ability to join, ebay's kylin is not concise enough, Facebook Presto hbase Connector is not public. So, here comes the trafodion. It provides standard SQL functionality on HBase and supports transactional OLTP. Trafodion is HP's Open Source initiative to develop an hbase solution for developing an enterprise-class SQL at HP Labs and hp-it. HP has more than 20 years of accumulated, transactional or business workloads for big data, and SQL technology that has developed transactions into the database Technologyand solution. Trafodion brings this core technology to the ecosystem of Hadoop. to understand more about Origins and of the project name , please visit:

Www.hp.com/go/trafodion

target workloads

        Hadoop workloads , long-running batch mode , to spanning as shown in with low latency workload . on the right is considered Good for Hadoop The three class parsing work , so also got the most attention from . In contrast to , operations " left-most work is a class New Workload , which includes OLTP workloads , and transaction

it including the use Social and mobile Data the interaction and Views Structured and semi-structured data the mixture.

Traditionally, these Work Load has passed Relationship processing database. However , the relational database is extensible and does not provide in some cases Need for Architecture flexibility. Hadoop's positioning has broken through
these restrictions. the Market has more and more interest and pressure to combine the benefits of Hadoop to significantly reduce costs to embrace these workloads in the ecosystem of Hadoop .

as business workloads represent business needs , They are typically traded by the The constant flow of c10> requires low latency response time for read/write access . In addition, these workloads are characterized by :

? with the acid compatible Protection Data the Integrity
? High Availability , Concurrency of and Scalability
? Multi- Structured Data
? fast-changing Data Requirements

Characteristics

Currently, there are no ready -made open source SQL solutions on hbase that can Adequately meet these requirements . trafodion provides the following features to support the transactional work of Hadoop :

?acid-compatible on tables and rows in multiple SQL statements the Distributed TransactionProtection
? Rich in,Full functionthe ANSI SQL LanguageSupportUseODBC/ JDBC ConnectionInterface
?by usingCompile-timeand run-time optimized to improve performance
? trafodion intends to using parallelPerception ofLarge data setsquery optimizerto provide HAdoop'sthe full functionalityEco-System:
?throughHBase'scolumnFamilyprovided byArchitectureFlexibilitystructure
?in theHadoop'sVersion SupportSnapshotfunction
? Highavailability and disaster recoverySupport,Copy andSnapshotfunction

Advantages

trafodion provides a full-featured HBase solution that optimizes all Transactions of the SQL on the Database management System of the Transactional of data protection . These features help overcome the Transactional work of Hadoop in support Weaknesses .


With Trafodion, customers receive the following benefits:

? can be Using SQL Specialty & Complex the MapReduce Programming of existing Transactional Applications

Seamless support for applications that already exist

to develop the next generation of high scalability , real-time Transaction Processing Applications

? Reduce Data Latency reduce Analytics workloads

can also be obtained Hadoop Ecosystem The following benefits are inherent :

? Reduce infrastructure costs
? Large-scale Scalability of and the elasticity Granules

? Improve Data availability and Disaster Recovery Protection

Architecture

trafodion software architecture consists of three different levels: the client layer , SQL Database Service Layer , and the storage engine Layer , such as is shown .

the first layer is Customer Service . Application through standard ODBC/jdbc Access trafodion Database .

SecondLayeris atrafodionprovideaabout theHBase'sTop ofschema relational SQL Abstraction,Package All the trafodion Database object services that need to be managed . These servicesincludeConnection Management,Transaction Management,OptimizedPlan Buildand Implementation. trafodionProduceParallela maturequery optimizerquery plan,and withoutComplex ofMapReduce Programming.

< Span> third layer is storage engine the standard h adoop service, including hbase , HDFS and Zoo Administrator . trafodion Database object hadoop stored on local ( HBase / hdfs ) database construct. trafodion processing SQL statements request Mappings to Local HBase Transparent on behalf of the application of Call .

Innovation the key

trafodionof theDistributed Transaction Management(DTM).Componentprovidefrom the transactionMultiple SQL statements,Multiple TablesorMultiple rowsthe singleTable Multi-protection . also，trafodionDTMleverage traditional two-phase commit protocol with multiple HBase zone configurations for distributed across clusters The cluster provides protection. DTMprovides aSupportImplicit(Auto Commit), andClear(BEGIN,COMMIT,ROLLBACK Work)Transaction Control.
trafodionProvides a lot of different transactional work Compile-timeand run-timeof theOptimized,fromfor OLTPclass single access to operations reports for transactions is highly complex SQL statements.

Example Use Cases : OpenCart Application

Opencartwhich is a free open source ecommerce platform that has been modified to Execute SQL statement for trafodion , rather than the default Database ( MySQL) of the Interface .
This is a very good the program to typical of OLTP workloads features .

The first two pictures shown is the hp 's shopping cart OpenCart changes, the last two Figure illustrates the workload and query- level analysis using trafodion queries Workbench .

Product Description

         HP has < span> as an open source project launch The trafodion , and is published under Apache License version 2.0 . trafodion can now help you evaluate trafodion capability of , and start proof
concept and prototype Effect. trafodion file and download package contains The installer and the executable code, can be www.trafodion.org .

Trafodion:transactional SQL on HBase