Hive 新特性:Bypass Mapreduce

來源:互聯網
上載者:User

正在搞的Hive查詢平台給每一個Query打了tag,想試試看效果如果發現竟然沒有資料流入;原來發現Hive裡面做了一個改進:https://issues.apache.org/jira/browse/HIVE-887

對於簡單的查詢不會走mapreduce而是直接在檔案層面過濾,由於bypass了mapreduce,大大降低了hive的查詢時間,可以通過參數hive.fetch.task.conversion控制是否啟用該特性


本文出自 “MIKE老畢的部落格” 部落格,請務必保留此出處http://boylook.blog.51cto.com/7934327/1301454

相關文章

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.