文章数:239, 网站运行天数:1060天, 最近更新:2025-1-23, 当前线路:美国 洛杉矶 US.LA.9929.Starter

30X Performance Improvement 🚀 Hive on Tez + LLAP Optimization Practices

Reference: guava source code : https://github.com/google/guava guava package conflict : https://superuser.com/questions/1492421/i-cant-run-hive-in-command-line guava update: https://issues.apache.org/jira/browse/HADOOP-15960 hive version: https://hive.apache.org/general/downloads/ tez official website: https://tez.apache.org/ tez-0.10.1 installation documentation: https://github.com/apache/tez/blob/branch-0.10.1/docs/src/site/markdown/install.md tez-timeline: https://github.com/apache/tez/blob/branch-0.10.1/docs/src/site/markdown/tez_yarn_timeline.md hive on Tez : https://hive.apache.org/docs/latest/hive-on-tez_33296197/ llap documentation: https://hive.apache.org/docs/latest/llap_62689557/ llap design documentation: https://issues.apache.org/jira/secure/attachment/12665704/LLAPdesigndocument.pdf https://www.cnblogs.com/boanxin/p/13336930.html https://hive.apache.org/docs/latest/llap_62689557/ https://www.cnblogs.com/lanston/p/13868096.html https://www.cnblogs.com/muzhongjiang/p/13181917.html Tez Tez is Apache’s newest open source computing framework for DAG jobs […]

Mock

What is Mock? The role of Mock in agile development is to quickly build prototypes, efficiently test code, and reduce the impact of the development team on external dependencies, thereby helping the development team respond to changes in requirements more quickly and flexibly and deliver high-quality software products. General Mock process mock platform implementation Mockiot […]

jvm garbage collector optimization scheme

Collector selection Serial collector: single-thread collector, suitable for small or medium-sized applications. Parallel collector: Multithreaded collector, suitable for large applications with response time priority CMS Collector: Concurrent marker scavenging collector, suitable for medium sized applications with strict response time requirements. G1 collector: Concurrent mark collating collector, suitable for large applications and applications with strict response […]

Install docker online

yum install -y yum-utils device-mapper-persistent-data lvm2 yum-config-manager –add-repo http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo yum makecache fast yum -y install docker-ce systemctl enable docker sudo mkdir -p /etc/docker sudo vi /etc/docker/daemon.json <<-‘EOF’ { "registry-mirrors": ["https://yours.mirror.aliyuncs.com"] } EOF sudo systemctl daemon-reload sudo systemctl restart docker