Tachyon Configuration Items

Tachyon configuration parameters are divided into 4 classes: Master,worker, Common (Master and Worker), and User configurations.

environment variable configuration file in $tachyon_home/conf/tachyon-env.sh, these variables will be called by tachyon_java_opts, the configuration template for this file is $tachyon_home/conf/ Tachyon-env.sh.template

Additional JAVA VM options can be added to the tachyon_master_java_opts and tachyon_worker_java_opts configurations. In the template file, Tachyon_java_opts will be called by Tachyon_master_java_opts and tachyon_worker_java_opts

Second, Tachyon Common configuration

Property name	Default value	Meaning
Tachyon.home	"/mnt/tachyon_default_home"	installation directory for Tachyon
Tachyon.underfs.address	$tachyon. Home + "/underfs"	Tachyon underlying file system directory
Tachyon.data.folder	$tachyon. underfs.address + "/tachyon/data"	Tachyon underlying file system data directory
Tachyon.workers.folder	$tachyon. underfs.address + "/tachyon/workers"	Tachyon Worke Directory
Tachyon.usezookeeper	False	Whether to use zookeeper for master fault tolerance
Tachyon.zookeeper.address	Null	Zookeeper Address
Tachyon.zookeeper.election.path	"/election"	Zookeeper election folder
Tachyon.zookeeper.leader.path	"/leader"	Zookeeperleader folder
Tachyon.underfs.hdfs.impl	"Org.apache.hadoop.hdfs.DistributedFileSystem"	HDFs underlying file system implementation class
Tachyon.max.columns	1000	Rawtable the maximum number of columns allowed, which must be set on the client and server side
Tachyon.table.metadata.byte	5242880	The maximum number of bytes allowed in rawtable metadata
Fs.s3n.awsAccessKeyId	Null	S3 AWS Access key ID
Fs.s3n.awsSecretAccessKey	Null	S3 AWS Encrypted Access Key ID
Tachyon.underfs.glusterfs.mounts	Null	Glusterfs volume mount point, e.g. /volume
Tachyon.underfs.glusterfs.volumes	Null	Glusterfs volume names, such as Tachyon_vol
Tachyon.underfs.glusterfs.mapred.system.dir	Glusterfs:///mapred/system	Specify The data subdirectory of the MapReduce in Glusterfs as needed

Third, master configuration

Tachyon.master.journal.folder	$tachyon. Home + "/journal/"	Master Journal log Storage Directory
Tachyon.master.hostname	localhost	Master Host Name
Tachyon.master.port	19998	Master node running port
Tachyon.master.web.port	19999	Web interface Run port
Tachyon.master.whitelist	/	Cache path

Iv. Configuration of Wroker

Tachyon.worker.port	29998	Worker node Run port
Tachyon.worker.data.port	29999	Worker Data Service Run port
Tachyon.worker.data.folder	/mnt/ramdisk	Worker Node Data Directory
Tachyon.worker.memory.size	MB	Worker Memory capacity

Five, User Configuration

Tachyon.user.failed.space.request.limits	3	The time before the file system terminates
Tachyon.user.quota.unit.bytes	8 MB	minimum size of client request worker
Tachyon.user.file.buffer.bytes	1 MB	File Buffer size
Tachyon.user.default.block.size.byte	1 GB	Tachyon file default block size
Tachyon.user.remote.read.buffer.size.byte	1 MB	buffer size for reading data from remote worker

Tachyon Configuration Items