What is Alluxio
Alluxio (formerly known as Tachyon) is a virtual distributed storage system. It bridges the gap between computation frameworks and storage systems, enabling computation applications to connect to numerous storage systems through a common interface. Read more about Alluxio Overview.
The Alluxio project originated from a research project called Tachyon at AMPLab, UC Berkeley, which was the data layer of the Berkeley Data Analytics Stack (BDAS). For more details, please refer to Haoyuan Li's PhD dissertation Alluxio: A Virtual Distributed File System.
Who Uses Alluxio
Alluxio is used in production to manage Petabytes of data in many leading companies, with the largest deployment exceeding 1300 nodes. Find more use cases at Powered by Alluxio.
Prebuilt binaries are available to download at https://www.alluxio.org/download .
Download and start an Alluxio master and a worker. More details can be found in documentation.
# launch a master $ docker run -d --net=host\ -v /mnt/data:/opt/alluxio/underFSStorage\ alluxio/alluxio master # launch a worker $ docker run -d --net=host --shm-size=1G\ -e ALLUXIO_WORKER_MEMORY_SIZE=1G\ -v /mnt/data:/opt/alluxio/underFSStorage\ -e ALLUXIO_MASTER_HOSTNAME=localhost\ alluxio/alluxio worker
$ brew install alluxio
Please follow the Guide to Get Started to run a simple example with Alluxio.
Report a Bug
Join the Community
Please use the following to reach members of the community:
- Slack: alluxio-community channel
- Mailing List: alluxio-users
- Meetup Group: Bay Area Meetup
- Twitter: @alluxio
Depend on Alluxio
For Alluxio versions 1.4 or earlier, use the
For Alluxio versions 1.5 or later, Alluxio provides several different client artifacts. The Alluxio
file system interface provided by the
alluxio-core-client-fs artifact is recommended for the best
performance and access to Alluxio-specific functionality. If you want to use other interfaces,
include the appropriate client artifact. For example,
alluxio-core-client-hdfs provides a client
implementing HDFS's file system API.
<dependency> <groupId>org.alluxio</groupId> <artifactId>alluxio-core-client-fs</artifactId> <version>1.8.1</version> </dependency>
libraryDependencies += "org.alluxio" % "alluxio-core-client-fs" % "1.8.1"
Contributions via GitHub pull requests are gladly accepted from their original author. Along with any pull requests, please state that the contribution is your original work and that you license the work to the project under the project's open source license. Whether or not you state this explicitly, by submitting any copyrighted material via pull request, email, or other means you agree to license the material under the project's open source license and warrant that you have the legal authority to do so. For a more detailed step-by-step guide, please read how to contribute to Alluxio. For new contributor, please take 2 new contributor tasks.