Installation

Conda

Both the hdfs3 Python library and the compiled libhdfs3 library (and its dependencies) are available from the conda-forge repository using conda:

$ conda install hdfs3 -c conda-forge

Note that conda packages are only available for the linux-64 platform.

PyPI and apt-get

Alternatively you can install the libhdfs3.so library using a system installer like apt-get:

echo "deb https://dl.bintray.com/wangzw/deb trusty contrib" | sudo tee /etc/apt/sources.list.d/bintray-wangzw-deb.list
sudo apt-get install -y apt-transport-https
sudo apt-get update
sudo apt-get install libhdfs3 libhdfs3-dev

And install the Python wrapper library, hdfs3, with pip:

pip install hdfs3

Build from Source

See the libhdfs3 installation instructions to install the compiled library.

You can download the hdfs3 Python wrapper library from github and install normally:

git clone git@github.com:dask/hdfs3
cd hdfs3
python setup.py install