XGBoost Python Package Troubleshooting ====================== Windows platform ------------ The current best solution for installing xgboost on windows machine is building from github. Please go to [windows](/windows/), build with the Visual Studio project file, and install. Additional detailed instruction can be found at this [installation tutorial](https://www.kaggle.com/c/otto-group-product-classification-challenge/forums/t/13043/run-xgboost-from-windows-and-python) from Kaggle Otto Forum. `pip install xgboost` is **not** tested nor supported in windows platform for now. Linux platform (also Mac OS X in general) ------------ **Trouble 0**: I see error messages like this when install from github using `python setup.py install`. XGBoostLibraryNotFound: Cannot find XGBoost Libarary in the candidate path, did you install compilers and run build.sh in root path? List of candidates: /home/dmlc/anaconda/lib/python2.7/site-packages/xgboost-0.4-py2.7.egg/xgboost/libxgboostwrapper.so /home/dmlc/anaconda/lib/python2.7/site-packages/xgboost-0.4-py2.7.egg/xgboost/../../wrapper/libxgboostwrapper.so /home/dmlc/anaconda/lib/python2.7/site-packages/xgboost-0.4-py2.7.egg/xgboost/./wrapper/libxgboostwrapper.so **Solution 0**: Please check if you have: * installed the latest C++ compilers and `make`, for example `g++` and `gcc` (Linux) or `clang LLVM` (Mac OS X). Recommended compilers are `g++-5` or newer (Linux and Mac), or `clang` comes with Xcode in Mac OS X. For installing compilers, please refer to your system package management commands, e.g. `apt-get` `yum` or `brew`(Mac). * compilers in your `$PATH`. Try typing `gcc` and see if your have it in your path. * Do you use other shells than `bash` and install from `pip`? In some old version of pip installation, the shell script used `pushd` for changing directory and triggering the build process, which may failed some shells without `pushd` command. Please update to the latest version by removing the old installation and redo `pip install xgboost` * Some outdated `make` may not recognize the recent changes in the `Makefile` and gives this error, please update to the latest `make`: `/usr/lib/ruby/gems/1.8/gems/make-0.3.1/bin/make:4: undefined local variable or method 'make' for main:Object (NameError)` **Trouble 1**: I see the same error message in **Trouble 0** when install from `pip install xgboost`. **Solution 1**: the problem is the same as in **Trouble 0**, please see **Solution 0**. **Trouble 2**: I see this error message when `pip install xgboost`. It says I have `libxgboostwrapper.so` but it is not valid. OSError: /home/dmlc/anaconda/lib/python2.7/site-packages/xgboost/./wrapper/libxgboostwrapper.so: invalid ELF header **Solution 2**: Solution is as in 0 and 1 by installing the latest `g++` compiler and the latest `make`. The reason for this rare error is that, `pip` ships with a pre-compiled `libxgboostwrapper.so` with Mac for placeholder for allowing `setup.py` to find the right lib path. If a system doesn't compile, it may refer to this placeholder lib and fail. This placeholder `libxgboostwrapper.so` will be automatically removed and correctly generated by the compiling on-the-fly for the system. **Trouble 3**: My system's `pip` says it can't find a valid `xgboost` installation release on `PyPI`. **Solution 3**: Some linux system comes with an old `pip` version. Please update to the latest `pip` by following the official installation document at **Trouble 4**: I tried `python setup.py install` but it says `setuptools` import fail. **Solution 4**: Please make sure you have [setuptools](https://pypi.python.org/pypi/setuptools) before installing the python package. **Trouble 5**: I see the same error message in **Trouble 0** when install from `pip install xgboost`. **Solution 5**: The compilation process uses too many processes to run `make` and the box runs out or RAM. To solve this, there are two alternatives: * Add more RAM. * Run `make` with just one process: ``` git clone --recursive https://github.com/dmlc/xgboost cd xgboost; make -j1 ``` Mac OS X (specific) ------------ Most of the troubles and solutions are the same with that in the Linux platform. Mac has the following specific problems. **Trouble 0**: I successfully installed `xgboost` using github installation/using `pip install xgboost`. But it runs very slow with only single thread, what is going on? **Solution 0**: `clang LLVM` compiler on Mac OS X from Xcode doesn't support OpenMP multi-thread. An alternative choice is installing `homebrew` and `brew install gcc5` which provides multi-thread OpenMP support. **Trouble 1**: Can I install `clang-omp` for supporting OpenMP without using `gcc`? **Solution 1**: it is not support and may have linking errors.