Not able to install guidedlda package on Azure Databricks

[ervivek]

Databricks Runtime Version - 6.4 (includes Apache Spark 2.4.5, Scala 2.11)
Python version - 3.7.3

Getting following error -

Py4JJavaError: An error occurred while calling o512.addIsolatedPyPILibrary.
: org.apache.spark.SparkException: Process List(/local_disk0/pythonVirtualEnvDirs/virtualEnv-50059e9f-df77-443e-ba1c-f0864815d49c/bin/python, /local_disk0/pythonVirtualEnvDirs/virtualEnv-50059e9f-df77-443e-ba1c-f0864815d49c/bin/pip, install, guidedlda, --disable-pip-version-check) exited with code 1. Failed building wheel for guidedlda
Command "/local_disk0/pythonVirtualEnvDirs/virtualEnv-50059e9f-df77-443e-ba1c-f0864815d49c/bin/python -u -c "import setuptools, tokenize;file='/tmp/pip-install-_djhf2u0/guidedlda/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" install --record /tmp/pip-record-yru4gj9o/install-record.txt --single-version-externally-managed --compile --install-headers /local_disk0/pythonVirtualEnvDirs/virtualEnv-50059e9f-df77-443e-ba1c-f0864815d49c/include/site/python3.7/guidedlda" failed with error code 1 in /tmp/pip-install-_djhf2u0/guidedlda/

[ervivek]

Any suggestion?

[AbinayaM02]

Please try with Python=3.6. It works.