When I run this import
import habana_frameworks.mediapipe.mediapipe
I got the follow error
>>> import habana_frameworks.mediapipe.mediapipe
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/robinysh/SpeechLLM/.venv/lib/python3.10/site-packages/habana_frameworks/mediapipe/mediapipe.py", line 2, in <module>
from habana_frameworks.mediapipe.backend.utils import get_media_fw_type
File "/home/robinysh/SpeechLLM/.venv/lib/python3.10/site-packages/habana_frameworks/mediapipe/backend/utils.py", line 3, in <module>
import media_pipe_types as mpt # NOQA
ModuleNotFoundError: No module named 'media_pipe_types'
Where should this missing package be coming from? Is it from some pypi package or habanalabs-installer.sh? I have tried to reinstall the habana-media-loader package from pypi but the error remains.
What docker are you running?
I am able to run “import habana_frameworks.mediapipe.mediapipe” fine on 1.16 release
Also, if you use docker, mediapipe comes preinstalled
>>> import habana_frameworks.mediapipe.mediapipe as mp
>>> mp
<module 'habana_frameworks.mediapipe.mediapipe' from '/usr/local/lib/python3.10/dist-packages/habana_frameworks/mediapipe/mediapipe.py'>
Am I supposed to install mediapipe from somwhere, in addition to habanalabs-installer.sh?
I am not using docker. I am creating a virtualenv and installing the dependencies with HABANALABS_VIRTUAL_DIR='.venv' habanalabs-installer.sh install --type pytorch --venv -y
If it helps, this is the output from HABANALABS_VIRTUAL_DIR='.venv' habanalabs-installer.sh validate
================================================================================
Environment
================================================================================
Device gaudi2
OS ubuntu
OS version 22.04
Log file /var/log/habana_logs/install-2024-07-10-00-52-13.log
Release version 1.16.2-2
Habanalabs server vault.habana.ai
Rewrite installer config no
Install type validate
Python repo URL https://vault.habana.ai/artifactory/api/pypi/gaudi-python/simple
Habanalabs software [OK]
habanalabs-container-runtime=1.16.2-2
habanalabs-dkms=1.16.2-2
habanalabs-firmware=1.16.2-2
habanalabs-firmware-odm=1.16.2-2
habanalabs-firmware-tools=1.16.2-2
habanalabs-graph=1.16.2-2
habanalabs-qual=1.16.2-2
habanalabs-qual-workloads=1.16.2-2
habanalabs-rdma-core=1.16.2-2
habanalabs-thunk=1.16.2-2
================================================================================
System
================================================================================
CPU: 160
Model name: Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz
MemTotal: 1056375244 kB
Hugepagesize: 2048 kB
================================================================================
OS environment
================================================================================
Package manager [apt]
The required sudo privileges are [FAILED]
Python 3.10 [OK]
================================================================================
Basic dependencies
================================================================================
gcc [OK]
cmake [OK]
lsof [OK]
curl [OK]
wget [OK]
linux-headers-5.15.0-92-generic [OK]
ethtool [OK]
libelf-dev [OK]
libbz2-dev [OK]
liblzma-dev [OK]
libibverbs-dev [OK]
librdmacm-dev [OK]
dkms [OK]
linux-modules-extra-5.15.0-92-generic [OK]
================================================================================
PyTorch dependencies
================================================================================
gcc [OK]
cmake [OK]
lsof [OK]
curl [OK]
wget [OK]
unzip [OK]
libcurl4 [OK]
moreutils [OK]
iproute2 [OK]
libcairo2-dev [OK]
libglib2.0-dev [OK]
libselinux1-dev [OK]
libnuma-dev [OK]
libpcre2-dev [OK]
libatlas-base-dev [OK]
libjpeg-dev [OK]
liblapack-dev [OK]
libnuma-dev [OK]
google-perftools [OK]
numactl [OK]
libopenblas-dev [OK]
The installed version is: 4.1.5
================================================================================
Installed Habanalabs software
================================================================================
habanalabs-container-runtime=1.16.2-2
habanalabs-dkms=1.16.2-2
habanalabs-firmware=1.16.2-2
habanalabs-firmware-odm=1.16.2-2
habanalabs-firmware-tools=1.16.2-2
habanalabs-graph=1.16.2-2
habanalabs-qual=1.16.2-2
habanalabs-qual-workloads=1.16.2-2
habanalabs-rdma-core=1.16.2-2
habanalabs-thunk=1.16.2-2
================================================================================
Full install log: /var/log/habana_logs/install-2024-07-10-00-52-13.log
================================================================================
I am not sure about mediapipe for bare metal installs. Usually I use the docker, and there mediapipe comes installed and you don’t have to do anything.
I’ll try to check if bare metal install needs anything else for mediapipe