This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

PROCESSOR-SDK-AM64X: tisdk build failure

Part Number: PROCESSOR-SDK-AM64X


I follow the directions from software-dl.ti.com/.../Release_Specific_Release_Notes.html

Using the ~/tisdk/configs/processor-sdk-linux/processor-sdk-linux-08_01_00.txt config and "MACHINE=am64xx-evm bitbake tisdk-base-image" delivers this output:

WARNING: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Failed to fetch URL git://github.com/onnx/onnx-tensorrt;protocol=https;branch=master;destsuffix=~/tisdk/build/arago-tmp-external-arm-glibc/work/aarch64-linux/onnxruntime/1.7.0-r0_psdkla_3/git/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt, attempting MIRRORS if available
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Fetcher failure: Unable to find revision dc22bb323ece3c65419717be8a0d3d0f318a61fa in branch master even from upstream
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'git://github.com/onnx/onnx-tensorrt;protocol=https;branch=master;destsuffix=~/tisdk/build/arago-tmp-external-arm-glibc/work/aarch64-linux/onnxruntime/1.7.0-r0_psdkla_3/git/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt')
ERROR: Logfile of failure stored in: ~/tisdk/build/arago-tmp-external-arm-glibc/work/aarch64-linux/onnxruntime/1.7.0-r0_psdkla_3/temp/log.do_fetch.4551
ERROR: Task (~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2768 tasks of which 2627 didn't need to be rerun and 1 failed.
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds

Summary: 1 task failed:
  ~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch
Summary: There were 7 WARNING messages shown.
Summary: There were 172 ERROR messages shown, returning a non-zero exit code.

After attempting to cherry pick the commit as suggested in https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1072575/j7expcxevm-building-of-tisdk-fails-due-to-fetch-from-incorrect-git-repo-branch-name/3969162 by altering /tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb as follows:

git diff onnxruntime.bb
diff --git a/recipes-core/packagegroups/onnxruntime.bb b/recipes-core/packagegroups/onnxruntime.bb
index c8fef5f..bc36d27 100644
--- a/recipes-core/packagegroups/onnxruntime.bb
+++ b/recipes-core/packagegroups/onnxruntime.bb
@@ -52,7 +52,7 @@ LIC_FILES_CHKSUM = "file://LICENSE;md5=0f7e3b1308cb5c00b372a6e78835732d \
                     file://cmake/external/FeaturizersLibrary/src/3rdParty/re2/LICENSE;md5=3b5c31eb512bdf3cb11ffd5713963760 \
 "
 
-SRC_URI = "git://github.com/microsoft/onnxruntime;protocol=https;branch=master;name=base \
+SRC_URI = "git.ti.com/gitweb \
            git://github.com/gabime/spdlog;protocol=https;branch=v2.x;destsuffix=${S}/server/external/spdlog;name=server-external-spdlog \
            git://github.com/apple/coremltools;protocol=https;branch=main;destsuffix=${S}/cmake/external/coremltools;name=cmake-external-coremltools \
            git://github.com/microsoft/onnxruntime-tvm;protocol=https;branch=nuphar;destsuffix=${S}/cmake/external/tvm;name=cmake-external-tvm \

The following output is generated:

WARNING: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Failed to fetch URL git.ti.com/gitweb, attempting MIRRORS if available
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Fetcher failure for URL: 'git.ti.com/gitweb. The fetch command returned success for url git.ti.com/gitweb but ~/tisdk/downloads/meta-psdkla.git doesn't exist?!
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'git.ti.com/gitweb
ERROR: Logfile of failure stored in: ~/tisdk/build/arago-tmp-external-arm-glibc/work/aarch64-linux/onnxruntime/1.7.0-r0_psdkla_3/temp/log.do_fetch.17693
ERROR: Task (~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2251 tasks of which 2206 didn't need to be rerun and 1 failed.
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds

Summary: 1 task failed:
  ~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch
Summary: There were 5 WARNING messages shown.
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.

Attempting the solution suggested in https://e2e.ti.com/support/processors-group/processors/f/processors-forum/948986/faq-tda4vm-how-to-resolve-yocto-build-failure-while-trying-to-fetch-repository as follows:

git diff onnxruntime.bb
diff --git a/recipes-core/packagegroups/onnxruntime.bb b/recipes-core/packagegroups/onnxruntime.bb
index c8fef5f..b09524f 100644
--- a/recipes-core/packagegroups/onnxruntime.bb
+++ b/recipes-core/packagegroups/onnxruntime.bb
@@ -52,7 +52,9 @@ LIC_FILES_CHKSUM = "file://LICENSE;md5=0f7e3b1308cb5c00b372a6e78835732d \
                     file://cmake/external/FeaturizersLibrary/src/3rdParty/re2/LICENSE;md5=3b5c31eb512bdf3cb11ffd5713963760 \
 "
 
-SRC_URI = "git://github.com/microsoft/onnxruntime;protocol=https;branch=master;name=base \
+SRC_URI = "git.ti.com/gitweb \
+            file://0001-do-not-strip-pdata_tools-at-do_install.patch \
+            file://use-sh-on-path.patch \
            git://github.com/gabime/spdlog;protocol=https;branch=v2.x;destsuffix=${S}/server/external/spdlog;name=server-external-spdlog \
            git://github.com/apple/coremltools;protocol=https;branch=main;destsuffix=${S}/cmake/external/coremltools;name=cmake-external-coremltools \
            git://github.com/microsoft/onnxruntime-tvm;protocol=https;branch=nuphar;destsuffix=${S}/cmake/external/tvm;name=cmake-external-tvm \
@@ -224,7 +226,7 @@ EXTRA_OECMAKE = " \
     -Donnxruntime_USE_TIDL=ON \
 "
 
-do_install() {
+do_install() {
     cmake_do_install
 
     install -d ${B}/docs/python

Fails as follows:

WARNING: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Failed to fetch URL git.ti.com/gitweb, attempting MIRRORS if available
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Fetcher failure for URL: 'git.ti.com/gitweb. The fetch command returned success for url git.ti.com/gitweb but ~/tisdk/downloads/meta-psdkla.git doesn't exist?!
ERROR: onnxruntime-1.7.0-r0_psdkla_3 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'git.ti.com/gitweb
ERROR: Logfile of failure stored in: ~/tisdk/build/arago-tmp-external-arm-glibc/work/aarch64-linux/onnxruntime/1.7.0-r0_psdkla_3/temp/log.do_fetch.17101
ERROR: Task (~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2704 tasks of which 2666 didn't need to be rerun and 1 failed.
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds
NOTE: Writing buildhistory
NOTE: Writing buildhistory took: 1 seconds

Summary: 1 task failed:
  ~/tisdk/sources/meta-psdkla/recipes-core/packagegroups/onnxruntime.bb:do_fetch
Summary: There were 9 WARNING messages shown.
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.

How do I build the SDK? Is there a fix available?

  • Hi!

    I recently ran into this issue myself trying to build the AM64x SDK v08.01 from source, and yes it is related to some upstream repositories renaming their branches, which unfortunately is not reflected well in the error message Yocto outputs...  But then also one repository changed its URL (Github project).

    Attached is a summary of all the changes I did to get the AM64x SDK v08.01 to build from sources just a few days ago, please give this a shot.

    Regards, Andreas

    adannenb@beast:~/tisdk/sources (master)
    $ for d in */ ; do echo "Checking for diff in $d..." ; git -C "$d" diff ; done
    Checking for diff in bitbake/...
    Checking for diff in meta-arago/...
    Checking for diff in meta-arm/...
    Checking for diff in meta-aws/...
    Checking for diff in meta-jupyter/...
    Checking for diff in meta-openembedded/...
    diff --git a/meta-oe/recipes-devtools/protobuf/protobuf_3.11.4.bb b/meta-oe/recipes-devtools/protobuf/protobuf_3.11.4.bb
    index d2f22ba6b..63b6fd2b2 100644
    --- a/meta-oe/recipes-devtools/protobuf/protobuf_3.11.4.bb
    +++ b/meta-oe/recipes-devtools/protobuf/protobuf_3.11.4.bb
    @@ -12,7 +12,7 @@ DEPENDS_append_class-target = " protobuf-native"
     
     SRCREV = "d0bfd5221182da1a7cc280f3337b5e41a89539cf"
     
    -SRC_URI = "git://github.com/google/protobuf.git;branch=3.11.x;protocol=https \
    +SRC_URI = "git://github.com/protocolbuffers/protobuf.git;branch=3.11.x;protocol=https \
                file://run-ptest \
                file://0001-protobuf-fix-configure-error.patch \
                file://0001-Makefile.am-include-descriptor.cc-when-building-libp.patch \
    Checking for diff in meta-psdkla/...
    diff --git a/recipes-core/packagegroups/onnxruntime.bb b/recipes-core/packagegroups/onnxruntime.bb
    index c8fef5f..718cc08 100644
    --- a/recipes-core/packagegroups/onnxruntime.bb
    +++ b/recipes-core/packagegroups/onnxruntime.bb
    @@ -68,20 +68,20 @@ SRC_URI = "git://github.com/microsoft/onnxruntime;protocol=https;branch=master;n
                git://github.com/tensorflow/tensorboard;protocol=https;branch=master;destsuffix=${S}/cmake/external/tensorboard;name=cmake-external-tensorboard \
                git://github.com/HowardHinnant/date;protocol=https;branch=master;destsuffix=${S}/cmake/external/date;name=cmake-external-date \
                git://github.com/google/flatbuffers;protocol=https;branch=master;destsuffix=${S}/cmake/external/flatbuffers;name=cmake-external-flatbuffers \
    -           git://github.com/onnx/onnx-tensorrt;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt \
    +           git://github.com/onnx/onnx-tensorrt;protocol=https;branch=main;destsuffix=${S}/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt \
                git://github.com/onnx/onnx;protocol=https;branch=rel-1.6.1;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx;name=cmake-external-onnx-tensorrt-third-party-onnx \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/benchmark;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-benchmark \
                git://github.com/pybind/pybind11;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-pybind11 \
                git://github.com/wjakob/clang-cindex-python3;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-pybind11-tools-clang \
                git://github.com/google/re2;protocol=https;branch=main;destsuffix=${S}/cmake/external/re2;name=cmake-external-re2 \
    -           git://github.com/onnx/onnx;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx;name=cmake-external-onnx \
    +           git://github.com/onnx/onnx;protocol=https;branch=main;destsuffix=${S}/cmake/external/onnx;name=cmake-external-onnx \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx/third_party/benchmark;name=cmake-external-onnx-third-party-benchmark \
                git://github.com/pybind/pybind11;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx/third_party/pybind11;name=cmake-external-onnx-third-party-pybind11 \
                git://github.com/martinmoene/optional-lite;protocol=https;branch=master;destsuffix=${S}/cmake/external/optional-lite;name=cmake-external-optional-lite \
                git://github.com/microsoft/wil;protocol=https;branch=master;destsuffix=${S}/cmake/external/wil;name=cmake-external-wil \
                git://github.com/NVlabs/cub;protocol=https;branch=main;destsuffix=${S}/cmake/external/cub;name=cmake-external-cub \
                git://github.com/google/nsync;protocol=https;branch=master;destsuffix=${S}/cmake/external/nsync;name=cmake-external-nsync \
    -           git://github.com/protocolbuffers/protobuf;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
    +           git://github.com/protocolbuffers/protobuf;protocol=https;branch=main;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
                git://github.com/google/googletest;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/googletest;name=cmake-external-protobuf-third-party-googletest \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/benchmark;name=cmake-external-protobuf-third-party-benchmark \
                git://github.com/jarro2783/cxxopts;protocol=https;branch=master;destsuffix=${S}/cmake/external/cxxopts;name=cmake-external-cxxopts \
    Checking for diff in meta-qt5/...
    Checking for diff in meta-ti/...
    Checking for diff in meta-virtualization/...
    Checking for diff in oe-core/...
    
    

  • Hello,

    Thank you for your suggestion!

    I adapted my onnxruntime.bb file as follows:

    user@host:../tisdk/sources/meta-psdkla/recipes-core/packagegroups$ git diff
    diff --git a/recipes-core/packagegroups/onnxruntime.bb b/recipes-core/packagegroups/onnxruntime.bb
    index c8fef5f..8798219 100644
    --- a/recipes-core/packagegroups/onnxruntime.bb
    +++ b/recipes-core/packagegroups/onnxruntime.bb
    @@ -68,20 +68,20 @@ SRC_URI = "git://github.com/microsoft/onnxruntime;protocol=https;branch=master;n
                git://github.com/tensorflow/tensorboard;protocol=https;branch=master;destsuffix=${S}/cmake/external/tensorboard;name=cmake-external-tensorboard \
                git://github.com/HowardHinnant/date;protocol=https;branch=master;destsuffix=${S}/cmake/external/date;name=cmake-external-date \
                git://github.com/google/flatbuffers;protocol=https;branch=master;destsuffix=${S}/cmake/external/flatbuffers;name=cmake-external-flatbuffers \
    -           git://github.com/onnx/onnx-tensorrt;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt \
    +           git://github.com/onnx/onnx-tensorrt;protocol=https;branch=main;destsuffix=${S}/cmake/external/onnx-tensorrt;name=cmake-external-onnx-tensorrt \
                git://github.com/onnx/onnx;protocol=https;branch=rel-1.6.1;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx;name=cmake-external-onnx-tensorrt-third-party-onnx \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/benchmark;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-benchmark \
                git://github.com/pybind/pybind11;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-pybind11 \
                git://github.com/wjakob/clang-cindex-python3;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang;name=cmake-external-onnx-tensorrt-third-party-onnx-third-party-pybind11-tools-clang \
                git://github.com/google/re2;protocol=https;branch=main;destsuffix=${S}/cmake/external/re2;name=cmake-external-re2 \
    -           git://github.com/onnx/onnx;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx;name=cmake-external-onnx \
    +           git://github.com/onnx/onnx;protocol=https;branch=main;destsuffix=${S}/cmake/external/onnx;name=cmake-external-onnx \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx/third_party/benchmark;name=cmake-external-onnx-third-party-benchmark \
                git://github.com/pybind/pybind11;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx/third_party/pybind11;name=cmake-external-onnx-third-party-pybind11 \
                git://github.com/martinmoene/optional-lite;protocol=https;branch=master;destsuffix=${S}/cmake/external/optional-lite;name=cmake-external-optional-lite \
                git://github.com/microsoft/wil;protocol=https;branch=master;destsuffix=${S}/cmake/external/wil;name=cmake-external-wil \
                git://github.com/NVlabs/cub;protocol=https;branch=main;destsuffix=${S}/cmake/external/cub;name=cmake-external-cub \
                git://github.com/google/nsync;protocol=https;branch=master;destsuffix=${S}/cmake/external/nsync;name=cmake-external-nsync \
    -           git://github.com/protocolbuffers/protobuf;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
    +           git://github.com/protocolbuffers/protobuf;protocol=https;branch=main;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
                git://github.com/google/googletest;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/googletest;name=cmake-external-protobuf-third-party-googletest \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/benchmark;name=cmake-external-protobuf-third-party-benchmark \
                git://github.com/jarro2783/cxxopts;protocol=https;branch=master;destsuffix=${S}/cmake/external/cxxopts;name=cmake-external-cxxopts \
    @@ -224,7 +224,7 @@ EXTRA_OECMAKE = " \
         -Donnxruntime_USE_TIDL=ON \
     "
     
    -do_install() {
    +do_install() {
         cmake_do_install
     
         install -d ${B}/docs/python
    (END)
                git://github.com/pybind/pybind11;protocol=https;branch=master;destsuffix=${S}/cmake/external/onnx/third_party/pybind11;name=cmake-external-onnx-third-party-pybind11 \
                git://github.com/martinmoene/optional-lite;protocol=https;branch=master;destsuffix=${S}/cmake/external/optional-lite;name=cmake-external-optional-lite \
                git://github.com/microsoft/wil;protocol=https;branch=master;destsuffix=${S}/cmake/external/wil;name=cmake-external-wil \
                git://github.com/NVlabs/cub;protocol=https;branch=main;destsuffix=${S}/cmake/external/cub;name=cmake-external-cub \
                git://github.com/google/nsync;protocol=https;branch=master;destsuffix=${S}/cmake/external/nsync;name=cmake-external-nsync \
    -           git://github.com/protocolbuffers/protobuf;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
    +           git://github.com/protocolbuffers/protobuf;protocol=https;branch=main;destsuffix=${S}/cmake/external/protobuf;name=cmake-external-protobuf \
                git://github.com/google/googletest;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/googletest;name=cmake-external-protobuf-third-party-googletest \
                git://github.com/google/benchmark;protocol=https;branch=master;destsuffix=${S}/cmake/external/protobuf/third_party/benchmark;name=cmake-external-protobuf-third-party-benchmark \
                git://github.com/jarro2783/cxxopts;protocol=https;branch=master;destsuffix=${S}/cmake/external/cxxopts;name=cmake-external-cxxopts \
    @@ -224,7 +224,7 @@ EXTRA_OECMAKE = " \
         -Donnxruntime_USE_TIDL=ON \
     "
     
    -do_install() {
    +do_install() {
         cmake_do_install
     
         install -d ${B}/docs/python

    This seems to have solved the onnxruntime issue.

    I do not have a protobuf_3.11.4.bb file but instead a protobuf_3.11.4.bbappend file that I altered:

    diff --git a/recipes-devtools/protobuf/protobuf_3.11.4.bbappend b/recipes-devtools/protobuf/protobuf_3.11.4.bbappend
    index 872ccfa..068cb7b 100644
    --- a/recipes-devtools/protobuf/protobuf_3.11.4.bbappend
    +++ b/recipes-devtools/protobuf/protobuf_3.11.4.bbappend
    @@ -5,7 +5,7 @@ SRC_URI_remove = "\
     "
     
     SRC_URI_append = "\
    -    git://github.com/google/protobuf.git;branch=master \
    -"
    +            git://github.com/protocolbuffers/protobuf.git;branch=3.11.x;protocol=https \
    +            "
     
     PR_append = "_psdkla"

    This seems to take care of my git issues for now. Unfortunately this produces this error message:

    ERROR: linux-ti-staging-5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32 do_package: Error executing a python function in exec_func_python() autogenerated:
    
    The stack trace of python calls that resulted in this exception/failure was:
    File: 'exec_func_python() autogenerated', lineno: 2, function: <module>
         0001:
     *** 0002:do_package(d)
         0003:
    File: '../tisdk/sources/oe-core/meta/classes/package.bbclass', lineno: 2315, function: do_package
         2311:
         2312:    cpath = oe.cachedpath.CachedPath()
         2313:
         2314:    for f in (d.getVar('PACKAGESPLITFUNCS') or '').split():
     *** 2315:        bb.build.exec_func(f, d)
         2316:
         2317:    ###########################################################################
         2318:    # Process PKGDEST
         2319:    ###########################################################################
    File: '../tisdk/sources/bitbake/lib/bb/build.py', lineno: 254, function: exec_func
         0250:    with bb.utils.fileslocked(lockfiles):
         0251:        if ispython:
         0252:            exec_func_python(func, d, runfile, cwd=adir)
         0253:        else:
     *** 0254:            exec_func_shell(func, d, runfile, cwd=adir)
         0255:
         0256:    try:
         0257:        curcwd = os.getcwd()
         0258:    except:
    File: '../tisdk/sources/bitbake/lib/bb/build.py', lineno: 455, function: exec_func_shell
         0451:    with open(fifopath, 'r+b', buffering=0) as fifo:
         0452:        try:
         0453:            bb.debug(2, "Executing shell function %s" % func)
         0454:            with open(os.devnull, 'r+') as stdin, logfile:
     *** 0455:                bb.process.run(cmd, shell=False, stdin=stdin, log=logfile, extrafiles=[(fifo,readfifo)])
         0456:        finally:
         0457:            os.unlink(fifopath)
         0458:
         0459:    bb.debug(2, "Shell function %s finished" % func)
    File: '../tisdk/sources/bitbake/lib/bb/process.py', lineno: 184, function: run
         0180:
         0181:    if pipe.returncode != 0:
         0182:        if log:
         0183:            # Don't duplicate the output in the exception if logging it
     *** 0184:            raise ExecutionError(cmd, pipe.returncode, None, None)
         0185:        raise ExecutionError(cmd, pipe.returncode, stdout, stderr)
         0186:    return stdout, stderr
    Exception: bb.process.ExecutionError: Execution of '../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/run.populate_srcipk_package.7555' failed with exit code 1
    
    ERROR: Logfile of failure stored in: ../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/log.do_package.7555
    ERROR: Task (../tisdk/sources/meta-ti/recipes-kernel/linux/linux-ti-staging_5.10.bb:do_package) failed with exit code '1'

    As is I am unsure if the .bb file changes made cause the python script to fail or not.

    Thanks again for the suggestion

  • Hi Floki,

    I don't think the .bb changes are related to that, the error message points to a failure in the IPK packaging of the Kernel sources. I've actually seen similar issues myself recently and I'm currently checking with the internal team to better understand the root cause. For the meantime I was able to get my build to completion by specifically disabling the IPK packaging of Kernel sources (and U-Boot, that failed for me too) by adding the following to local.conf...

    CREATE_SRCIPK_pn-linux-ti-staging = "0"
    CREATE_SRCIPK_pn-u-boot-ti-staging = "0"

    Can you please try that and let me know if that allows your build to proceed.

    Regards, Andreas

  • Hi Andreas,

    Thank you for your suggestion.

    adding the suggested lines to the end of ../tisdk/build/conf/local.conf gives me the following error message when attempting to bitbake:

    ERROR: linux-ti-staging-5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32 do_compile: oe_runmake failed
    ERROR: linux-ti-staging-5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32 do_compile: Execution of '../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/run.do_compile.28961' failed with exit code 1
    ERROR: Logfile of failure stored in: ../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/log.do_compile.28961
    Log data follows:
    | DEBUG: Executing shell function do_compile
    | NOTE: make -j 9 HOSTCC=gcc  -isystem../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/include -O2 -pipe -L../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -L../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,--enable-new-dtags                         -Wl,-rpath-link,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -Wl,-rpath-link,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,-rpath,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -Wl,-rpath,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,-O1 HOSTCPP=gcc  -E HOSTCXX=g++  -isystem../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/include -O2 -pipe -L../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -L../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,--enable-new-dtags                         -Wl,-rpath-link,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -Wl,-rpath-link,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,-rpath,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/usr/lib                         -Wl,-rpath,../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native/lib                         -Wl,-O1 Image CC=aarch64-none-linux-gnu-gcc   -fuse-ld=bfd -fmacro-prefix-map=../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32=/usr/src/debug/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32                      -fdebug-prefix-map=../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32=/usr/src/debug/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32                      -fdebug-prefix-map=../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot=                      -fdebug-prefix-map=../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/recipe-sysroot-native=  -fdebug-prefix-map=../tisdk/build/arago-tmp-external-arm-glibc/work-shared/am64xx-evm/kernel-source=/usr/src/kernel   LD=aarch64-none-linux-gnu-ld.bfd   LOADADDR=0x80008000 DTC_FLAGS=-@
    |   GEN     Makefile
    |   CALL    ../tisdk/build/arago-tmp-external-arm-glibc/work-shared/am64xx-evm/kernel-source/scripts/atomic/check-atomics.sh
    |   CALL    ../tisdk/build/arago-tmp-external-arm-glibc/work-shared/am64xx-evm/kernel-source/scripts/checksyscalls.sh
    |   CHK     include/generated/compile.h
    |   GEN     .version
    |   CHK     include/generated/compile.h
    |   LD      vmlinux.o
    |   MODPOST vmlinux.symvers
    | WARNING: modpost: EXPORT symbol "msi_desc_to_pci_sysdata" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "msi_desc_to_pci_dev" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msix_vec_count" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_enable_msi" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_free_irq_vectors" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_restore_msi_state" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_irq_get_affinity" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_disable_msi" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_enable_msix_range" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_alloc_irq_vectors_affinity" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msi_mask_irq" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_disable_msix" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_irq_vector" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msi_unmask_irq" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_write_msi_msg" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msi_create_irq_domain" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msi_enabled" [vmlinux] version generation failed, symbol will not be versioned.
    | WARNING: modpost: EXPORT symbol "pci_msi_vec_count" [vmlinux] version generation failed, symbol will not be versioned.
    |   MODINFO modules.builtin.modinfo
    |   GEN     modules.builtin
    |   LD      .tmp_vmlinux.kallsyms1
    | aarch64-none-linux-gnu-ld.bfd: drivers/pci/msi.o: relocation R_AARCH64_ABS32 against `__crc_pci_msi_mask_irq' can not be used when making a shared object
    | ../tisdk/build/arago-tmp-external-arm-glibc/work-shared/am64xx-evm/kernel-source/Makefile:1179: recipe for target 'vmlinux' failed
    | make[1]: *** [vmlinux] Error 1
    | ../tisdk/build/arago-tmp-external-arm-glibc/work-shared/am64xx-evm/kernel-source/Makefile:185: recipe for target '__sub-make' failed
    | make: *** [__sub-make] Error 2
    | ERROR: oe_runmake failed
    | WARNING: ../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/run.do_compile.28961:1 exit 1 from 'exit 1'
    | ERROR: Execution of '../tisdk/build/arago-tmp-external-arm-glibc/work/am64xx_evm-linux/linux-ti-staging/5.10.65+gitAUTOINC+dcc6bedb2c-r0b.arago5_psdkla_32/temp/run.do_compile.28961' failed with exit code 1
    ERROR: Task (../tisdk/sources/meta-ti/recipes-kernel/linux/linux-ti-staging_5.10.bb:do_compile) failed with exit code '1'
    

    Regards,
    Floki

  • Can you try a MACHINE=am64xx-evm bitbake -c cleanall linux-ti-staging and then try a rebuild of the tisdk-base-image target?

    If that results in the same error, try MACHINE=am64xx-evm bitbake -c cleanall tisdk-base-image and a rebuild?

    It's a long shot but sometimes cleaning out the build (and/or re-trying) can fix intermittent build issues, esp. after making updates to configs or recipes.

    If that still results in the same error, can you make sure to try to get a working build with the TI-provided sources as-is (plus the local.conf modification discussed earler), without any of your other customizations? Might be good to set it up in a new folder from scratch to make sure it is 100% clean.

    Regards, Andreas

  • Thank you Andreas! I managed to bitbake after cleaning up.

    Quick question; I get a LOT of messages with "../path/name is owned by uid 1000, which is the same as the user running bitbake. This may be due to host contamination [host-user-contaminated]" in the build output.

    Is this normal?

    Regards, Floki

  • Hi Floki,

    I don't think I have seen that issue but doing a quick google research it seems to be not uncommon to happen. A UID of 1000 points to the first user account setup on a new Linux installation which is the same UID used in some recipes which triggers the warning. Unless you intentionally "polluted" the build directories this seems harmless. If you are adventurous you could setup a new user account on your Linux machine, and setup your Yocto build again and re-try, chances are it won't produce that same warning (due to your new user account having a different UID). Which would confirm the warning is indeed harmless.

    There's some more info here: https://www.openembedded.org/pipermail/openembedded-core/2017-February/132178.html

    Regards,
    Andreas