TDA4VM: Arago: Replace TI linux source repository with own git source repository

Thomas Dorsch

Part Number: TDA4VM

Hi,

I try to replace the used linux source repository in arago with my own repository which hosts linux source code.

I created a bbappend-file to overwrite some variables of meta-ti/recipes-kernel/linux/linux-ti-staging_5.4.bb, which I thought it is enough.

The file looks like this:

#This will overwrite the kernel source repository URL
BRANCH = "ibg-ti-linux-5.4.y"
SRCREV = "66cf445b7697a4963cfc796e06918fe5b147fe7d"
PV = "5.4.40+git${SRCPV}"

KERNEL_GIT_URI = "git://myserver:j721e_linux/generic/ibg-linux-ti.git"

This is the error during rebuilding the image with that changed ti linux source repository:

NOTE: Executing Tasks
WARNING: linux-ti-staging-5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla do_fetch: Failed to fetch URL git://myserver:j721e_linux/generic/ibg-linux-ti.git;protocol=git;branch=ibg-ti-linux-5.4.y, attempting MIRRORS if available
ERROR: linux-ti-staging-5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export PATH="/home/ewdt/oe/arago/sources/oe-core/scripts:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/usr/bin/aarch64-linux:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot/usr/bin/crossscripts:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/usr/sbin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/usr/bin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/sbin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/bin:/home/ewdt/oe/crosscompiletoolchain/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin:/home/ewdt/oe/arago/sources/bitbake/bin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/hosttools"; export HOME="/home/ewdt"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://myserver:j721e_linux/generic/ibg-linux-ti.git /home/ewdt/oe/arago/downloads/git2/myserver.j721e_linux.generic.ibg-linux-ti.git --progress failed with exit code 128, output:
Cloning into bare repository '/home/ewdt/oe/arago/downloads/git2/myserver.j721e_linux.generic.ibg-linux-ti.git'...
fatal: Unable to look up myserver:j721e_linux (port 9418) (Name or service not known)

ERROR: linux-ti-staging-5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla do_fetch: Fetcher failure for URL: 'git://myserver:j721e_linux/generic/ibg-linux-ti.git;protocol=git;branch=ibg-ti-linux-5.4.y'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/temp/log.do_fetch.29919
ERROR: Task (/home/ewdt/oe/arago/sources/meta-ti/recipes-kernel/linux/linux-ti-staging_5.4.bb:do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2982 tasks of which 2981 didn't need to be rerun and 1 failed.

When I look into the logfile of the task, I noticed following:

DEBUG: Fetching software-dl.ti.com/.../git2_myserver.j721e_linux.generic.ibg-linux-ti.git.tar.gz using command '/usr/bin/env wget -t 2 -T 30 --passive-ftp --no-check-certificate -P /home/ewdt/oe/arago/downloads 'software-dl.ti.com/processor-s
dk-mirror/sources/git2_myserver.j721e_linux.generic.ibg-linux-ti.git.tar.gz''
DEBUG: Fetcher accessed the network with the command /usr/bin/env wget -t 2 -T 30 --passive-ftp --no-check-certificate -P /home/ewdt/oe/arago/downloads 'software-dl.ti.com/.../git2_myserver.j721e_linux.generic.ibg-linux-ti.git.tar.gz'
DEBUG: Running export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export PATH="/home/ewdt/oe/arago/sources/oe-core/scripts:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/u
sr/bin/aarch64-linux:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot/usr/bin/crossscripts:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+g
itAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/usr/sbin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/usr/bin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/
work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/sbin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/work/j7_evm-linux/linux-ti-staging/5.4.40+gitAUTOINC+66cf445b76-r0a.arago5_psdkla/recipe-sysroot-native/bin:/home/ewdt/oe/crossc
ompiletoolchain/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin:/home/ewdt/oe/arago/sources/bitbake/bin:/home/ewdt/oe/arago/build/arago-tmp-external-arm-glibc/hosttools"; export HOME="/home/ewdt"; /usr/bin/env wget -t 2 -T 30 --passive-ftp --no-check-certificate -P /home/ewdt/oe/arago/
downloads 'software-dl.ti.com/.../git2_myserver.j721e_linux.generic.ibg-linux-ti.git.tar.gz' --progress=dot -v
--2020-11-16 14:53:15--  software-dl.ti.com/.../git2_myserver.j721e_linux.generic.ibg-linux-ti.git.tar.gz
Resolving software-dl.ti.com (software-dl.ti.com)... 184.30.209.167, 2a02:26f0:1500:18f::b48, 2a02:26f0:1500:1a6::b48
Connecting to software-dl.ti.com (software-dl.ti.com)|184.30.209.167|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2020-11-16 14:53:15 ERROR 404: Not Found.

I noticed this: Fetching

So it seems that KERNEL_GIT_URI seems to get wrapped into some TI specific paths to get the source code.

Can you guide me how to successfully replace the TI linux kernel source repository, with my own git repository?

Best regards,
Thomas

over 5 years ago

0 Karthik Ramanan over 5 years ago

TI__Guru** 113810 points

Hi Thomas,

This is very interesting. Can you please attach the log.do_fetch from your build - the failure log?

I will try to replicate this on my side and provide you the instructions/findings.

Regards

Karthik

0 Thomas Dorsch over 5 years ago in reply to Karthik Ramanan

Expert 2601 points

Hi Karthik,

I attached the failure log. Please notice, that I replaced our server URL in my earlier post. So that it does not get picked up by google..

Thank you very much!

Regards,

Thomas

/Edit: It seems I cannot attach a file here. Here is the link to the logfile:
https://privatebin.net/?dda399fd4ed5e2f1#Dc7fyFkSbxkj2oq54uj62NyRiVmVGtWKPhJHpNGy1Zba

0 Karthik Ramanan over 5 years ago in reply to Thomas Dorsch

TI__Guru** 113810 points

Hi Thomas,

The company firewall blocks me from accessing the fileshare path. Can you please zip the same (or change extension) and then try uploading the log? If it still doesn't work, I will try to propose alternate method.

Regards

Karthik

0 Thomas Dorsch over 5 years ago in reply to Karthik Ramanan

Expert 2601 points

Hi Karthik,

I try to compress the log file:

log.do_fetch.29919.tar.gz

0 Karthik Ramanan over 5 years ago in reply to Thomas Dorsch

TI__Guru** 113810 points

Hi Thomas,

I am attaching my build log (do_fetch for the kernel) here, there is one difference about the usage of the mirrors.

My recommendation is that we have an offline discussion over email to be able to look at the unfiltered log and share further information. Are you fine if we work this offline?

We can update the thread with our findings.

/cfs-file/__key/communityserver-discussions-components-files/791/6165.log.7z

Regards

Karthik

0 Thomas Dorsch over 5 years ago in reply to Karthik Ramanan

Expert 2601 points

Hi Karthik,

I will look into the mirrors, maybe I can find anything there.

Yes sure, we can communicate further via email. How do I get your email address?

Best regards,
Thomas

0 Thomas Dorsch over 5 years ago in reply to Thomas Dorsch

Expert 2601 points

Hi,

I think I have found the issue. Just want to share my solution:

I use a private gitlab repository, authentication via ssh.

This seems to be the git URI which yocto can handle to clone the repository:

#This will overwrite the kernel source repository from original TI ones.
BRANCH = "ibg-ti-linux-5.4.y"
SRCREV = "66cf445b7697a4963cfc796e06918fe5b147fe7d"
PV = "5.4.40+git${SRCPV}"

KERNEL_GIT_URI = "git://git@myserver:/j721e_linux/generic/ibg-linux-ti.git"
KERNEL_GIT_PROTOCOL = "ssh"

An additional git@ and "/" after : was required to get it functional.

Sorry for inconvenience, best regards,
Thomas

0 Karthik Ramanan over 5 years ago in reply to Thomas Dorsch

TI__Guru** 113810 points

Thomas,

Ok, good to know about this. There are always these quirks that we sometimes are not aware of when working on a public repository.

Thanks for posting the solution. I will close this thread.

The E2E system allows me to trigger an email if I need to connect with you and I would have done that if we had to work this offline, for now that is not necessary, will look forward to connect at a different time.

Regards
Karthik

Processors

Processors forum

TDA4VM: Arago: Replace TI linux source repository with own git source repository