PROCESSOR-SDK-AM65X: How to resolve the fetch error that occurs when executing bitbake.

Hi Tomitama,

This looks like a git proxy issue to me.

What is the difference between first failure and the second one? Why isn't the mtd-utils failure seen in the second fetch?

Regards

Karthik

Hello Karthik,
Thank you for your reply.

I think I've fixed the problem with the git proxy, and I'm getting a fetch error only here. Other than this, there are many places where fetching is successful.
When I change "SRC_URI" in "/yocto-build/sources/oe-core/meta/recipes-devtools/mtd/mtd-utils_git.bb" to "http" as shown below, I get a fetch error The content of has changed.Checksum seems to be bad.

Do I need to change "mtd-utils_git.bb" further? How should I change it?

---

SRC_URI = "git://git.infradead.org/mtd-utils.git  -->  SRC_URI = "git.infradead.org/mtd-utils.git

---

The details of the fetch error are as follows:

-------------------------------------------------------------------------------

ERROR: mtd-utils-2.1.1-r0.arago1 do_fetch: No checksum specified for '/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/downloads/mtd-utils.git', please add at least one to the recipe:
SRC_URI[sha256sum] = "ab4bfeb45fee37d666a9ac1c67d3ced4ad6f70d046362759d99620939d46eafa"
ERROR: mtd-utils-2.1.1-r0.arago1 do_fetch: Fetcher failure for URL: 'git.infradead.org/mtd-utils.git'. Missing SRC_URI checksum
ERROR: Logfile of failure stored in: /home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/temp/log.do_fetch.2326
ERROR: Task (/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/sources/oe-core/meta/recipes-devtools/mtd/mtd-utils_git.bb:do_fetch) failed with exit code '1'

-------------------------------------------------------------------------------

Hi Tomitama,

1. Could you please explain why you need to change from git to http when you mention that you have fixed the proxy issue?

2. I would recommend that you apply your proxy change and "revert" your changes on the mtd-utils_git.bb recipe. Share the log with this configuration.

3. If you have a failure with the bitbake in Step #2, I recommend that you try the following command on your Linux machine terminal and share the output "git clone git://git.infradead.org/mtd-utils.git"

Regards

Karthik

Hello Karthik,
Thank you for your reply.

1.
The proxy server in my environment does not allow the git protocol, so I am using the http protocol instead of the git protocol by modifying the ".gitconfig" as shown below.
-----
[url "http://"]
insteadOf = git://
-----
However, only the following two recipes still get fetch errors.
  /yocto-build/sources/oe-core/meta/recipes-devtools/mtd/mtd-utils_git.bb
  /yocto-build/sources/meta-arago/meta-arago-extras/recipes-benchmark/stream/stream_5.10.bb
Therefore, I tried to change the URI of the mtd-utils_git.bb recipe directly.

2.
The result of undoing the changes to the mtd-utils_git.bb recipe is as follows.
I am implementing by modifying ".gitconfig" using http protocol instead of git protocol.
-------------------------------------------------------------------------------
WARNING: mtd-utils-2.1.1-r0.arago1 do_fetch: Failed to fetch URL git://git.infradead.org/mtd-utils.git, attempting MIRRORS if available
ERROR: mtd-utils-2.1.1-r0.arago1 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export SSH_AGENT_PID="1491"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export GIT_PROXY_COMMAND="oe-git-proxy"; export all_proxy="socks://www-proxy.bb.tdi.co.jp:10080/"; export ALL_PROXY="socks://www-proxy.bb.tdi.co.jp:10080/"; export no_proxy="bb.tdi.co.jp"; export NO_PROXY="bb.tdi.co.jp"; export ftp_proxy="www-proxy.bb.tdi.co.jp:10080/"; export https_proxy="www-proxy.bb.tdi.co.jp:10080/"; export http_proxy="www-proxy.bb.tdi.co.jp:10080/"; export PATH="/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/sources/oe-core/scripts:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot-native/usr/bin/aarch64-linux:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot/usr/bin/crossscripts:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot-native/usr/sbin:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot-native/usr/bin:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot-native/sbin:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/work/aarch64-linux/mtd-utils/2.1.1-r0.arago1/recipe-sysroot-native/bin:/home/tomita/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/sources/bitbake/bin:/home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/build/arago-tmp-external-arm-glibc/hosttools"; export HOME="/home/tomita"; LANG=C git -c core.fsyncobjectfiles=0 fetch -f --prune --progress git://git.infradead.org/mtd-utils.git refs/*:refs/* failed with exit code 128, output:
fatal: repository 'git.infradead.org/.../' not found

ERROR: mtd-utils-2.1.1-r0.arago1 do_fetch: Fetcher failure for URL: 'git://git.infradead.org/mtd-utils.git'. Unable to fetch URL from any source.
-------------------------------------------------------------------------------

3.
When I changed ".gitconfig", the result was as follows.
  fatal: repository 'git.infradead.org/.../' not found
When using "corkscrew", the result is as follows.
  2020/12/08 13:57:24 socat[5382] E read(): EOF during read of socks reply, peer might not be a socks4 server
  fatal: Could not read from remote repository.

Hello Karthik,
Thank you for your reply.

What exactly does -3- "revert changes that i did for the proxy" mean?
Does it indicate that changes to ".gitconfig" should be undone?
Or does it indicate that changes to "mtd-utils_git.bb recipe" should be undone?
Or both?

Hi Tomitama,

Please undo all the experimental changes that you did to resolve the error for mtd_utils. It is probably both, but I'm not 100% clear on what you did.

Regards

Karthik

Hello Karthik,
Thank you for your reply.

1. Undo all experimental changes.
2. Execute a series of commands on the following site.
     software-dl.ti.com/.../Overview_Building_the_SDK.html

When bitbake is executed after performing the above procedure, the following error is output.
-----
ERROR: ExpansionError during parsing /home/tomita/ti-processor-sdk-linux-am65xx-evm-07_00_01_06/yocto-build/sources/meta-aws/recipes-sdk/aws-iot-device-sdk-python-v2/aws-iot-device-sdk-python-v2_git.bb
-----

Also, when I executed "git clone git: //git.infradead.org/mtd-utils.git", the following error was output.
-----
2020/12/09 12:05:36 socat[27381] E read(): EOF during read of socks reply, peer might not be a socks4 server
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
-----

Please tell me how to resolve.

Hi Tomitama,

You had reported the exact same issue and we had resolved it in this discussion: https://e2e.ti.com/support/processors/f/791/p/957352/3537785#3537785 request you to please remember the previous learnings or do a search on the e2e for your problems.

Regarding your error of the git clone, this is a proxy related issue and it is specific to your machine. Please use the relevant opensource forums to search for solutions to resolve the git clone issue. 

Regadrs

Karthik

Hello Karthik,
Thank you for your reply.

I remember and understand that the "ws-iot-device-sdk-python-v2_git.bb" recipe has been resolved.

If I'm working in an environment where the proxy doesn't allow the git protocol, is it impossible for bitbake to make all the builds successful?
I hope it isn't.
If "mtd_utils" cannot be fetched with http, is there any other workaround?

Hello Karthik,
Thank you for your reply.

I have already explored the mirror.
Looking at the contents of "log.do_fetch", all the fetches for the following mirrors are also in error.

-----
     DEBUG: Mirror fetch failure for url software-dl.ti.com/.../git2_git.infradead.org.mtd-utils.git.tar.gz (original url: git://git.infradead.org/mtd-utils.git)
     DEBUG: Mirror fetch failure for url software-dl.ti.com/.../git2_git.infradead.org.mtd-utils.git.tar.gz (original url: git://git.infradead.org/mtd-utils.git)
     DEBUG: Mirror fetch failure for url arago-project.org/.../git2_git.infradead.org.mtd-utils.git.tar.gz (original url: git://git.infradead.org/mtd-utils.git)
     DEBUG: Mirror fetch failure for url downloads.yoctoproject.org/.../git2_git.infradead.org.mtd-utils.git.tar.gz (original url: git://git.infradead.org/mtd-utils.git)
     DEBUG: Mirror fetch failure for url sources.openembedded.org/git2_git.infradead.org.mtd-utils.git.tar.gz (original url: git://git.infradead.org/mtd-utils.git)
     DEBUG: Mirror fetch failure for url git://git.infradead.org/mtd-utils.git;protocol=https (original url: git://git.infradead.org/mtd-utils.git)

-----

I manually downloaded "git2_git.infradead.org.mtd-utils.git.tar.gz" from a web browser and put it in "/ yocto-build / downloads", but the fetch error is not resolved.
Is there a solution?