• State
  • Locked Locked
  • Replies 5 replies
  • Subscribers 98 subscribers
  • Views 314 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM4376: Very slow git speed again

Jonathan K
Prodigy 30 points
Part Number: AM4376

Tool/software:

Hi,

Lately we have seen the same issue as in these old cases again, the download speed from the TI git is very slow. Sometimes it fails completely.

Our Yocto builds have turned very slow and sometimes fail completely, with everything else except TI fast as normal.

When doing the command:

time git clone git://git.ti.com/ti-linux-kernel/ti-linux-kernel.git

It remains on "remote: Counting objects" for a very long time. The total download speed of my computer then is:

Our automated tests get stuck at downloading from TI, even when I updated the downloads and sstate-cache they use today.

It usually looks like this for a long time:

Bitbake still alive (no events for 600s). Active tasks:
/builds/my/as/servo/emot-ecu-os/build/../layers/meta-ti/meta-ti-bsp/recipes-bsp/cm3-pm-firmware/amx3-cm3_git.bb:do_fetch
/builds/my/as/servo/emot-ecu-os/build/../layers/meta-ti/meta-ti-bsp/recipes-kernel/linux/linux-ti-staging-rt_5.10.bb:do_fetch

The git.ti.com website is also slow when browsing, and sometimes I see the same "Proxy error" as shown in one of the other cases.

Hope this can be solved again, this is very frustrating.

  • 0
    TI__Guru 69632 points

    Hi Jonathan,

    I'm not aware of any current issues but I'm checking with the team to see and report back here. Sometimes this can be caused by heavy server load, and sometimes by DoS-type attacks. Most of these events should be temporary of nature but it seems like for you the speed has dropped considerably, consistently?

    Regards, Andreas

  • 0 in reply to Andreas Dannenberg
    Prodigy 30 points

    Hi Andreas,

    Yes, we noticed the speed drop a couple of weeks ago. Don't know when it started, since we did not run those jobs for a while.

    Best regards,

    Jonathan

  • 0 in reply to Andreas Dannenberg
    Prodigy 30 points

    Now the entire TI git seems to be offline:

    And when attempting to clone for test:

    $ git clone git://git.ti.com/ti-linux-kernel/ti-linux-kernel.git
Cloning into 'ti-linux-kernel'...
fatal: unable to connect to git.ti.com:
git.ti.com[0: 198.47.28.208]: errno=Connection refused

  • 0 in reply to Jonathan K
    TI__Guru 69632 points

    Hi Jonathan,

    you should be using the "HTTPS Transport" for Git, not the older "GIT Transport". All our current Yocto recipes have been upgraded to use those (SDK v10.x onwards). Many servers have stopped supporting the "GIT Transport", including the TI Git server, due to security and other shortcomings of this protocol.

    Like this....

    a0797059@jiji:~/tmp
$ time git clone https://git.ti.com/git/ti-linux-kernel/ti-linux-kernel.git
Cloning into 'ti-linux-kernel'...
remote: Enumerating objects: 14846862, done.
remote: Counting objects: 100% (14846862/14846862), done.
remote: Compressing objects: 100% (1955674/1955674), done.
Receiving objects: 100% (14846862/14846862), 3.26 GiB | 50.82 MiB/s, done.
remote: Total 14846862 (delta 12834006), reused 14837613 (delta 12825055), pack-reused 0
Resolving deltas: 100% (12834006/12834006), done.
Updating files: 100% (87910/87910), done.

real    11m37.891s
user    10m57.623s
sys     0m44.127s
a0797059@jiji:~/tmp
$ du -h -d1 ti-linux-kernel/
8.5M    ti-linux-kernel/lib
200K    ti-linux-kernel/init
80K     ti-linux-kernel/certs
3.8M    ti-linux-kernel/crypto
280K    ti-linux-kernel/ipc
52M     ti-linux-kernel/sound
1.1G    ti-linux-kernel/drivers
1.9M    ti-linux-kernel/samples
38M     ti-linux-kernel/net
292K    ti-linux-kernel/LICENSES
4.6M    ti-linux-kernel/scripts
3.8M    ti-linux-kernel/security
80K     ti-linux-kernel/usr
1.2M    ti-linux-kernel/rust
2.1M    ti-linux-kernel/block
157M    ti-linux-kernel/arch
724K    ti-linux-kernel/io_uring
324K    ti-linux-kernel/virt
51M     ti-linux-kernel/fs
3.8G    ti-linux-kernel/.git
75M     ti-linux-kernel/Documentation
5.8M    ti-linux-kernel/mm
87M     ti-linux-kernel/tools
15M     ti-linux-kernel/kernel
57M     ti-linux-kernel/include
5.4G    ti-linux-kernel/

    If you have an older build / Yocto base you can upgrade the recipes. There's a couple of E2E posts on this topic.

    Regards, Andreas

  • 0 in reply to Andreas Dannenberg
    Prodigy 30 points

    Hi Andreas,

    Our recipes have been using https from the start. The git one was just me testing download speed. Since you post the git link in the TI cgit web interface I assumed it worked.

    Something has changed since yesterday. The TI git web interface is snappy, and the Yocto fetch is much faster. The entire job is about 2 hours faster, no longer waiting for the kernel to download for hours.

    Perhaps your IT fixed something yesterday when the entire git web interface became unresponsive.

    Hope this continues to work!

    Best regards,

    Jonathan