PROCESSOR-SDK-J7200: yocto-build - different amount of Tasks for same image

Ovidiu Briscan

Hi Ti ,

I am trying to compile the SDK ti-processor-sdk-linux-j7200-evm-07_01_01_04-Linux-x86-Install.bin according to the steps specified in the docs.

The command I am issuing is :

> TOOLCHAIN_BASE=/home/ubuntu/toolchain MACHINE=j7-evm bitbake -k tisdk-tiny-image

The same command I am issuing on a virtualbox Ubuntu 18.04 and on a native Ubuntu 18.04, one difference that i could see is the file system on the virtual box is ext4 and on the native Ubuntu is ext3, don't know if this has any influence but the scenario I am experiencing is:

On the VirtualBox Ubuntu the # of Tasks is 3273 while on the native Ubuntu the # of Tasks 3119 (please see below attachment)

SDK_J7200_VirtualBox SDK_J7200_Native

What I would like to understand is why is this difference for the same image, same toolchain, same OS more or less.

Is there a command for the bitbake to list all the tasks from all the recipes so I can compare if something is missing on the Ubuntu native sdk compilation ?

Please let me know what is the additional info I can attach.

Many thanks in advance,

Ovidiu

over 5 years ago

0 Karthik Ramanan over 5 years ago

TI__Guru** 113810 points

Hi Ovidiu,

I haven't done this type of analysis.

But this can be achieved by looking at the buildstats and writing some scripts to figure out recipes (which are directories) and tasks that are files inside those directories.

The buildstats will be under "arago-tmp-external-arm-glibc/buildstats" look for the correct timestamp.

Regards

Karthik

0 Ovidiu Briscan over 5 years ago

Prodigy 10 points

Ok, I will try to have a look at the stats, but have you seen this before is it an expected behavior ?

0 Ovidiu Briscan over 5 years ago in reply to Karthik Ramanan

Prodigy 10 points

Hi TI team, i finally finished the SDK build on the virtual machine, here are the findings by comparing the buildstats contents, see attached the packages on one side and on the other

Here are the additional packages:

> bmap-tools-native-3.5+gitAUTOINC+db7087b883-r0
> btrfs-tools-native-5.4.1-r0
> cdrtools-native-3.01-r0
> dosfstools-native-4.1-r0
> gptfdisk-native-1.0.4-r0
> groff-native-1.22.4-r1
> lz4-native-1_1.9.2-r0
> mtools-native-4.0.23-r0
> nasm-native-2.15.03-r0
> parted-native-3.3-r0
> python3-six-native-1.14.0-r0
> squashfs-tools-native-4.4-r0

>syslinux-native-6.04-pre2-r1
> tisdk-uenv-1.0-r3

Also on the native Ubuntu , i see that the packages are with an older version.

Again i mention that i did not do anything different in the command line in neither of the PCs.

I am trying to understand why is this difference between the 2 SDK compilations. Thanks

Fullscreen SDK_J7200_native_Ubuntu18_04.txt Download

.
acl-2.2.53-r0
acl-native-2.2.53-r0
attr-2.4.48-r0
attr-native-2.4.48-r0
autoconf-archive-2019.01.06-r0
autoconf-archive-native-2019.01.06-r0
autoconf-native-2.69-r11
automake-native-1.16.1-r0
base-files-3.0.14-r89.arago4
base-passwd-3.5.29-r0
bash-5.0-r0.arago0
bash-completion-2.10-r0
bc-native-1.07.1-r0
binutils-native-2.34-r0
bison-native-3.5.3-r0
bjam-native-1.72.0-r0
boost-1.72.0-r0
bridge-utils-1.6-r0
btrfs-tools-5.4.1-r0
busybox-1.31.1-r0.arago21
bzip2-1.0.8-r0
bzip2-native-1.0.8-r0
ca-certificates-20190110-r0
cadence-mhdp-fw-1.2.17-r0
cmake-native-3.16.5-r0
compose-file-3.0+gitAUTOINC+a3e58764f5-r0
containerd-opencontainers-v1.2.7+gitAUTOINC+fd103cb716-r0
coreutils-8.31-r0
cpio-native-2.13-r0
cracklib-2.9.5-r0
cracklib-native-2.9.5-r0
cross-localedef-native-2.31+gitAUTOINC+6fdf971c9d_cd9f958c4c-r0
cryptodev-linux-1.10-r0
cryptodev-module-1.10-r0.arago0
curl-native-7.69.1-r0
db-native-1_5.3.28-r1
dbus-1.12.16-r0.arago1
dbus-native-1.12.16-r0.arago1
debianutils-native-4.9.1-r0
depmodwrapper-cross-1.0-r0
docker-ce-19.03.8-ce+gitafacb8b7f0d8d4f9d2a8e8736e9c993e672b41f3-r0.arago0
dtc-native-1.6.0-r0
dwarfsrcfiles-native-1.0-r0
e2fsprogs-1.45.4-r0
e2fsprogs-native-1.45.4-r0
elfutils-native-0.178-r0
expat-2.2.9-r0
expat-native-2.2.9-r0
external-arm-toolchain-2019.12-r0
file-native-5.38-r0
findutils-4.7.0-r0
flex-2.6.4-r0
flex-native-2.6.4-r0
gawk-5.0.1-r0
gdbm-1.18.1-r0
gdbm-native-1.18.1-r0
gettext-minimal-native-0.20.1-r0
gettext-native-0.20.1-r0
glib-2.0-native-1_2.62.6-r0
gmp-6.2.0-r0
gnu-config-native-20200117+gitAUTOINC+5256817ace-r0
go-capability-0.0+gitAUTOINC+2c00daeb6c-r0
go-cli-1.1.0+gitAUTOINC+27ecc97192-r0
go-connections-0.2.1+gitAUTOINC+4ccf312bf1-r0
go-context-git-r0
go-cross-aarch64-1.14.7-r0
go-dbus-4.0.0+gitAUTOINC+5f6efc7ef2-r0
go-distribution-2.6.0+gitAUTOINC+28602af35a-r0
go-fsnotify-1.2.11+gitAUTOINC+836bfd95fe-r0
go-logrus-0.11.0+gitAUTOINC+d264929707-r0
go-mux-git-r0
go-native-1.14.7-r0
go-patricia-2.2.6+gitAUTOINC+666120de43-r0
go-pty-git-r0
go-runtime-1.14.7-r0
go-systemd-4+gitAUTOINC+b4a58d9518-r0
gperf-native-3.1-r0
grpc-go-1.4.0+gitAUTOINC+777daa17ff-r0
gtk-doc-native-1.32-r0
icu-66.1-r0
icu-native-66.1-r0
init-ifupdown-1.0-r7.arago1
initscripts-1.0-r155
intltool-native-0.51.0-r0
iptables-1.8.4-r0
kbd-2.2.0-r0
kern-tools-native-0.2+gitAUTOINC+c66833e1ca-r12
kmod-26-r0
kmod-native-26-r0
ldconfig-native-2.12.1-r2
libaio-0.3.111-r0
libarchive-native-3.4.2-r0
libcap-2.32-r0
libcap-ng-0.7.10-r0
libcap-ng-native-0.7.10-r0
libffi-3.3-r0
libffi-native-3.3-r0
libnsl2-1.2.0+gitAUTOINC+4a062cf418-r0
libnsl2-native-1.2.0+gitAUTOINC+4a062cf418-r0
libpam-1.3.1-r0
libpcre2-native-10.34-r0
libpcre-native-8.44-r0
libsolv-native-0.7.10-r0
libtirpc-1.2.6-r0
libtirpc-native-1.2.6-r0
libtool-2.4.6-r0
libtool-cross-2.4.6-r0
libtool-native-2.4.6-r0
libxml2-native-2.9.10-r0
libxml-parser-perl-native-2.46-r0
linux-ti-staging-5.4.74+gitAUTOINC+9574bba32a-r0a.arago5_psdkla
lvm2-2.03.06-r0
lzo-2.10-r0
lzo-native-2.10-r0
lzop-native-1.04-r0
m4-1.4.18-r0
m4-native-1.4.18-r0
makedevs-native-1.0.1-r0
make-mod-scripts-1.0-r0
meson-native-0.53.2-r0
mklibs-native-0.1.44-r0
modutils-initscripts-1.0-r7
ncurses-6.2-r0
ncurses-native-6.2-r0
netbase-2_6.1-r0
ninja-native-1.10.0-r0
notary-0.6.1+gitAUTOINC+d6e1431feb-r0
openssl-1.1.1g-r0
openssl-native-1.1.1g-r0
opkg-native-1_0.4.2-r0
opkg-utils-0.4.2-r0
opkg-utils-native-0.4.2-r0
optee-os-3.8.0+gitAUTOINC+199fca17b5-r0.arago0
os-release-1.0-r0
packagegroup-arago-sysvinit-boot-1.0-r0
patch-native-2.7.6-r0
perl-native-5.30.1-r0
pigz-native-2.4-r0
pkgconfig-native-0.29.2+gitAUTOINC+edf8e6f0ea-r0
popt-native-1.16-r3
prelink-native-1.0+gitAUTOINC+f9975537db-r0
pseudo-native-1.9.0+gitAUTOINC+060058bb29-r0
python3-3.8.2-r0
python3-native-3.8.2-r0
python3-pycryptodome-native-3.9.7-r0
python3-pycryptodomex-native-3.9.7-r0
python3-pyelftools-native-0.26-r0
python3-setuptools-native-45.2.0-r0
qemu-native-4.2.0-r0
qemuwrapper-cross-1.0-r0
quilt-native-0.66-r0
re2c-native-1.0.1-r0
readline-8.0-r0
readline-native-8.0-r0
rpm-native-1_4.14.2.1-r0
rsync-native-3.1.3-r0
runc-docker-1.0.0-rc8+gitAUTOINC+425e105d5a-r0
run-postinsts-1.0-r10
shadow-4.8.1-r0
shadow-native-4.8.1-r0
shadow-securetty-4.6-r3.arago0
shadow-sysroot-4.6-r3
sqlite3-3_3.31.1-r0
sqlite3-native-3_3.31.1-r0
swig-native-3.0.12-r0
sysfsutils-2.1.0-r5
systemd-1_244.3-r0.arago6
systemd-compat-units-1.0-r29
systemd-conf-244.3-r0
systemd-serialgetty-1.0-r5
systemd-systemctl-native-1.0-r6
sysvinit-2.96-r0.arago1
sysvinit-inittab-2.88dsf-r10
texinfo-dummy-native-1.0-r0
thin-provisioning-tools-0.8.5-r0_psdkla
tini-0.18.0-r0
ti-rtos-firmware-07.01.00.38-r0
ti-sci-fw-2020.08b-r1_psdkla
tisdk-tiny-image-1.0-r0
trusted-firmware-a-2.3-r0
u-boot-ti-staging-1_2020.01+gitAUTOINC+3c9ebdb87d-r22_psdkla
u-boot-tools-native-1_2020.01-r0
unzip-native-1_6.0-r5
update-rc.d-0.8-r0
update-rc.d-native-0.8-r0
util-linux-2.35.1-r0
util-linux-native-2.35.1-r0
volatile-binds-1.0-r0
xz-5.2.4-r0
xz-native-5.2.4-r0
zlib-1.2.11-r0
zlib-native-1.2.11-r0

Fullscreen SDK_J7200_VBOX_Ubuntu18_04.txt Download

.
acl-2.2.53-r0
acl-native-2.2.53-r0
attr-2.4.48-r0
attr-native-2.4.48-r0
autoconf-archive-2019.01.06-r0
autoconf-archive-native-2019.01.06-r0
autoconf-native-2.69-r11
automake-native-1.16.1-r0
base-files-3.0.14-r89.arago4
base-passwd-3.5.29-r0
bash-5.0-r0.arago0
bash-completion-2.10-r0
bc-native-1.07.1-r0
binutils-native-2.34-r0
bison-native-3.5.4-r0
bjam-native-1.72.0-r0
bmap-tools-native-3.5+gitAUTOINC+db7087b883-r0
boost-1.72.0-r0
bridge-utils-1.6-r0
btrfs-tools-5.4.1-r0
btrfs-tools-native-5.4.1-r0
busybox-1.31.1-r0.arago21
bzip2-1.0.8-r0
bzip2-native-1.0.8-r0
ca-certificates-20210119-r0
cadence-mhdp-fw-1.2.17-r0
cdrtools-native-3.01-r0
cmake-native-3.16.5-r0
compose-file-3.0+gitAUTOINC+a3e58764f5-r0
containerd-opencontainers-v1.2.7+gitAUTOINC+fd103cb716-r0
coreutils-8.31-r0
cpio-native-2.13-r0
cracklib-2.9.5-r0
cracklib-native-2.9.5-r0
cross-localedef-native-2.31+gitAUTOINC+f84949f1c4_cd9f958c4c-r0
cryptodev-linux-1.10-r0
cryptodev-module-1.10-r0.arago0
curl-native-7.69.1-r0
db-native-1_5.3.28-r1
dbus-1.12.16-r0.arago1
dbus-native-1.12.16-r0.arago1
debianutils-native-4.9.1-r0
depmodwrapper-cross-1.0-r0
docker-ce-19.03.8-ce+gitafacb8b7f0d8d4f9d2a8e8736e9c993e672b41f3-r0.arago0
dosfstools-native-4.1-r0
dtc-native-1.6.0-r0
dwarfsrcfiles-native-1.0-r0
e2fsprogs-1.45.4-r0
e2fsprogs-native-1.45.4-r0
elfutils-native-0.178-r0
expat-2.2.9-r0
expat-native-2.2.9-r0
external-arm-toolchain-2019.12-r0
file-native-5.38-r0
findutils-4.7.0-r0
flex-2.6.4-r0
flex-native-2.6.4-r0
gawk-5.0.1-r0
gdbm-1.18.1-r0
gdbm-native-1.18.1-r0
gettext-minimal-native-0.20.1-r0
gettext-native-0.20.1-r0
glib-2.0-native-1_2.62.6-r0
gmp-6.2.0-r0
gnu-config-native-20200117+gitAUTOINC+5256817ace-r0
go-capability-0.0+gitAUTOINC+2c00daeb6c-r0
go-cli-1.1.0+gitAUTOINC+27ecc97192-r0
go-connections-0.2.1+gitAUTOINC+4ccf312bf1-r0
go-context-git-r0
go-cross-aarch64-1.14.15-r0
go-dbus-4.0.0+gitAUTOINC+5f6efc7ef2-r0
go-distribution-2.6.0+gitAUTOINC+28602af35a-r0
go-fsnotify-1.2.11+gitAUTOINC+836bfd95fe-r0
go-logrus-0.11.0+gitAUTOINC+d264929707-r0
go-mux-git-r0
go-native-1.14.15-r0
go-patricia-2.2.6+gitAUTOINC+666120de43-r0
go-pty-git-r0
go-runtime-1.14.15-r0
go-systemd-4+gitAUTOINC+b4a58d9518-r0
gperf-native-3.1-r0
gptfdisk-native-1.0.4-r0
groff-native-1.22.4-r1
grpc-go-1.4.0+gitAUTOINC+777daa17ff-r0
gtk-doc-native-1.32-r0
icu-66.1-r0
icu-native-66.1-r0
init-ifupdown-1.0-r7.arago1
initscripts-1.0-r155
intltool-native-0.51.0-r0
iptables-1.8.4-r0
kbd-2.2.0-r0
kern-tools-native-0.2+gitAUTOINC+c66833e1ca-r12
kmod-26-r0
kmod-native-26-r0
ldconfig-native-2.12.1-r2
libaio-0.3.111-r0
libarchive-native-3.4.2-r0
libcap-2.32-r0
libcap-ng-0.7.10-r0
libcap-ng-native-0.7.10-r0
libffi-3.3-r0
libffi-native-3.3-r0
libnsl2-1.2.0+gitAUTOINC+4a062cf418-r0
libnsl2-native-1.2.0+gitAUTOINC+4a062cf418-r0
libpam-1.3.1-r0
libpcre2-native-10.34-r0
libpcre-native-8.44-r0
libsolv-native-0.7.10-r0
libtirpc-1.2.6-r0
libtirpc-native-1.2.6-r0
libtool-2.4.6-r0
libtool-cross-2.4.6-r0
libtool-native-2.4.6-r0
libxml2-native-2.9.10-r0
libxml-parser-perl-native-2.46-r0
linux-ti-staging-5.4.106+gitAUTOINC+023faefa70-r0a.arago5_psdkla_8
lvm2-2.03.06-r0
lz4-native-1_1.9.2-r0
lzo-2.10-r0
lzo-native-2.10-r0
lzop-native-1.04-r0
m4-1.4.18-r0
m4-native-1.4.18-r0
makedevs-native-1.0.1-r0
make-mod-scripts-1.0-r0
meson-native-0.53.2-r0
mklibs-native-0.1.44-r0
modutils-initscripts-1.0-r7
mtools-native-4.0.23-r0
nasm-native-2.15.03-r0
ncurses-6.2-r0
ncurses-native-6.2-r0
netbase-2_6.1-r0
ninja-native-1.10.0-r0
notary-0.6.1+gitAUTOINC+d6e1431feb-r0
openssl-1.1.1j-r0
openssl-native-1.1.1j-r0
opkg-native-1_0.4.2-r0
opkg-utils-0.4.2-r0
opkg-utils-native-0.4.2-r0
optee-os-3.11.0+gitAUTOINC+c4def2a826-r0
os-release-1.0-r0
packagegroup-arago-sysvinit-boot-1.0-r0
parted-native-3.3-r0
patch-native-2.7.6-r0
perl-native-5.30.1-r0
pigz-native-2.4-r0
pkgconfig-native-0.29.2+gitAUTOINC+edf8e6f0ea-r0
popt-native-1.16-r3
prelink-native-1.0+gitAUTOINC+f9975537db-r0
pseudo-native-1.9.0+gitAUTOINC+60e25a3655-r0
python3-3.8.2-r0
python3-native-3.8.2-r0
python3-pycryptodome-native-3.9.7-r0
python3-pycryptodomex-native-3.9.7-r0
python3-pyelftools-native-0.26-r0
python3-setuptools-native-45.2.0-r0
python3-six-native-1.14.0-r0
qemu-native-4.2.0-r0
qemuwrapper-cross-1.0-r0
quilt-native-0.66-r0
re2c-native-1.0.1-r0
readline-8.0-r0
readline-native-8.0-r0
rpm-native-1_4.14.2.1-r0
rsync-native-3.1.3-r0
runc-docker-1.0.0-rc8+gitAUTOINC+425e105d5a-r0
run-postinsts-1.0-r10
shadow-4.8.1-r0
shadow-native-4.8.1-r0
shadow-securetty-4.6-r3.arago0
shadow-sysroot-4.6-r3
sqlite3-3_3.31.1-r0
sqlite3-native-3_3.31.1-r0
squashfs-tools-native-4.4-r0
swig-native-3.0.12-r0
sysfsutils-2.1.0-r5
syslinux-native-6.04-pre2-r1
systemd-1_244.5-r0.arago6
systemd-compat-units-1.0-r29
systemd-conf-244.3-r0
systemd-serialgetty-1.0-r5
systemd-systemctl-native-1.0-r6
sysvinit-2.96-r0.arago1
sysvinit-inittab-2.88dsf-r10
texinfo-dummy-native-1.0-r0
thin-provisioning-tools-0.8.5-r0_psdkla
tini-0.18.0-r0
ti-rtos-firmware-07.03.00.29-r0
ti-sci-fw-2021.01a-r1_psdkla_2
tisdk-tiny-image-1.0-r0
tisdk-uenv-1.0-r3
trusted-firmware-a-2.4-r0
u-boot-ti-staging-1_2020.01+gitAUTOINC+2781231a33-r36_psdkla_1
u-boot-tools-native-1_2020.01-r0
unzip-native-1_6.0-r5
update-rc.d-0.8-r0
update-rc.d-native-0.8-r0
util-linux-2.35.1-r0
util-linux-native-2.35.1-r0
volatile-binds-1.0-r0
xz-5.2.4-r0
xz-native-5.2.4-r0
zlib-1.2.11-r0
zlib-native-1.2.11-r0

0 Karthik Ramanan over 5 years ago in reply to Ovidiu Briscan

TI__Guru** 113810 points

Hi Ovidiu,

Thanks for the details.

-1-

Now, between the Native Ubuntu and the VM Ubuntu, I suspect that the difference could be coming from the host packages differences between the two. There is a chance that there are different packages installed between the two PCs and the VM could be more "vanilla" because you can reinstall a fresh ISO file and that might be causing some difference - this is just a guess and can be verified easily by inspecting the debian packages already installed between the two and going further.

-2-

But more fundamentally, is this is causing any issues/differences in the final images that need to be used on the target?

We haven't done this type of investigation but nonetheless this is an interesting exercise to learn more about this. Please give me your feedback on -1- and -2- and we can decide the next steps on how to take this forward.

Regards

Karthik

0 Ovidiu Briscan over 5 years ago in reply to Karthik Ramanan

Prodigy 10 points

Hi, thanks for supporting me, the story goes like: on my work laptop i installed an virtual box Ubuntu 18.04 due to various problems (relative path in the bitbake command, swap issues, ram allocation issues, inodes max users issues) on my personal laptop i have installed a native Ubuntu 18.04 , at the end i made it work on my work laptop virtual box, so this is not a stopping topic for me righ now. But back when working with the native Ubuntu my fear was due to the fact that number of task in the bitbake are less that the final image will not be the same.

So to answer you the 2nd question, any diffs in the final image, i don't really know as i did not do any comparison btw the 2 binaries/deploy folders.

As for the 1st question, it may be there is a slight diff btw the 2 distro but as they are both 18.04 i expect to be very similar.

Q: When launching bitbake do you know if there is any check on the host kernel and based on that some newer versions or older ones are downloaded/installed ?

Thanks,

Ovidiu

+1 Karthik Ramanan over 5 years ago in reply to Ovidiu Briscan

TI__Guru** 113810 points

Ok Ovidiu,

Ovidiu Briscan said:
Here are the additional packages:

> bmap-tools-native-3.5+gitAUTOINC+db7087b883-r0
> btrfs-tools-native-5.4.1-r0
> cdrtools-native-3.01-r0
> dosfstools-native-4.1-r0
> gptfdisk-native-1.0.4-r0
> groff-native-1.22.4-r1
> lz4-native-1_1.9.2-r0
> mtools-native-4.0.23-r0
> nasm-native-2.15.03-r0
> parted-native-3.3-r0
> python3-six-native-1.14.0-r0
> squashfs-tools-native-4.4-r0

Lets take a look at the diff of the tasks that you highlighted, all of them are related to native components, so they are not going to affect the final image that is built for the target, it is coming from differences in the host environment which is what you explained.

Hope that answers your question.

Regards

Karthik

0 Ovidiu Briscan over 5 years ago in reply to Karthik Ramanan

Prodigy 10 points

Understood, thanks a lot.

Processors

Processors forum

PROCESSOR-SDK-J7200: yocto-build - different amount of Tasks for same image