AM3874 - Linux 2.6.37 kernel hangs during boot process

Anatoly Goldstein

Intellectual 530 points

Other Parts Discussed in Thread: AM3874, CCSTUDIO

Hi, all.

I'm trying to start Linux on custom board based on AM3874 processor.

I'm using Linux kernel 2.6.37 provided by TI in EZSDK v05.04.00.11.

Kernel image is loaded over TFTP. The only output that I get is

Starting kernel ...

Uncompressing Linux... done, booting the kernel.

After adding a bunch of printouts I found that it hangs in arch/arm/kernel/traps.c in function static void __init kuser_get_tls_init(unsigned long vectors) while calling to memcpy((void *)vectors + 0xfe0, (void *)vectors + 0xfe8, 4);

Actually any access to (void *)vectors + 0xfe8 (even pointer de-referencing) causes the same problem.

If I disable this call, the kernel continue booting till it gets to some problem with root fs.

Does anybody know what may be a reason that kernel hangs on memcpy?

over 10 years ago

0 Biser Gatchev-XID over 10 years ago

TI__Guru**** 393215 points

Moving this to the AM387X forum.

0 Pavel Botev over 10 years ago

TI__Guru**** 170625 points

Hi Anatoly,

Please refer to the below wiki page:

processors.wiki.ti.com/.../Kernel_-_Common_Problems_Booting_Linux

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Hello, Pavel.

Thanks for a quick reply.

I saw this wiki page. Problem #2 looks similar to my case but its not the same.

I already overcame causes #1 and #2. Cause #3 doesn't look to be a correct direction as I only updated ti814Xevm pinmux to match our PCB.

My current guess is that this problem relates to incorrect DDR leveling. If this will be the case I'll close this thread.

Do you know what will be the consequences of bypassing kuser_get_tls_init() function that does processor specific fixups for the kuser helpers?

Thanks

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

See also the below e2e thread:

e2e.ti.com/.../1228438

Anatoly Goldstein said:
My current guess is that this problem relates to incorrect DDR leveling. If this will be the case I'll close this thread.

At what frequency you are running DDR3? Can you try with lower frequency possible? At what OPP you are running the kernel? If you set OPP166 but do not set the voltage to 1.35V, the linux kernel will hang.

Anatoly Goldstein said:
Do you know what will be the consequences of bypassing kuser_get_tls_init() function that does processor specific fixups for the kuser helpers?

I am not aware. I will try this on my side (DM814x/AM387x EVM) to see if removing this function will cause some drawback.

Regards,
Pavel

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

Anatoly Goldstein said:
Do you know what will be the consequences of bypassing kuser_get_tls_init() function that does processor specific fixups for the kuser helpers?

I remove this function like below:

linux-kernel/arch/arm/kernel/traps.c

void __init early_trap_init(void)
{

..........

/*
   * Do processor specific fixups for the kuser helpers
   */
   //kuser_get_tls_init(vectors);
........

}

But when I try to boot this kernel, I have problem to mount the rootfs (I am using network nfs):

VFS: Mounted root (nfs filesystem) on device 0:15.
devtmpfs: mounted
Freeing init memory: 232K
Kernel panic - not syncing: Attempted to kill init!
Backtrace:
[<c0050bf4>] (dump_backtrace+0x0/0x110) from [<c03ea444>] (dump_stack+0x18/0x1c)
r7:d6438000 r6:d6438000 r5:d643bee0 r4:c058c190
[<c03ea42c>] (dump_stack+0x0/0x1c) from [<c03ea4a8>] (panic+0x60/0x17c)
[<c03ea448>] (panic+0x0/0x17c) from [<c007ac3c>] (do_exit+0x74/0x5e4)
r3:c055bd94 r2:d643be38 r1:d64380fc r0:c04c4eda
[<c007abc8>] (do_exit+0x0/0x5e4) from [<c007b230>] (do_group_exit+0x84/0xb4)
[<c007b1ac>] (do_group_exit+0x0/0xb4) from [<c00862c4>] (get_signal_to_deliver+0x2d4/0x304)
r5:d643bee0 r4:0000000b
[<c0085ff0>] (get_signal_to_deliver+0x0/0x304) from [<c004fa78>] (do_notify_resume+0x7c/0x654)
[<c004f9fc>] (do_notify_resume+0x0/0x654) from [<c004ce58>] (work_pending+0x24/0x28)

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Thanks, Pavel.

So its not possible just skip this function.

Answering your previous questions currently we are running DDR3 on frequency 400MHz. I tried it on 300MHz but it din't help. On 200MHz the board is not working at all.
The voltage is set to 1.1V. In u-boot the frequency is set to 600MHz so its OPP100. Is there another place where OPP is configured?

Another thing that I thought about is that we have DDR3 of 512MB, the problematic memcpy hangs while trying to copy data from address 0xFFFF0FE8 (memcpy((void *)vectors + 0xfe0, (void *)vectors + 0xfe8, 4); ) , this address is actually outside of DDR3. So maybe its MMU related issue?
On the other hand CONFIG_MMU option is on and other memcpy commands in early_trap_init() functions seem to work fine.

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

Can you provide me these two things:

1. Your linux kernel (uImage), I want to test on my side

2. Full console output when booting the board, from the very beginning, not only the last two lines

Anatoly Goldstein said:
I tried it on 300MHz but it din't help.

Then this should not be SW leveling issue. Have you tried DDR3 tests to verify the hardware design? We have u-boot mtest and CCStudio based DDR3 hardware diagnostic tests.

Regards,
Pavel

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly Goldstein said:
Another thing that I thought about is that we have DDR3 of 512MB, the problematic memcpy hangs while trying to copy data from address 0xFFFF0FE8 (memcpy((void *)vectors + 0xfe0, (void *)vectors + 0xfe8, 4); ) , this address is actually outside of DDR3. So maybe its MMU related issue?

May be this address 0xFFFF0FE8 is virtual, and the actual physical address is within the DDR3 512MB memory map. See also the below wiki for configuring 512MB map:

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Hi, Pavel.

The system doesn't allow me to attach uImage here, so I put it on my GoogleDrive
.

I also attach two files with console output, first one for the case when system hangs and the second one for the case when I disabled problematic function call.

Fullscreen kernel_boot_hang.txt Download

U-Boot SPL 2014.10 (Apr 07 2015 - 13:55:21)


U-Boot 2014.10 (Apr 07 2015 - 13:55:21)

DRAM:  512 MiB
NAND:  64 MiB
MMC:   OMAP SD/MMC: 0
Net:   cpsw
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot# run netboot
Booting from network ...
link up on port 0, speed 100, full duplex
BOOTP broadcast 1
*** Unhandled DHCP Option in OFFER/ACK: 26
*** Unhandled DHCP Option in OFFER/ACK: 26
DHCP client bound to address 192.168.1.33 (27 ms)
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 192.168.1.143; our IP address is 192.168.1.33
Filename 'uEnv.txt'.
Load address: 0x80200000
Loading: *
TFTP error: 'File not found' (1)
Not retrying...
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 192.168.1.143; our IP address is 192.168.1.33
Filename 'zImage'.
Load address: 0x80200000
Loading: #################################################################
         #################################################################
         #################################################################
         #############################################################
         1.6 MiB/s
done
Bytes transferred = 1309052 (13f97c hex)
Kernel image @ 0x80200000 [ 0x000000 - 0x13f97c ]

Starting kernel ...

Uncompressing Linux... done, booting the kernel.

Fullscreen kernel_boot.txt Download

U-Boot SPL 2014.10 (Apr 07 2015 - 13:55:21)


U-Boot 2014.10 (Apr 07 2015 - 13:55:21)

DRAM:  512 MiB
NAND:  64 MiB
MMC:   OMAP SD/MMC: 0
Net:   cpsw
U-Boot#
U-Boot#
U-Boot#
U-Boot#
U-Boot# run netboot
Booting from network ...
link up on port 0, speed 100, full duplex
BOOTP broadcast 1
*** Unhandled DHCP Option in OFFER/ACK: 26
*** Unhandled DHCP Option in OFFER/ACK: 26
DHCP client bound to address 192.168.1.33 (27 ms)
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 192.168.1.143; our IP address is 192.168.1.33
Filename 'uEnv.txt'.
Load address: 0x80200000
Loading: *
TFTP error: 'File not found' (1)
Not retrying...
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 192.168.1.143; our IP address is 192.168.1.33
Filename 'zImage'.
Load address: 0x80200000
Loading: #################################################################
         #################################################################
         #################################################################
         #############################################################
         1.7 MiB/s
done
Bytes transferred = 1309052 (13f97c hex)
Kernel image @ 0x80200000 [ 0x000000 - 0x13f97c ]

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Linux version 2.6.37 (anatoly@anatoly-ThinkPad-Edge-E440) (gcc version 4.5.1 (Sourcery G++ Lite 2010.09-50) ) #4 Wed Apr 8 10:12:06 EEST 2015
CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c53c7f
CPU: VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine: PowerBeacon-AM3874
reserved size = 0 at 0x0
Memory policy: ECC disabled, Data cache writeback
OMAP chip is TI8148 2.0
SRAM: Mapped pa 0x402f1000 to va 0xfe400000 size: 0xf000
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 130048
Kernel command line: console=ttyO0,115200n8 root=/dev/nfs nfsroot=192.168.1.143:, rw ip=dhcp
PID hash table entries: 2048 (order: 1, 8192 bytes)
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Memory: 512MB = 512MB total
Memory: 516816k/516816k available, 7472k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xe0800000 - 0xf8000000   ( 376 MB)
    lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
    pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    modules : 0xbf000000 - 0xbfe00000   (  14 MB)
      .init : 0xc0008000 - 0xc002d000   ( 148 kB)
      .text : 0xc002d000 - 0xc0280000   (2380 kB)
      .data : 0xc0280000 - 0xc02ab400   ( 173 kB)
SLUB: Genslabs=11, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS:375
IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
Total of 128 interrupts on 1 active controller
GPMC revision 6.0
Trying to install interrupt handler for IRQ368
Trying to install interrupt handler for IRQ369
Trying to install interrupt handler for IRQ370
Trying to install interrupt handler for IRQ371
Trying to install interrupt handler for IRQ372
Trying to install interrupt handler for IRQ373
Trying to install interrupt handler for IRQ374
Trying to install type control for IRQ375
Trying to set irq flags for IRQ375
OMAP clockevent source: GPTIMER1 at 20000000 Hz
Console: colour dummy device 80x30
Calibrating delay loop... 4797.23 BogoMIPS (lpj=23986176)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
devtmpfs: initialized
omap_voltage_early_init: voltage driver support not added
regulator: core version 0.5
regulator: dummy:
omap_voltage_domain_lookup: Voltage driver init not yet happened.Faulting!
omap_voltage_add_dev: VDD specified does not exist!
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
omap_mux_init: Add partition: #1: core, flags: 4
Debugfs: Only enabling/disabling deep sleep and wakeup timer is supported now
bio: create slab <bio-0> at 0
SCSI subsystem initialized
Switching to clocksource gp timer
NetWinder Floating Point Emulator V0.97 (double precision)
PMU: registered new PMU device of type 0
omap-iommu omap-iommu.0: ducati registered
omap-iommu omap-iommu.1: sys registered
JFFS2 version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
msgmni has been set to 1009
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
omap_uart.0: ttyO0 at MMIO 0x48020000 (irq = 72) is a OMAP UART0
console [ttyO0] enabled
omap_uart.1: ttyO1 at MMIO 0x48022000 (irq = 73) is a OMAP UART1
omap_uart.2: ttyO2 at MMIO 0x48024000 (irq = 74) is a OMAP UART2
omap_uart.3: ttyO3 at MMIO 0x481a6000 (irq = 44) is a OMAP UART3
omap_uart.5: ttyO5 at MMIO 0x481aa000 (irq = 46) is a OMAP UART5
brd: module loaded
loop: module loaded
mice: PS/2 mouse device common for all mice
omap_rtc omap_rtc: rtc core: registered omap_rtc as rtc0
OMAP Watchdog Timer Rev 0x00: initial timeout 60 sec
VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
omap_voltage_late_init: Voltage driver support not added
Power Management for TI81XX.
omap_rtc omap_rtc: setting system clock to 2000-01-01 00:00:00 UTC (946684800)
VFS: Cannot open root device "nfs" or unknown-block(0,255)
Please append a correct "root=" boot option; here are the available partitions:
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,255)
Backtrace:
[<c003af2c>] (dump_backtrace+0x0/0x110) from [<c01d8ac8>] (dump_stack+0x18/0x1c)
 r6:00008000 r5:df811000 r4:c02abad8 r3:60000013
[<c01d8ab0>] (dump_stack+0x0/0x1c) from [<c01d8b28>] (panic+0x5c/0x178)
[<c01d8acc>] (panic+0x0/0x178) from [<c0009144>] (mount_block_root+0x23c/0x28c)
 r3:00000000 r2:00000000 r1:df83bf60 r0:c0242e09
 r7:c002305c
[<c0008f08>] (mount_block_root+0x0/0x28c) from [<c00092cc>] (mount_root+0x50/0x64)
 r8:00000000 r7:00000013 r6:c005f4d4 r5:c0023071 r4:000000ff
[<c000927c>] (mount_root+0x0/0x64) from [<c0009450>] (prepare_namespace+0x170/0x1d0)
 r4:c02ab464 r3:00000000
[<c00092e0>] (prepare_namespace+0x0/0x1d0) from [<c0008d70>] (kernel_init+0x114/0x154)
 r5:c0008c5c r4:c0022634
[<c0008c5c>] (kernel_init+0x0/0x154) from [<c005f4d4>] (do_exit+0x0/0x5bc)
 r4:00000000 r3:00000000

Frankly speaking I didn't do DDR3 SW Leveling as we have only J-Link JTAG emulator that is not supported by CCStudio, currently I'm waiting for appropriate emulator delivery.
I ran mtest and it passed ok except for the very high address range where it hanged, but I guess this is the location of u-boot code, data and other important things.

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

Anatoly Goldstein said:
The system doesn't allow me to attach uImage here, so I put it on my GoogleDrive

You should click on the right down button "Use rich formatting" then you will be able to attach in the e2e forum by drag and drop.

I test your uImage, but I have the below:

Starting kernel ...

Uncompressing Linux... done, booting the kernel.

Error: unrecognized/unsupported machine ID (r1 = 0x00000bbc).

Available machine support:

ID (hex) NAME
0000270f PowerBeacon-AM3874

Please check your kernel config and/or bootloader.

Is it possible to change this kernel for DM814x/AM387x TI EVM (default) and send it again to me?

Anatoly Goldstein said:
I also attach two files with console output, first one for the case when system hangs and the second one for the case when I disabled problematic function call.

In the second case, I suspect your boot args are not correct.Below are mine (for 1GB DDR, you should modify for 512MB DDR):

TI8148_EVM#setenv bootargs 'console=ttyO0,115200n8 root=/dev/nfs nfsroot=172.20.1.195:/home/users/pbotev/targetfs,nolock rw mem=364M@0x80000000 mem=320M@0x9FC00000 vmalloc=500M notifyk.vpssm3_sva=0xBF900000 ip=dhcp noinitrd'

BR
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Oh! Sorry about that. I should remember that I changed platform name.

Any way, I think I found the problem, it looks like I had wrong memory map configurations in u-boot. I followed the example from EZSDK Memory Map wiki that you provided earlier and the board stopped hanging in kuser_get_tls_init() function.
But I still do not fully understand why previous memory map configuration caused problems.
Let me describe it:
We have one DDR3 chip of 512MB
previous definition - one LISA section with DMM_LISA_MAP_3 = 0x80500100 (SYS_ADDR 80h, SYS_SIZE 512MB, no interleaving, map to EMIF0)
new definition - two LISA sections DMM_LISA_MAP_2 = 0x80500100 and DMM_LISA_MAP_3 = 0xA0500100

Why mapping definition of one section is not good?
Why shouldn't it be four sections, something like 0x80500100, 0xA0500100, 0xC0500100 and 0xE0500100?

Thanks,
Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

One LISA map section (on LISA_MAP_3) should be fine also. See the below patch for 1GB single EMIF configuration:

May be the problem is in using u-boot 2014, can you check with the default u-boot 2010.06?

BR
Pavel

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

Anatoly Goldstein said:
I ran mtest and it passed ok except for the very high address range where it hanged, but I guess this is the location of u-boot code, data and other important things.

The location of u-boot and its data is from 0x80000000 to 0x80800000, to avoid over-writing U-Boot when it is executing make sure that an address greater than 0x80800000 is used.

This is what I have in the DM814x/AM387x EVM mtest for the first 512MB DDR3:

TI8148_EVM#mtest 0x80800000 0xA0000000 0xaa55aa55 1
Pattern AA55AA55 Writing... Reading...Tested 1 iteration(s) with 0 errors.
TI8148_EVM#

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Pavel,

it appears to be too complicate to switch from u-boot 2014 to u-boot 2010.06.
I could run u-boot and configured memory mapping with a single section, however it takes to much time to configure ethernet device and nand, so I tried to load kernel image over uart. I also used following bootargs setenv bootargs 'console=ttyO0,115200n8 root=/dev/nfs nfsroot=192.168.1.143:/tftpboot/targetfs, nolock rw mem=179M@0x800000000 ip=dhcp".
As a result I got the following log
## Booting kernel from Legacy Image at 90000000 ...
Image Name: Linux-2.6.37
Image Type: ARM Linux Kernel Image (uncompressed)
Data Size: 2676104 Bytes = 2.6 MiB
Load Address: 80008000
Entry Point: 80008000
Verifying Checksum ... OK
Loading Kernel Image ... OK
OK

Starting kernel ...

Uncompressing Linux... done, booting the kernel.

The interesting thing is that, as I wrote earlier, in u-boot 2014 with single LISA section mtest hangs on very upper addresses, but with two LISA sections the test passed ok on all 512M (0x80000000 - 0xA0000000).

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly Goldstein said:
console=ttyO0

Are you using UART0 for console (same as in the DM814x/AM387x EVM)?

Anatoly Goldstein said:
## Booting kernel from Legacy Image at 90000000 ...

Can you try with loading uImage at 0x80009000? This is what we have in the default MMC/SD boot script:

fatload mmc 0 0x80009000 uImage
bootm 0x80009000

## Booting kernel from Legacy Image at 80009000 ...
   Image Name:   Linux-2.6.37
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    2717500 Bytes = 2.6 MiB
   Load Address: 80008000
   Entry Point: 80008000
   Verifying Checksum ... OK
   Loading Kernel Image ... OK

Anatoly Goldstein said:
The interesting thing is that, as I wrote earlier, in u-boot 2014 with single LISA section mtest hangs on very upper addresses, but with two LISA sections the test passed ok on all 512M (0x80000000 - 0xA0000000).

This looks to be u-boot 2014 specific, so I can not advice. But in EZSDK memory map wiki for 512MB we have two LISA sections used, so this should be fine.

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Pavel,

Yes, I'm using UART0 for console.

I tried to use 0x80009000 for image loading but got the same result. It is probably related to some missing configurations in u-boot 2010, since I made only quick configuration of DDR3.

Since reconfiguration of memory mapping in u-boot 2014 solved initial problem of kernel hanging, I think I'll continue with u-boot 2014 and this solution.

Thank you very much for your help,

Anatoly

0 Anatoly Goldstein over 10 years ago in reply to Anatoly Goldstein

Intellectual 530 points

Hello, Pavel.

Unfortunately I have to continue this thread.

Currently I'm booting Linux with JFFS2 file system.
My current problem is that my system is very unstable. Sometimes it hangs or crashes during kernel boot, sometimes it gets to Linux command line prompt, but shortly after that it crashes.
Since crashes happen in different places I thought that the problems relates to incorrect DDR3 configurations.
So I performed DDR leveling procedure according to processors.wiki.ti.com/.../TI814x-DDR3-Init-U-Boot_Wordwise_SWleveling, but it didn't help. In addition 'mtest' command in u-boot is passing just fine.
As I mentioned earlier I'm using u-boot 2014, so I tried to run u-boot 2010 provided by TI (with updates for my DDR and NAND), but it also didn't make much difference.
I have run out of ideas, can you suggest any additional direction for investigation?

Thanks,
Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly,

Anatoly Goldstein said:
Currently I'm booting Linux with JFFS2 file system.
My current problem is that my system is very unstable. Sometimes it hangs or crashes during kernel boot, sometimes it gets to Linux command line prompt, but shortly after that it crashes.

Anatoly Goldstein said:
As I mentioned earlier I'm using u-boot 2014, so I tried to run u-boot 2010 provided by TI (with updates for my DDR and NAND), but it also didn't make much difference.

This might be related to the linux kernel, not to the u-boot. Are you using BCH8 or 1-bit Hamming? See if the below wiki pages will be in help:

You might need to change the linux kernel source code from the default BCH8 to 1bit Hamming code:

Anatoly Goldstein said:
So I performed DDR leveling procedure according to processors.wiki.ti.com/.../TI814x-DDR3-Init-U-Boot_Wordwise_SWleveling, but it didn't help. In addition 'mtest' command in u-boot is passing just fine.

Try with the byte wise leveling:

You can also try with the HW diagnostic tests for the DDR3 and NAND, available at the Mistral site, to check that everything is fine from the HW side for the DDR3 and NAND.

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Pavel,

Thanks for the links, I already reviewed most of them, but I'll give another look.

I do not think that the problem relates to JFFS2 file system. I'm using 1bit Hamming code, without that kernel would fail on mounting root FS. In addition crashes may happen before mounting file system.

As for byte wise leveling, according to TI's wiki byte wise SW leveling is for 32 bit DDR interface only. We are using 16 bit DDR3.

You can find boot log example in attached file.

Fullscreen kernel2637_booting.txt Download

link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 192.168.1.109; our IP address is 192.168.1.33
Filename 'zImage'.
Load address: 0x80200000
Loading: #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################
         1.6 MiB/s
done
Bytes transferred = 2079736 (1fbbf8 hex)
Kernel image @ 0x80200000 [ 0x000000 - 0x1fbbf8 ]

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Linux version 2.6.37 (anatoly@anatoly-ThinkPad-Edge-E440) (gcc version 4.5.1 (Sourcery G++ Lite 2010.09-50) ) #1 Thu May 7 10:22:14 EEST 2015
CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c53c7f
CPU: VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine: PowerBeacon-AM3874
reserved size = 0 at 0x0
Memory policy: ECC disabled, Data cache writeback
OMAP chip is TI8148 2.0
SRAM: Mapped pa 0x402f1000 to va 0xfe400000 size: 0xf000
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 44660
Kernel command line: console=ttyO0,115200n8 root=/dev/mtdblock8 rw rootfstype=jffs2 rootwait=1 mem=176M
PID hash table entries: 1024 (order: 0, 4096 bytes)
Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
Memory: 176MB = 176MB total
Memory: 173920k/173920k available, 6304k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xcb800000 - 0xf8000000   ( 712 MB)
    lowmem  : 0xc0000000 - 0xcb000000   ( 176 MB)
    pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    modules : 0xbf000000 - 0xbfe00000   (  14 MB)
      .init : 0xc0008000 - 0xc003d000   ( 212 kB)
      .text : 0xc003d000 - 0xc03cba84   (3643 kB)
      .data : 0xc03cc000 - 0xc0406300   ( 233 kB)
SLUB: Genslabs=11, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS:375
IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
Total of 128 interrupts on 1 active controller
GPMC revision 6.0
Trying to install interrupt handler for IRQ368
Trying to install interrupt handler for IRQ369
Trying to install interrupt handler for IRQ370
Trying to install interrupt handler for IRQ371
Trying to install interrupt handler for IRQ372
Trying to install interrupt handler for IRQ373
Trying to install interrupt handler for IRQ374
Trying to install type control for IRQ375
Trying to set irq flags for IRQ375
OMAP clockevent source: GPTIMER1 at 20000000 Hz
Console: colour dummy device 80x30
Calibrating delay loop... 4797.23 BogoMIPS (lpj=23986176)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
ftrace: allocating 9660 entries in 19 pages
devtmpfs: initialized
omap_voltage_early_init: voltage driver support not added
regulator: core version 0.5
regulator: dummy: 
omap_voltage_domain_lookup: Voltage driver init not yet happened.Faulting!
omap_voltage_add_dev: VDD specified does not exist!
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
omap_mux_init: Add partition: #1: core, flags: 4
Debugfs: Only enabling/disabling deep sleep and wakeup timer is supported now
bio: create slab <bio-0> at 0
SCSI subsystem initialized
Switching to clocksource gp timer
NetWinder Floating Point Emulator V0.97 (double precision)
PMU: registered new PMU device of type 0
omap-iommu omap-iommu.0: ducati registered
omap-iommu omap-iommu.1: sys registered
JFFS2 version 2.2. (NAND) (SUMMARY)  �© 2001-2006 Red Hat, Inc.
msgmni has been set to 339
kworker/u:0 used greatest stack depth: 6868 bytes left
kworker/u:0 used greatest stack depth: 6676 bytes left
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
omap_uart.0: ttyO0 at MMIO 0x48020000 (irq = 72) is a OMAP UART0
console [ttyO0] enabled
omap_uart.1: ttyO1 at MMIO 0x48022000 (irq = 73) is a OMAP UART1
omap_uart.2: ttyO2 at MMIO 0x48024000 (irq = 74) is a OMAP UART2
omap_uart.3: ttyO3 at MMIO 0x481a6000 (irq = 44) is a OMAP UART3
omap_uart.4: ttyO4 at MMIO 0x481a8000 (irq = 45) is a OMAP UART4
omap_uart.5: ttyO5 at MMIO 0x481aa000 (irq = 46) is a OMAP UART5
brd: module loaded
loop: module loaded
Generic platform RAM MTD, (c) 2004 Simtec Electronics
slram: not enough parameters.
GPIO NAND driver, �© 2004 Simtec Electronics
omap2-nand driver initializing
NAND device: Manufacturer ID: 0xc2, Chip ID: 0xf0 (Macronix )
Creating 9 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot SPL"
mtd: Giving out device 0 to U-Boot SPL
0x000000020000-0x000000040000 : "U-Boot SPL Backup 1"
mtd: Giving out device 1 to U-Boot SPL Backup 1
0x000000040000-0x000000060000 : "U-Boot SPL Backup 2"
mtd: Giving out device 2 to U-Boot SPL Backup 2
0x000000060000-0x000000080000 : "U-Boot SPL Backup 3"
mtd: Giving out device 3 to U-Boot SPL Backup 3
0x000000080000-0x000000180000 : "U-Boot"
mtd: Giving out device 4 to U-Boot
0x000000180000-0x0000001a0000 : "U-Boot Env"
mtd: Giving out device 5 to U-Boot Env
0x0000001a0000-0x0000001c0000 : "U-Boot Env Backup"
mtd: Giving out device 6 to U-Boot Env Backup
0x0000001c0000-0x0000009c0000 : "Kernel"
mtd: Giving out device 7 to Kernel
0x0000009c0000-0x000004000000 : "File System"
mtd: Giving out device 8 to File System
omap_rtc omap_rtc: rtc core: registered omap_rtc as rtc0
OMAP Watchdog Timer Rev 0x00: initial timeout 60 sec
VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
omap_voltage_late_init: Voltage driver support not added
Power Management for TI81XX.
omap_rtc omap_rtc: setting system clock to 2000-01-01 00:00:00 UTC (946684800)
Empty flash at 0x0000ff70 ends at 0x00010000
Empty flash at 0x0002fffc ends at 0x00030000
Empty flash at 0x0004fffc ends at 0x00050000
Empty flash at 0x0006fffc ends at 0x00070000
Empty flash at 0x0008fffc ends at 0x00090000
Empty flash at 0x000afffc ends at 0x000b0000
Empty flash at 0x000efffc ends at 0x000f0000
Empty flash at 0x0010fffc ends at 0x00110000
Empty flash at 0x0012fffc ends at 0x00130000
Empty flash at 0x0014fffc ends at 0x00150000
Empty flash at 0x0016fffc ends at 0x00170000
Empty flash at 0x0018fffc ends at 0x00190000
Empty flash at 0x001afffc ends at 0x001b0000
Empty flash at 0x001cff98 ends at 0x001d0000
Empty flash at 0x001efffc ends at 0x001f0000
Empty flash at 0x0020ffcc ends at 0x00210000
Empty flash at 0x0026fffc ends at 0x00270000
Empty flash at 0x0028ffd0 ends at 0x00290000
JFFS2 notice: (1) jffs2_build_xattr_subsystem: complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) and 0 of xref (0 dead, 0 orphan) found.
VFS: Mounted root (jffs2 filesystem) on device 31:8.
devtmpfs: mounted
Freeing init memory: 212K
hostname used greatest stack depth: 6300 bytes left

    System initialization...

    Hostname       : OMAP3EVM
 uname used greatest stack depth: 6060 bytes left
   Filesystem     : v1.0.0


    Kernel relea

I'll try to perform DDR3 and NAND HW diagnostic as you suggested.

Thanks,

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly Goldstein said:
As for byte wise leveling, according to TI's wiki byte wise SW leveling is for 32 bit DDR interface only. We are using 16 bit DDR3.

I would recommend you byte wise leveling for 16-bit DDR3 also.

"Filename 'zImage'."
Can you try with uImage?

"gcc version 4.5.1 (Sourcery G++ Lite 2010.09-50"
Can you try with Code Sourcery 2009q1-203 and/or arago-2011.09 toolchains?

Which linux kernel you are using exactly? Is the one below?

"Creating 9 MTD partitions on "omap2-nand.0":"

By default we have 6 (not 9) MTD partitions. This might be the root cause.

omap2-nand driver initializing
NAND device: Manufacturer ID: 0x2c, Chip ID: 0xca (Micron )
Creating 6 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot-min"
0x000000020000-0x000000260000 : "U-Boot"
0x000000260000-0x000000280000 : "U-Boot Env"
0x000000280000-0x0000006c0000 : "Kernel"
0x0000006c0000-0x00000cee0000 : "File System"
0x00000cee0000-0x000010000000 : "Reserved"

"Empty flash at 0x0000ff70 ends at 0x00010000"

Have you try to erase and reflash?

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Pavel,

I tried to perform byte wise leveling, but program output was zeros for Read DQS, Read DQS GATE and Write DATA. I got meaningful values only for Write DQS.

Running uImage instead of zImage didn't change system behaviour.

Using Code Sourcery 2009q1-203 toolchain instead of Sourcery G++ Lite 2010.09-50 didn't change system behaviour. Actually I have Sourcery G++ Lite 2009q1-203 but I think its the same.

I'm using linux-2.6.37-psp04.04.00.01 provided by TI as part of EZSDK 5_04_00_11 SW package.

Yes I reconfigured NAND partitions, but u-boot and kernel has the same definitions. File system was burned on NAND from u-boot and I believe kernel is reading it from the correct location. You can see below that u-boot and kernel are synced

U-Boot# mtdparts

device nand0 <nand.0>, # parts = 9
#: name size offset mask_flags
0: NAND.SPL 0x00020000 0x00000000 0
1: NAND.SPL.backup1 0x00020000 0x00020000 0
2: NAND.SPL.backup2 0x00020000 0x00040000 0
3: NAND.SPL.backup3 0x00020000 0x00060000 0
4: NAND.u-boot 0x00100000 0x00080000 0
5: NAND.u-boot-env 0x00020000 0x00180000 0
6: NAND.u-boot-env.backup10x00020000 0x001a0000 0
7: NAND.kernel 0x00800000 0x001c0000 0
8: NAND.rootfs 0x03640000 0x009c0000 0

Creating 9 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot SPL"
mtd: Giving out device 0 to U-Boot SPL
0x000000020000-0x000000040000 : "U-Boot SPL Backup 1"
mtd: Giving out device 1 to U-Boot SPL Backup 1
0x000000040000-0x000000060000 : "U-Boot SPL Backup 2"
mtd: Giving out device 2 to U-Boot SPL Backup 2
0x000000060000-0x000000080000 : "U-Boot SPL Backup 3"
mtd: Giving out device 3 to U-Boot SPL Backup 3
0x000000080000-0x000000180000 : "U-Boot"
mtd: Giving out device 4 to U-Boot
0x000000180000-0x0000001a0000 : "U-Boot Env"
mtd: Giving out device 5 to U-Boot Env
0x0000001a0000-0x0000001c0000 : "U-Boot Env Backup"
mtd: Giving out device 6 to U-Boot Env Backup
0x0000001c0000-0x0000009c0000 : "Kernel"
mtd: Giving out device 7 to Kernel
0x0000009c0000-0x000004000000 : "File System"
mtd: Giving out device 8 to File System

And as for 'Empty flash' warnings, yes I erased and reflashed NAND multiple times. This warnings appear also when running on another board.

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

Anatoly Goldstein said:
I tried to perform byte wise leveling, but program output was zeros for Read DQS, Read DQS GATE and Write DATA. I got meaningful values only for Write DQS.

Can you try with running the DDR3 at frequency as low as possible? May be this issue will come up only at high DDR3 frequency.

Anatoly Goldstein said:
I'm using linux-2.6.37-psp04.04.00.01 provided by TI as part of EZSDK 5_04_00_11 SW package.

Can you try with the latest linux kernel code base:

Can you provide console log with the exact kernel crash?

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

I tried to perform DDR byte wise leveling for 333MHz and 300MHz, the results were the same.

For some reason I cannot run the latest linux kernel, it doesn't even start. Console log stops after "Starting kernel ..." (the last thing printed by u-boot), I do not get even "Uncompressing Linux...". I need more time to debug this.

As I mentioned in previous posts, the system doesn't crash in the same place, crashes are happening in different places and sometimes the system hangs without any crash dump. In attachment you can see three different crash dumps that I collected today.

Fullscreen 3441.kernel_crash_1.txt Download

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Linux version 2.6.37 (anatoly@anatoly-ThinkPad-Edge-E440) (gcc version 4.3.3 (Sourcery G++ Lite 2009q1-203) ) #1 Thu May 7 15:02:32 EEST 2015
CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c53c7f
CPU: VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine: PowerBeacon-AM3874
reserved size = 0 at 0x0
Memory policy: ECC disabled, Data cache writeback
OMAP chip is TI8148 2.0
SRAM: Mapped pa 0x402f1000 to va 0xfe400000 size: 0xf000
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 44660
Kernel command line: console=ttyO0,115200n8 root=/dev/mtdblock8 rw rootfstype=jffs2 rootwait=1 mem=176M
PID hash table entries: 1024 (order: 0, 4096 bytes)
Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
Memory: 176MB = 176MB total
Memory: 174008k/174008k available, 6216k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xcb800000 - 0xf8000000   ( 712 MB)
    lowmem  : 0xc0000000 - 0xcb000000   ( 176 MB)
    pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    modules : 0xbf000000 - 0xbfe00000   (  14 MB)
      .init : 0xc0008000 - 0xc0040000   ( 224 kB)
      .text : 0xc0040000 - 0xc03b5000   (3540 kB)
      .data : 0xc03b6000 - 0xc03f0160   ( 233 kB)
SLUB: Genslabs=11, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS:375
IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
Total of 128 interrupts on 1 active controller
GPMC revision 6.0
Trying to install interrupt handler for IRQ368
Trying to install interrupt handler for IRQ369
Trying to install interrupt handler for IRQ370
Trying to install interrupt handler for IRQ371
Trying to install interrupt handler for IRQ372
Trying to install interrupt handler for IRQ373
Trying to install interrupt handler for IRQ374
Trying to install type control for IRQ375
Trying to set irq flags for IRQ375
OMAP clockevent source: GPTIMER1 at 20000000 Hz
Console: colour dummy device 80x30
Calibrating delay loop... 4797.23 BogoMIPS (lpj=23986176)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
ftrace: allocating 9460 entries in 28 pages
devtmpfs: initialized
omap_voltage_early_init: voltage driver support not added
regulator: core version 0.5
regulator: dummy: 
omap_voltage_domain_lookup: Voltage driver init not yet happened.Faulting!
omap_voltage_add_dev: VDD specified does not exist!
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
omap_mux_init: Add partition: #1: core, flags: 4
Debugfs: Only enabling/disabling deep sleep and wakeup timer is supported now
bio: create slab <bio-0> at 0
SCSI subsystem initialized
Switching to clocksource gp timer
NetWinder Floating Point Emulator V0.97 (double precision)
PMU: registered new PMU device of type 0
omap-iommu omap-iommu.0: ducati registered
omap-iommu omap-iommu.1: sys registered
JFFS2 version 2.2. (NAND) (SUMMARY)  �© 2001-2006 Red Hat, Inc.
msgmni has been set to 339
kworker/u:0 used greatest stack depth: 6732 bytes left
kworker/u:0 used greatest stack depth: 6516 bytes left
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
omap_uart.0: ttyO0 at MMIO 0x48020000 (irq = 72) is a OMAP UART0
console [ttyO0] enabled
omap_uart.1: ttyO1 at MMIO 0x48022000 (irq = 73) is a OMAP UART1
omap_uart.2: ttyO2 at MMIO 0x48024000 (irq = 74) is a OMAP UART2
omap_uart.3: ttyO3 at MMIO 0x481a6000 (irq = 44) is a OMAP UART3
omap_uart.4: ttyO4 at MMIO 0x481a8000 (irq = 45) is a OMAP UART4
omap_uart.5: ttyO5 at MMIO 0x481aa000 (irq = 46) is a OMAP UART5
brd: module loaded
loop: module loaded
Generic platform RAM MTD, (c) 2004 Simtec Electronics
slram: not enough parameters.
GPIO NAND driver, �© 2004 Simtec Electronics
omap2-nand driver initializing
NAND device: Manufacturer ID: 0xc2, Chip ID: 0xf0 (Macronix )
Creating 9 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot SPL"
mtd: Giving out device 0 to U-Boot SPL
0x000000020000-0x000000040000 : "U-Boot SPL Backup 1"
mtd: Giving out device 1 to U-Boot SPL Backup 1
0x000000040000-0x000000060000 : "U-Boot SPL Backup 2"
mtd: Giving out device 2 to U-Boot SPL Backup 2
0x000000060000-0x000000080000 : "U-Boot SPL Backup 3"
mtd: Giving out device 3 to U-Boot SPL Backup 3
0x000000080000-0x000000180000 : "U-Boot"
mtd: Giving out device 4 to U-Boot
0x000000180000-0x0000001a0000 : "U-Boot Env"
mtd: Giving out device 5 to U-Boot Env
0x0000001a0000-0x0000001c0000 : "U-Boot Env Backup"
mtd: Giving out device 6 to U-Boot Env Backup
0x0000001c0000-0x0000009c0000 : "Kernel"
mtd: Giving out device 7 to Kernel
0x0000009c0000-0x000004000000 : "File System"
mtd: Giving out device 8 to File System
omap_rtc omap_rtc: rtc core: registered omap_rtc as rtc0
OMAP Watchdog Timer Rev 0x00: initial timeout 60 sec
VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
omap_voltage_late_init: Voltage driver support not added
Power Management for TI81XX.
Unable to handle kernel paging request at virtual address ea335610
pgd = c0004000
[ea335610] *pgd=00000000
Internal error: Oops: 5 [#1]
last sysfs file: 
Modules linked in:
CPU: 0    Not tainted  (2.6.37 #1)
PC is at mix_pool_bytes_extract+0x10c/0x1d0
LR is at extract_buf+0x88/0x100
pc : [<c023609c>]    lr : [<c02364e4>]    psr: 80000093
sp : ca83fd00  ip : ca83fd60  fp : ca83fd5c
r10: 0000001d  r9 : 0000001f  r8 : 00000000
r7 : ffbca327  r6 : e2020007  r5 : c0236090  r4 : 00000011
r3 : 00000007  r2 : dd70e4a2  r1 : 00000001  r0 : 0000001d
Flags: Nzcv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment kernel
Control: 10c5387d  Table: 80004019  DAC: 00000017
Process swapper (pid: 1, stack limit = 0xca83e2e8)
Stack: (0xca83fd00 to 0xca840000)
fd00: c02dcb10 ca83fea4 00000014 ca83fee4 c03e0b48 0000001a 00000014 0000000e
fd20: 00000007 00000001 00000bc9 60000013 c05c855c ca83fea4 ca83fd64 c03e0b48
fd40: ca83fee4 ca83ff26 c0023740 c03e0b48 ca83ff1c ca83fd60 c02364e4 c0235f9c
fd60: c00e5bac 5160f91e 1f9a7d8a e2ffa98a cbf8be61 ba45e97d c15ad2a9 48a181ac
fd80: 27a3bcff 3ddb5b9c 53002fb9 3c9ae56d d77c10c2 54c3b322 a2fc70dd c2f0ca92
fda0: c9b5ece1 5970f7aa 8b244d80 5b2a92f7 095d1741 5a072ce6 3e5f18f8 7dae0fc7
fdc0: ce22a683 ccdca346 e5ecfa78 faa2c477 6003a831 53b15e5c 5f688167 0c5b359d
fde0: be04b37d 23dc8ef9 d79d2a48 8b179236 e9ba52e2 470aae6b 48055a54 a92797fc
fe00: a58083db bb4f6738 f6abdffb 0f09178d db3c3918 dc9634a3 4cc0ff87 bb382b00
fe20: 211e5c9a be8908e0 e76918a2 c414ee95 8814729d aba42b2d caa3913a 428952b2
fe40: b322572f 80d9d2df 10ef59e7 49533529 3e62cdbb b9cadad3 dc5c0e1d f2b579d2
fe60: 993f9389 4c30756e 1a4e9415 7fb8c631 61cab6e4 95526eb2 b4ca1c73 a25e9eb6
fe80: 5f41e7e7 62e11dd6 2d3b3dff a0c19c59 c22ad129 e62de099 a2d03b7c bde28647
fea0: 743a01c4 00000180 00000000 c0073e18 00000000 80000093 0000000c 60000013
fec0: ca83ff74 c03f0180 c0023740 c03e0b48 ca83fefc c0236440 c03e0b48 0000000c
fee0: 60000013 4543dd0c 3e9c5b3c 1227b248 5e9a7d44 2dcf8be6 c0236440 0000000a
ff00: 0000000c ca83ff26 ca83ff74 0000000a ca83ff54 ca83ff20 c02365d4 c0236468
ff20: ca83ff44 c02d5c6c ca4e7d80 c043fa18 c002a234 c002a244 c0029f14 00000000
ff40: c03f0180 00000000 ca83ff6c ca83ff58 c0236720 c0236568 00000000 00000000
ff60: ca83ff8c ca83ff70 c002375c c02366f8 c01a0074 00000001 c002a230 c002a244
ff80: ca83ffd4 ca83ff90 c0040440 c002374c ca83ffb4 3733b438 00000034 00000000
ffa0: 00000177 c03d8b30 c0029f14 c002a234 c002a244 c0029f14 00000013 00000000
ffc0: 00000000 00000000 ca83fff4 ca83ffd8 c000877c c0040408 00000000 c00086a4
ffe0: c007e6ec 00000013 00000000 ca83fff8 c007e6ec c00086b0 00000000 00000000
Backtrace: 
[<c0235f90>] (mix_pool_bytes_extract+0x0/0x1d0) from [<c02364e4>] (extract_buf+0x88/0x100)
[<c023645c>] (extract_buf+0x0/0x100) from [<c02365d4>] (extract_entropy+0x78/0xac)
 r8:0000000a r7:ca83ff74 r6:ca83ff26 r5:0000000c r4:0000000a
[<c023655c>] (extract_entropy+0x0/0xac) from [<c0236720>] (get_random_bytes+0x34/0x40)
[<c02366ec>] (get_random_bytes+0x0/0x40) from [<c002375c>] (random32_reseed+0x1c/0x6c)
[<c0023740>] (random32_reseed+0x0/0x6c) from [<c0040440>] (do_one_initcall+0x44/0x1c4)
[<c00403fc>] (do_one_initcall+0x0/0x1c4) from [<c000877c>] (kernel_init+0xd8/0x170)
[<c00086a4>] (kernel_init+0x0/0x170) from [<c007e6ec>] (do_exit+0x0/0x75c)
 r7:00000013 r6:c007e6ec r5:c00086a4 r4:00000000
Code: e08a3001 e7956104 e0000009 e0033009 (e795410c) 
---[ end trace a9225de1f90f609a ]---
swapper used greatest stack depth: 4844 bytes left
Kernel panic - not syncing: Attempted to kill init!
Backtrace: 
[<c00510bc>] (dump_backtrace+0x0/0x118) from [<c02b7ad8>] (dump_stack+0x20/0x24)
 r7:ca83c000 r6:00000005 r5:000012ec r4:c03f08a0
[<c02b7ab8>] (dump_stack+0x0/0x24) from [<c02b7b58>] (panic+0x7c/0x1a4)
[<c02b7adc>] (panic+0x0/0x1a4) from [<c007ed20>] (do_exit+0x634/0x75c)
 r3:c03d0228 r2:ca83c134 r1:ca83fb4c r0:c035b268
[<c007e6ec>] (do_exit+0x0/0x75c) from [<c005158c>] (bad_mode+0x0/0x6c)
[<c00513b8>] (die+0x0/0x1d4) from [<c00544b8>] (__do_kernel_fault+0x84/0x94)
[<c0054434>] (__do_kernel_fault+0x0/0x94) from [<c005451c>] (do_bad_area+0x54/0x84)
 r9:00000193 r8:00000005 r7:ca83fcb8 r6:c0007a88 r5:c0004000
r4:00000005
[<c00544c8>] (do_bad_area+0x0/0x84) from [<c02bc240>] (do_translation_fault+0x7c/0xb0)
 r4:00003a88
[<c02bc1c4>] (do_translation_fault+0x0/0xb0) from [<c0040340>] (do_DataAbort+0x44/0xa8)
 r9:00000193 r8:ca83fcb8 r7:c03ba608 r6:00000005 r5:ca83fcec
r4:c03ba5b8
[<c00402fc>] (do_DataAbort+0x0/0xa8) from [<c02ba06c>] (__dabt_svc+0x4c/0x60)
Exception stack(0xca83fcb8 to 0xca83fd00)
fca0:                                                       0000001d 00000001
fcc0: dd70e4a2 00000007 00000011 c0236090 e2020007 ffbca327 00000000 0000001f
fce0: 0000001d ca83fd5c ca83fd60 ca83fd00 c02364e4 c023609c 80000093 ffffffff
[<c0235f90>] (mix_pool_bytes_extract+0x0/0x1d0) from [<c02364e4>] (extract_buf+0x88/0x100)
[<c023645c>] (extract_buf+0x0/0x100) from [<c02365d4>] (extract_entropy+0x78/0xac)
 r8:0000000a r7:ca83ff74 r6:ca83ff26 r5:0000000c r4:0000000a
[<c023655c>] (extract_entropy+0x0/0xac) from [<c0236720>] (get_random_bytes+0x34/0x40)
[<c02366ec>] (get_random_bytes+0x0/0x40) from [<c002375c>] (random32_reseed+0x1c/0x6c)
[<c0023740>] (random32_reseed+0x0/0x6c) from [<c0040440>] (do_one_initcall+0x44/0x1c4)
[<c00403fc>] (do_one_initcall+0x0/0x1c4) from [<c000877c>] (kernel_init+0xd8/0x170)
[<c00086a4>] (kernel_init+0x0/0x170) from [<c007e6ec>] (do_exit+0x0/0x75c)
 r7:00000013 r6:c007e6ec r5:c00086a4 r4:00000000

Fullscreen 1258.kernel_crash_2.txt Download

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Linux version 2.6.37 (anatoly@anatoly-ThinkPad-Edge-E440) (gcc version 4.3.3 (Sourcery G++ Lite 2009q1-203) ) #1 Thu May 7 15:02:32 EEST 2015
CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c53c7f
CPU: VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine: PowerBeacon-AM3874
reserved size = 0 at 0x0
Memory policy: ECC disabled, Data cache writeback
OMAP chip is TI8148 2.0
SRAM: Mapped pa 0x402f1000 to va 0xfe400000 size: 0xf000
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 44660
Kernel command line: console=ttyO0,115200n8 root=/dev/mtdblock8 rw rootfstype=jffs2 rootwait=1 mem=176M
PID hash table entries: 1024 (order: 0, 4096 bytes)
Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
Memory: 176MB = 176MB total
Memory: 174008k/174008k available, 6216k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xcb800000 - 0xf8000000   ( 712 MB)
    lowmem  : 0xc0000000 - 0xcb000000   ( 176 MB)
    pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    modules : 0xbf000000 - 0xbfe00000   (  14 MB)
      .init : 0xc0008000 - 0xc0040000   ( 224 kB)
      .text : 0xc0040000 - 0xc03b5000   (3540 kB)
      .data : 0xc03b6000 - 0xc03f0160   ( 233 kB)
SLUB: Genslabs=11, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS:375
IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
Total of 128 interrupts on 1 active controller
GPMC revision 6.0
Trying to install interrupt handler for IRQ368
Trying to install interrupt handler for IRQ369
Trying to install interrupt handler for IRQ370
Trying to install interrupt handler for IRQ371
Trying to install interrupt handler for IRQ372
Trying to install interrupt handler for IRQ373
Trying to install interrupt handler for IRQ374
Trying to install type control for IRQ375
Trying to set irq flags for IRQ375
OMAP clockevent source: GPTIMER1 at 20000000 Hz
Console: colour dummy device 80x30
Calibrating delay loop... 4797.23 BogoMIPS (lpj=23986176)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
ftrace: allocating 9460 entries in 28 pages
devtmpfs: initialized
omap_voltage_early_init: voltage driver support not added
regulator: core version 0.5
regulator: dummy: 
omap_voltage_domain_lookup: Voltage driver init not yet happened.Faulting!
omap_voltage_add_dev: VDD specified does not exist!
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
omap_mux_init: Add partition: #1: core, flags: 4
Debugfs: Only enabling/disabling deep sleep and wakeup timer is supported now
bio: create slab <bio-0> at 0
SCSI subsystem initialized
Switching to clocksource gp timer
NetWinder Floating Point Emulator V0.97 (double precision)
PMU: registered new PMU device of type 0
omap-iommu omap-iommu.0: ducati registered
omap-iommu omap-iommu.1: sys registered
JFFS2 version 2.2. (NAND) (SUMMARY)  �© 2001-2006 Red Hat, Inc.
msgmni has been set to 339
kworker/u:0 used greatest stack depth: 6732 bytes left
kworker/u:0 used greatest stack depth: 6516 bytes left
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
omap_uart.0: ttyO0 at MMIO 0x48020000 (irq = 72) is a OMAP UART0
console [ttyO0] enabled
omap_uart.1: ttyO1 at MMIO 0x48022000 (irq = 73) is a OMAP UART1
omap_uart.2: ttyO2 at MMIO 0x48024000 (irq = 74) is a OMAP UART2
omap_uart.3: ttyO3 at MMIO 0x481a6000 (irq = 44) is a OMAP UART3
omap_uart.4: ttyO4 at MMIO 0x481a8000 (irq = 45) is a OMAP UART4
omap_uart.5: ttyO5 at MMIO 0x481aa000 (irq = 46) is a OMAP UART5
brd: module loaded
loop: module loaded
Generic platform RAM MTD, (c) 2004 Simtec Electronics
slram: not enough parameters.
GPIO NAND driver, �© 2004 Simtec Electronics
omap2-nand driver initializing
NAND device: Manufacturer ID: 0xc2, Chip ID: 0xf0 (Macronix )
Creating 9 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot SPL"
mtd: Giving out device 0 to U-Boot SPL
0x000000020000-0x000000040000 : "U-Boot SPL Backup 1"
mtd: Giving out device 1 to U-Boot SPL Backup 1
0x000000040000-0x000000060000 : "U-Boot SPL Backup 2"
mtd: Giving out device 2 to U-Boot SPL Backup 2
0x000000060000-0x000000080000 : "U-Boot SPL Backup 3"
mtd: Giving out device 3 to U-Boot SPL Backup 3
0x000000080000-0x000000180000 : "U-Boot"
mtd: Giving out device 4 to U-Boot
0x000000180000-0x0000001a0000 : "U-Boot Env"
mtd: Giving out device 5 to U-Boot Env
0x0000001a0000-0x0000001c0000 : "U-Boot Env Backup"
mtd: Giving out device 6 to U-Boot Env Backup
0x0000001c0000-0x0000009c0000 : "Kernel"
mtd: Giving out device 7 to Kernel
0x0000009c0000-0x000004000000 : "File System"
mtd: Giving out device 8 to File System
omap_rtc omap_rtc: rtc core: registered omap_rtc as rtc0
OMAP Watchdog Timer Rev 0x00: initial timeout 60 sec
VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
omap_voltage_late_init: Voltage driver support not added
Power Management for TI81XX.
omap_rtc omap_rtc: setting system clock to 2000-01-01 00:00:00 UTC (946684800)
Empty flash at 0x0000ff70 ends at 0x00010000
Empty flash at 0x0002fffc ends at 0x00030000
Empty flash at 0x0004fffc ends at 0x00050000
Empty flash at 0x0006fffc ends at 0x00070000
Empty flash at 0x0008fffc ends at 0x00090000
Empty flash at 0x000afffc ends at 0x000b0000
Empty flash at 0x000efffc ends at 0x000f0000
Empty flash at 0x0010fffc ends at 0x00110000
Empty flash at 0x0012fffc ends at 0x00130000
Empty flash at 0x0014fffc ends at 0x00150000
Empty flash at 0x0016fffc ends at 0x00170000
Empty flash at 0x0018fffc ends at 0x00190000
Empty flash at 0x001afffc ends at 0x001b0000
Empty flash at 0x001cff98 ends at 0x001d0000
Empty flash at 0x001efffc ends at 0x001f0000
Empty flash at 0x0020ffcc ends at 0x00210000
Empty flash at 0x0026fffc ends at 0x00270000
Empty flash at 0x0028ffd0 ends at 0x00290000
JFFS2 notice: (1) jffs2_build_xattr_subsystem: complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) and 0 of xref (0 dead, 0 orphan) found.
VFS: Mounted root (jffs2 filesystem) on device 31:8.
devtmpfs: mounted
Freeing init memory: 224K
Node CRC b8097a6b != calculated CRC adc8ff07 for node at 0009cc70
Data CRC b84d64b0 != calculated CRC 98a1e20d for node at 0009d6f8
Data CRC 7af86759 != calculated CRC 0346b867 for node at 0009e114
Data CRC 4f26c478 != calculated CRC 1fd9828b for node at 0009ec4c
inflate returned -3
hostname used greatest stack depth: 5388 bytes left

    System initialization...

    Hostname       : OMAP3EVM
    Filesystem     : v1.0.0


    Kernel release : Linux 2.6.37
    Kernel version : #1 Thu May 7 15:02:32 EEST 2015

 Mounting /proc             : [SUCCESS]
 Mounting /syspagealloc: memory corruption
              : c06d6d48: 05 00 00 00 00 00 00 00                          ........
Backtrace: 
[<c00510bc>] (dump_backtrace+0x0/0x118) from [<c02b7ad8>] (dump_stack+0x20/0x24)
 r7:00000000 r6:c0458618 r5:c06d6d4f r4:c06d6d48
[<c02b7ab8>] (dump_stack+0x0/0x24) from [<c010d940>] (kernel_map_pages+0x224/0x238)
[<c010d71c>] (kernel_map_pages+0x0/0x238) from [<c00e5b20>] (get_page_from_freelist+0x314/0x58c)
[<c00e580c>] (get_page_from_freelist+0x0/0x58c) from [<c00e5e94>] (__alloc_pages_nodemask+0xfc/0x610)
[<c00e5d98>] (__alloc_pages_nodemask+0x0/0x610) from [<c00fa5a4>] (do_wp_page+0x638/0x7bc)
[<c00f9f6c>] (do_wp_page+0x0/0x7bc) from [<c00fac14>] (handle_mm_fault+0x160/0x74c)
[<c00faab4>] (handle_mm_fault+0x0/0x74c) from [<c02bc160>] (do_page_fault+0x1dc/0x240)
[<c02bbf84>] (do_page_fault+0x0/0x240) from [<c0040340>] (do_DataAbort+0x44/0xa8)
[<c00402fc>] (do_DataAbort+0x0/0xa8) from [<c02ba4e4>] (ret_from_exception+0x0/0x10)
Exception stack(0xcaa93fb0 to 0xcaa93ff8)
3fa0:                                     00001000 00000000 ffffffff 00000000
3fc0: 00000000 0018d030 00198bcc 00198bd8 00198bb0 00198bf0 00198bc4 001b8e84
3fe0: 0018e1e8 bedf6cf0 000994a4 001010c8 60000010 ffffffff
[SUCCESS]
 Mounting /devUnable to handle kernel paging request at virtual address eae929c8
pgd = caaa4000
[eae929c8] *pgd=00000000
Internal error: Oops: 5 [#1]
last sysfs file: 
Modules linked in:
CPU: 0    Not tainted  (2.6.37 #1)
PC is at mix_pool_bytes_extract+0x10c/0x1d0
LR is at extract_buf+0x88/0x100
pc : [<c023609c>]    lr : [<c02364e4>]    psr: 20000093
sp : caa93ba8  ip : caa93c08  fp : caa93c04
r10: 00000011  r9 : 0000001f  r8 : 00000000
r7 : 88ed2b4f  r6 : bcd2bf35  r5 : c04439a8  r4 : 00000005
r3 : 00000007  r2 : 7ee92d7c  r1 : 00000001  r0 : 0000000e
Flags: nzCv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment user
Control: 10c5387d  Table: 8aaa4019  DAC: 00000015
Process mount (pid: 44, stack limit = 0xcaa922e8)
Stack: (0xcaa93ba8 to 0xcaa94000)
3ba0:                   c02dcb10 caa93d4c 00000014 caa93d8c c03e0b48 0000001a
3bc0: 00000014 0000000e 00000007 00000001 000018bf 60000013 c00df148 caa93d4c
3be0: caa93c0c c03e0b48 caa93d8c caa93dce caa93fb0 c03e0b48 caa93dc4 caa93c08
3c00: c02364e4 c0235f9c 00000001 e684220f 242de9fe a0bc49f7 e7d1abdb a6d01a50
3c20: 82db7e97 0e04c4ce ec5bb9e4 9905aeb7 94516223 3d6e1717 e27629ec e33a5ff3
3c40: 5c82687d 71116d73 029ac5fa 077f5a65 4d789aea 73310294 00074d8b 0d2c370e
3c60: 82675b34 cc2e9503 ef785266 42e771e2 eee2884d 843a302c f828fbf1 e3cb1b86
3c80: b08b8d3e 84d0b3c8 86a22de0 0c45485b 4e9bd9c8 f90a50ac ec1b4a2a d8a4c086
3ca0: 493da980 cc043a07 bf386e9a 074b402b 28ab20e7 43862b38 47e6f99d 2e28905f
3cc0: 792444cc 06ee7012 b25215da 16403821 198b862f a0f55d91 e900442d 4607d9e2
3ce0: 5fa9bc8e 49429c26 c78d048a 1a49df78 7f0986e6 15adc4f8 9b164c09 23917e92
3d00: 02e452c1 85f53039 9f8bd3da 5c31d013 14eee9ba d9a926a2 e31cc972 7075a5d8
3d20: 86d398ce 6bc5742a aef5e8dc aa0ca6bb 3668aeff 82c0e828 a1c4e203 c0f28b19
3d40: 32f9e3fb 278aec06 cac4b34b c0100c38 caa7f420 c0073e18 00000000 80000093
3d60: 00000010 60000013 caa93ec0 caa82100 caa93fb0 c03e0b48 caa93da4 c0236440
3d80: c03e0b48 00000010 60000013 0b55ddb1 5c411227 e946c7a8 a9289d7b 0245da63
3da0: c0236440 0000000a 00000010 caa93dce caa93ec0 0000000a caa93dfc caa93dc8
3dc0: c02365d4 c0236468 ffff0000 00000001 caa82500 0018d9b5 caa93ec0 caa92000
3de0: caa82500 00000000 caa82100 ca9ea200 caa93e14 caa93e00 c0236720 c0236568
3e00: 00000000 be82ff6b caa93efc caa93e18 c01544d0 c02366f8 00001812 00000000
3e20: caa93e44 caa93e30 c0054c3c c0054adc 00000017 c011b15c caa92000 00000000
3e40: 00008000 00000001 00000000 ca979900 0018d9b5 001b8f3c 00009e00 00000000
3e60: 00008000 00184690 0018d000 0018d9b5 ca9ea200 001ba2d8 00000005 ca811000
3e80: caa93eb4 00000008 c00fb5b8 00184690 00000017 0018d9b5 00000006 c00fb568
3ea0: 0018d000 caa92000 caa93eec 00000006 be82ff6b be82ff5b 00008000 00000001
3ec0: caa93ecc c0056e84 00000f8b caa93e4c caa93eec fffffff8 00000000 c03db3e8
3ee0: c0153978 c03daed8 c03e7220 ca9ea200 caa93f3c caa93f00 c011b15c c0153984
3f00: caa93fb0 ca9ea202 00000000 00000000 001ba2e4 00000000 ca9ea200 00000001
3f20: caa93fb0 c011c86c 001ba2e4 ca811000 caa93f84 caa93f40 c011ca98 c011b0c0
3f40: 001ba30c c043e538 caa93fb0 001ba2c4 c004d048 00000000 caa93f84 ca811000
3f60: 001ba2c4 001ba2e4 caa93fb0 c004d048 caa92000 00000000 caa93fa4 caa93f88
3f80: c00509dc c011c828 001ba2c4 001ba30c 001ba2e4 0000000b 00000000 caa93fa8
3fa0: c004ce40 c00509a4 001ba2c4 001ba30c 001ba30c 001ba2c4 001ba2e4 00000000
3fc0: 001ba2c4 001ba30c 001ba2e4 0000000b 001ba30c 00000000 001ba254 00000000
3fe0: 001ba317 bebe1690 00016a70 000d1cdc 60000010 001ba30c 00000000 00000000
Backtrace: 
[<c0235f90>] (mix_pool_bytes_extract+0x0/0x1d0) from [<c02364e4>] (extract_buf+0x88/0x100)
[<c023645c>] (extract_buf+0x0/0x100) from [<c02365d4>] (extract_entropy+0x78/0xac)
 r8:0000000a r7:caa93ec0 r6:caa93dce r5:00000010 r4:0000000a
[<c023655c>] (extract_entropy+0x0/0xac) from [<c0236720>] (get_random_bytes+0x34/0x40)
[<c02366ec>] (get_random_bytes+0x0/0x40) from [<c01544d0>] (load_elf_binary+0xb58/0x1420)
[<c0153978>] (load_elf_binary+0x0/0x1420) from [<c011b15c>] (search_binary_handler+0xa8/0x300)
[<c011b0b4>] (search_binary_handler+0x0/0x300) from [<c011ca98>] (do_execve+0x27c/0x324)
[<c011c81c>] (do_execve+0x0/0x324) from [<c00509dc>] (sys_execve+0x44/0x64)
[<c0050998>] (sys_execve+0x0/0x64) from [<c004ce40>] (ret_fast_syscall+0x0/0x30)
 r7:0000000b r6:001ba2e4 r5:001ba30c r4:001ba2c4
Code: e08a3001 e7956104 e0000009 e0033009 (e795410c) 
              : ---[ end trace 3bd48277ee9ab467 ]---
mount used greatest stack depth: 4896 bytes left
Segmentation fau

Fullscreen kernel_crash_3.txt Download

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Linux version 2.6.37 (anatoly@anatoly-ThinkPad-Edge-E440) (gcc version 4.3.3 (Sourcery G++ Lite 2009q1-203) ) #1 Thu May 7 15:02:32 EEST 2015
CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c53c7f
CPU: VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine: PowerBeacon-AM3874
reserved size = 0 at 0x0
Memory policy: ECC disabled, Data cache writeback
OMAP chip is TI8148 2.0
SRAM: Mapped pa 0x402f1000 to va 0xfe400000 size: 0xf000
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 44660
Kernel command line: console=ttyO0,115200n8 root=/dev/mtdblock8 rw rootfstype=jffs2 rootwait=1 mem=176M
PID hash table entries: 1024 (order: 0, 4096 bytes)
Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
Memory: 176MB = 176MB total
Memory: 174008k/174008k available, 6216k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xcb800000 - 0xf8000000   ( 712 MB)
    lowmem  : 0xc0000000 - 0xcb000000   ( 176 MB)
    pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    modules : 0xbf000000 - 0xbfe00000   (  14 MB)
      .init : 0xc0008000 - 0xc0040000   ( 224 kB)
      .text : 0xc0040000 - 0xc03b5000   (3540 kB)
      .data : 0xc03b6000 - 0xc03f0160   ( 233 kB)
SLUB: Genslabs=11, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS:375
IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
Total of 128 interrupts on 1 active controller
GPMC revision 6.0
Trying to install interrupt handler for IRQ368
Trying to install interrupt handler for IRQ369
Trying to install interrupt handler for IRQ370
Trying to install interrupt handler for IRQ371
Trying to install interrupt handler for IRQ372
Trying to install interrupt handler for IRQ373
Trying to install interrupt handler for IRQ374
Trying to install type control for IRQ375
Trying to set irq flags for IRQ375
OMAP clockevent source: GPTIMER1 at 20000000 Hz
Console: colour dummy device 80x30
Calibrating delay loop... 4797.23 BogoMIPS (lpj=23986176)
pid_max: default: 32768 minimum: 301
Security Framework initialized
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
ftrace: allocating 9460 entries in 28 pages
devtmpfs: initialized
omap_voltage_early_init: voltage driver support not added
regulator: core version 0.5
regulator: dummy: 
omap_voltage_domain_lookup: Voltage driver init not yet happened.Faulting!
omap_voltage_add_dev: VDD specified does not exist!
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
OMAP GPIO hardware version 0.1
omap_mux_init: Add partition: #1: core, flags: 4
Debugfs: Only enabling/disabling deep sleep and wakeup timer is supported now
bio: create slab <bio-0> at 0
SCSI subsystem initialized
Switching to clocksource gp timer
NetWinder Floating Point Emulator V0.97 (double precision)
PMU: registered new PMU device of type 0
omap-iommu omap-iommu.0: ducati registered
omap-iommu omap-iommu.1: sys registered
JFFS2 version 2.2. (NAND) (SUMMARY)  �© 2001-2006 Red Hat, Inc.
msgmni has been set to 339
kworker/u:0 used greatest stack depth: 6732 bytes left
kworker/u:0 used greatest stack depth: 6516 bytes left
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
omap_uart.0: ttyO0 at MMIO 0x48020000 (irq = 72) is a OMAP UART0
console [ttyO0] enabled
omap_uart.1: ttyO1 at MMIO 0x48022000 (irq = 73) is a OMAP UART1
omap_uart.2: ttyO2 at MMIO 0x48024000 (irq = 74) is a OMAP UART2
omap_uart.3: ttyO3 at MMIO 0x481a6000 (irq = 44) is a OMAP UART3
omap_uart.4: ttyO4 at MMIO 0x481a8000 (irq = 45) is a OMAP UART4
omap_uart.5: ttyO5 at MMIO 0x481aa000 (irq = 46) is a OMAP UART5
brd: module loaded
loop: module loaded
Generic platform RAM MTD, (c) 2004 Simtec Electronics
slram: not enough parameters.
GPIO NAND driver, �© 2004 Simtec Electronics
omap2-nand driver initializing
NAND device: Manufacturer ID: 0xc2, Chip ID: 0xf0 (Macronix )
Creating 9 MTD partitions on "omap2-nand.0":
0x000000000000-0x000000020000 : "U-Boot SPL"
mtd: Giving out device 0 to U-Boot SPL
0x000000020000-0x000000040000 : "U-Boot SPL Backup 1"
mtd: Giving out device 1 to U-Boot SPL Backup 1
0x000000040000-0x000000060000 : "U-Boot SPL Backup 2"
mtd: Giving out device 2 to U-Boot SPL Backup 2
0x000000060000-0x000000080000 : "U-Boot SPL Backup 3"
mtd: Giving out device 3 to U-Boot SPL Backup 3
0x000000080000-0x000000180000 : "U-Boot"
mtd: Giving out device 4 to U-Boot
0x000000180000-0x0000001a0000 : "U-Boot Env"
mtd: Giving out device 5 to U-Boot Env
0x0000001a0000-0x0000001c0000 : "U-Boot Env Backup"
mtd: Giving out device 6 to U-Boot Env Backup
0x0000001c0000-0x0000009c0000 : "Kernel"
mtd: Giving out device 7 to Kernel
0x0000009c0000-0x000004000000 : "File System"
mtd: Giving out device 8 to File System
omap_rtc omap_rtc: rtc core: registered omap_rtc as rtc0
OMAP Watchdog Timer Rev 0x00: initial timeout 60 sec
VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
omap_voltage_late_init: Voltage driver support not added
Power Management for TI81XX.
omap_rtc omap_rtc: setting system clock to 2000-01-01 00:00:00 UTC (946684800)
Empty flash at 0x0000ff70 ends at 0x00010000
Empty flash at 0x0002fffc ends at 0x00030000
Empty flash at 0x0004fffc ends at 0x00050000
Empty flash at 0x0006fffc ends at 0x00070000
Empty flash at 0x0008fffc ends at 0x00090000
Empty flash at 0x000afffc ends at 0x000b0000
Empty flash at 0x000efffc ends at 0x000f0000
Empty flash at 0x0010fffc ends at 0x00110000
Empty flash at 0x0012fffc ends at 0x00130000
Empty flash at 0x0014fffc ends at 0x00150000
Empty flash at 0x0016fffc ends at 0x00170000
Empty flash at 0x0018fffc ends at 0x00190000
Empty flash at 0x001afffc ends at 0x001b0000
Empty flash at 0x001cff98 ends at 0x001d0000
Empty flash at 0x001efffc ends at 0x001f0000
Empty flash at 0x0020ffcc ends at 0x00210000
Empty flash at 0x0026fffc ends at 0x00270000
Empty flash at 0x0028ffd0 ends at 0x00290000
JFFS2 notice: (1) jffs2_build_xattr_subsystem: complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan) and 0 of xref (0 dead, 0 orphan) found.
VFS: Mounted root (jffs2 filesystem) on device 31:8.
devtmpfs: mounted
Freeing init memory: 224K
Unable to handle kernel paging request at virtual address eae8a628
pgd = caa94000
[eae8a628] *pgd=00000000
Internal error: Oops: 5 [#1]
last sysfs file: 
Modules linked in:
CPU: 0    Not tainted  (2.6.37 #1)
PC is at mix_pool_bytes_extract+0x10c/0x1d0
LR is at extract_buf+0x88/0x100
pc : [<c023609c>]    lr : [<c02364e4>]    psr: 20000093
sp : caa91ac0  ip : caa91b20  fp : caa91b1c
r10: 00000009  r9 : 0000001f  r8 : 00000000
r7 : c09e26ff  r6 : 1e4081dc  r5 : c04439a8  r4 : 0000001d
r3 : 00000007  r2 : db5c44fb  r1 : 00000001  r0 : 0000000e
Flags: nzCv  IRQs off  FIQs on  Mode SVC_32  ISA ARM  Segment user
Control: 10c5387d  Table: 8aa94019  DAC: 00000015
Process rcS (pid: 37, stack limit = 0xcaa902e8)
Stack: (0xcaa91ac0 to 0xcaa92000)
1ac0: c02dcb10 caa91c64 00000014 caa91ca4 c03e0b48 0000001a 00000014 0000000e
1ae0: 00000007 00000001 000010d8 60000013 c00df148 caa91c64 caa91b24 c03e0b48
1b00: caa91ca4 caa91ce6 caa91fb0 c03e0b48 caa91cdc caa91b20 c02364e4 c0235f9c
1b20: 00000001 e07ad314 3427714c 03cfe07c acb03063 64d474f8 a11ca5b8 f4fafdd5
1b40: 7eb47cef e0115f27 8ab3b242 481abeb8 7f0b185b 3418789b dc81401e 28b46780
1b60: e4a10b8a be4a58a3 752129da 9740436d 99dbaa47 a22fb0d9 28d3b449 4b08de6b
1b80: 6512ebfd 7d241aea 9722bb51 1ca0dd67 8eebd1d0 53422926 18a64574 a63a6130
1ba0: 4fa1c117 991088a0 bbc4b3f9 ccdddf88 4de68efd 0343e8da 33758a91 bbe05699
1bc0: 7da4f2c3 97c38b79 33db1fc2 fd37b215 98d12240 8bc17e1d 328b79cf 38373a92
1be0: 0401fc60 e10b4b3d fb9c30a9 6d50f24e 0e92da22 91fde1ef 2215e7a6 350c7aa0
1c00: b707e11d 53d52bef cb34ef16 5943beb7 ee3b5485 d27e94ed 9bb9b97c 0416bf14
1c20: 35c97273 886e57c0 74597512 204fbecb 95a47d82 05acf560 5dc80218 eed727b3
1c40: 98ad1230 be618101 7f03d265 67bf0d42 bc8e22f4 598e19f9 280f88ab bc43db27
1c60: 01661951 c0100c38 caa7f2c0 c0073e18 00000000 80000093 00000010 60000013
1c80: caa91dd8 caa82200 caa91fb0 c03e0b48 caa91cbc c0236440 c03e0b48 00000010
1ca0: 60000013 2cea1d42 ebe6c396 8f464dc1 bb530136 0a981c42 c0236440 0000000a
1cc0: 00000010 caa91ce6 caa91dd8 0000000a caa91d14 caa91ce0 c02365d4 c0236468
1ce0: ffff0000 00000001 caa82380 0018d9b5 caa91dd8 caa90000 caa82380 00000000
1d00: caa82200 ca9ea200 caa91d2c caa91d18 c0236720 c0236568 00000000 bea4af78
1d20: caa91e14 caa91d30 c01544d0 c02366f8 00001812 00000000 00000000 00000000
1d40: 00000014 c012ee9c 00000000 c011b15c caa90000 00000000 00008000 00000001
1d60: 00000000 ca979840 0018d9b5 001b8f3c 00009e00 00000000 00008000 00184690
1d80: 0018d000 0018d9b5 00000080 c0132350 00000080 c01e22c4 caa91db4 00000006
1da0: c01e22c4 00184690 caa91dec 0018d9b5 00000006 c01e22a8 0018d000 00000080
1dc0: c01e0368 00000002 bea4af78 bea4af68 00008000 c03daed8 c03e7220 ca9ea200
1de0: caa91e0c caa91d64 c0116224 fffffff8 00000000 c03db3e8 c0153978 c03daed8
1e00: c03e7220 ca9ea200 caa91e54 caa91e18 c011b15c c0153984 caa91fb0 ca9ea202
1e20: 00000001 00000000 c011be64 ca9ea200 caa91fb0 caa91e58 c0151bd0 c03daed8
1e40: c03e7220 ca9ea200 caa91efc caa91e58 c0151e0c c011b0c0 6e69622f 0068732f
1e60: 00000010 caa91ecc 00000000 00000001 ca9ea200 bec8dc08 00000010 ca811000
1e80: caa91eb4 caa91e90 c00fb5b8 c00fb20c 00000017 caa91ecc 00000000 c00fb568
1ea0: 00000001 caa90000 caa91eec caa91eb8 c011c478 c00fb568 00000001 00000001
1ec0: caa91ecc c0056e84 00000f94 caa91e4c beffff84 fffffffe ca9ea202 00000000
1ee0: fffffff8 fffffff8 00000000 c03db3c8 caa91f3c caa91f00 c011b15c c0151bdc
1f00: caa91fb0 ca9ea202 00000000 00000000 001b9fc0 00000000 ca9ea200 00000001
1f20: caa91fb0 c011c86c 001b9fc0 ca811000 caa91f84 caa91f40 c011ca98 c011b0c0
1f40: bec8dc40 c043e538 caa91fb0 bec8dc08 c004d048 00000000 caa91f84 ca811000
1f60: bec8dc08 001b9fc0 caa91fb0 c004d048 caa90000 00000000 caa91fa4 caa91f88
1f80: c00509dc c011c828 bec8dc08 001b9fc0 bec8dc40 0000000b 00000000 caa91fa8
1fa0: c004ce40 c00509a4 bec8dc08 001b9fc0 bec8dc40 bec8dc08 001b9fc0 bec8dc40
1fc0: bec8dc08 001b9fc0 bec8dc40 0000000b bec8dc0c 00000000 00000000 bec8dc04
1fe0: 7ef8fefe bec8dbc0 000d2050 000d1cdc a0000010 bec8dc40 00000000 00000000
Backtrace: 
[<c0235f90>] (mix_pool_bytes_extract+0x0/0x1d0) from [<c02364e4>] (extract_buf+0x88/0x100)
[<c023645c>] (extract_buf+0x0/0x100) from [<c02365d4>] (extract_entropy+0x78/0xac)
 r8:0000000a r7:caa91dd8 r6:caa91ce6 r5:00000010 r4:0000000a
[<c023655c>] (extract_entropy+0x0/0xac) from [<c0236720>] (get_random_bytes+0x34/0x40)
[<c02366ec>] (get_random_bytes+0x0/0x40) from [<c01544d0>] (load_elf_binary+0xb58/0x1420)
[<c0153978>] (load_elf_binary+0x0/0x1420) from [<c011b15c>] (search_binary_handler+0xa8/0x300)
[<c011b0b4>] (search_binary_handler+0x0/0x300) from [<c0151e0c>] (load_script+0x23c/0x250)
[<c0151bd0>] (load_script+0x0/0x250) from [<c011b15c>] (search_binary_handler+0xa8/0x300)
 r6:c03db3c8 r5:00000000 r4:fffffff8
[<c011b0b4>] (search_binary_handler+0x0/0x300) from [<c011ca98>] (do_execve+0x27c/0x324)
[<c011c81c>] (do_execve+0x0/0x324) from [<c00509dc>] (sys_execve+0x44/0x64)
[<c0050998>] (sys_execve+0x0/0x64) from [<c004ce40>] (ret_fast_syscall+0x0/0x30)
 r7:0000000b r6:bec8dc40 r5:001b9fc0 r4:bec8dc08
Code: e08a3001 e7956104 e0000009 e0033009 (e795410c) 
---[ end trace b9eb0704bc1e1f70 ]---
rcS used greatest stack depth: 4664 bytes left

Please press Enter to activate this console. 
/ # 
/ # 
/ # 
/ # 
/ # 
/ # 
/ # ls

Please press Enter to activate this console. 
/ # ls
bin      dev      lib      mnt      proc     sbin     tmp      var
debug    etc      linuxrc  opt      root     sys      usr
/ # 
/ # Unable to handle kernel paging request at virtual address 00001888
pgd = c0004000
[00001888] *pgd=00000000
Internal error: Oops: 80000007 [#2]
last sysfs file: 
Modules linked in:
CPU: 0    Tainted: G      D      (2.6.37 #1)
PC is at 0x1888
LR is at 0x1889
pc : [<00001888>]    lr : [<00001889>]    psr: 20000033
sp : caa81bac  ip : 00000000  fp : caa81c2c
r10: 00001889  r9 : ca8b5010  r8 : 00001889
r7 : 00000000  r6 : 000005b4  r5 : 00000000  r4 : ca8b5218
r3 : 000005b4  r2 : 000005b4  r1 : fffffa4c  r0 : 00000001
Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA Thumb  Segment kernel
Control: 10c5387d  Table: 8aaa4019  DAC: 00000017
Process jffs2_gcd_mtd8 (pid: 36, stack limit = 0xcaa802e8)
Stack: (0xcaa81bac to 0xcaa82000)
1ba0:                            ca814000 ca8b5218 c02834b8 c0281a48 ca8b5218
1bc0: 00000000 00000000 0000024c 0000003f 00000001 000005b4 00000000 00000040
1be0: 00000000 ca814000 00000000 00000000 00000000 00000000 00000000 00000000
1c00: 00000000 000005b4 ca8b5010 00c44a4c 00000000 ca8b5218 00000000 ca8b5010
1c20: caa81c5c caa81c30 c0283b38 c02832e8 ca8b540c 00000000 00000000 009c0000
1c40: 00000000 00284a4c 00000000 ca9e2000 caa81cb4 caa81c60 c026fd3c c0283a9c
1c60: 000005b4 caa81d60 ca814000 c01822a4 000000ff 00000000 00000000 00000000
1c80: 00000000 00000000 caa81d64 caa81d60 000005b4 00284a4c 00000000 ca814000
1ca0: caa72520 ca9e3000 caa81d04 caa81cb8 c018f218 c026fcb8 000005b4 caa81d60
1cc0: ca814000 c0110d10 ca9e311c caa81cd8 c0110d10 c010e858 caa81d64 caa81d60
1ce0: 000005b4 00284a4c 00000800 ca814000 caa72520 caa72518 caa81d94 caa81d08
1d00: c01842d4 c018f1b8 000005b4 caa81d60 ca814000 caa81d20 caa81d50 caa81da4
1d20: ca9ee800 ca9e3000 ca814044 ca814028 caa80000 000005b4 caa81d54 00000000
1d40: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 ca9ee800
1d60: ca9e3000 c01839bc caa81d94 ca9ee800 ca9ee800 00000200 caa81f18 c0185b00
1d80: ca9e3000 ca982fe0 caa81e14 caa81d98 c0185bb0 c0183f00 00000000 60000013
1da0: 00000000 40000113 00000000 ca9e32f8 ca9e3000 ca9e3304 ca9e3304 00000084
1dc0: caa81ddc caa81dd0 c009e5c4 c0204690 caa81e14 caa81de0 c0191130 c009e5b8
1de0: ca9e331c c03ce2d8 c03e6d00 ca982fe0 00000001 ca9e3000 caa81f18 ca9e3000
1e00: ca9e302c 00000084 caa81f14 caa81e18 c018a0e4 c0185ad4 00000000 c03b6000
1e20: caa81e54 caa81e30 c02bc2d0 c0047008 c03b601c ca97db00 00000017 caa7b180
1e40: c03ce2d8 c03e6d00 caa81e6c caa81e58 c02bc364 c02b83bc 00000000 c03b9038
1e60: caa81eac caa81e70 c02b83bc c0078654 caa81e9c c03da870 c03ba8bc ca97dd24
1e80: 00000001 40000113 a0000013 c02b8910 40000113 a0000013 c0411400 ffff996e
1ea0: caa81f04 caa81eb0 c02b8910 c0087468 caa80000 ffff9969 caa81edc 00000000
1ec0: 00200200 ffff996e c0411400 c0089564 ca97db00 c0089f84 caa80000 caa80000
1ee0: caa81f04 caa81ef0 c0089f84 40000113 caa80000 ca9e3000 caa81f18 00000001
1f00: 00000000 00000084 caa81fbc caa81f18 c018ce2c c0189f38 00000001 00000000
1f20: 00000080 00000000 00000000 aaaaaaaa aaaaaaaa aaaaaaaa c02bc2d0 c0047008
1f40: ca83e01c ca97db00 00000017 c03da870 c03ce2d8 c03e6d00 caa81f7c caa81f68
1f60: c02bc364 c02b83bc 00000000 ca83c000 caa81fbc caa81f80 c02b83bc c0078654
1f80: c018ccc4 c03da870 c03ba8bc 00000000 caa81fbc caa81fcc caa81fcc ca83fcf0
1fa0: ca9e3000 c018ccc4 00000000 00000000 caa81ff4 caa81fc0 c0099048 c018ccd0
1fc0: ca83fcf0 00000000 ca9e3000 00000000 caa81fd0 caa81fd0 ca83fcf0 c0098fac
1fe0: c007e6ec 00000013 00000000 caa81ff8 c007e6ec c0098fb8 00000000 00000000
Backtrace: 
[<c02832dc>] (nand_do_read_ops+0x0/0x454) from [<c0283b38>] (nand_read+0xa8/0xc4)
[<c0283a90>] (nand_read+0x0/0xc4) from [<c026fd3c>] (part_read+0x90/0x118)
 r8:ca9e2000 r7:00000000 r6:00284a4c r5:00000000 r4:009c0000
[<c026fcac>] (part_read+0x0/0x118) from [<c018f218>] (jffs2_flash_read+0x6c/0x2a0)
[<c018f1ac>] (jffs2_flash_read+0x0/0x2a0) from [<c01842d4>] (jffs2_do_read_inode_internal+0x3e0/0x1bd4)
[<c0183ef4>] (jffs2_do_read_inode_internal+0x0/0x1bd4) from [<c0185bb0>] (jffs2_do_crccheck_inode+0xe8/0x120)
[<c0185ac8>] (jffs2_do_crccheck_inode+0x0/0x120) from [<c018a0e4>] (jffs2_garbage_collect_pass+0x1b8/0x1850)
[<c0189f2c>] (jffs2_garbage_collect_pass+0x0/0x1850) from [<c018ce2c>] (jffs2_garbage_collect_thread+0x168/0x180)
[<c018ccc4>] (jffs2_garbage_collect_thread+0x0/0x180) from [<c0099048>] (kthread+0x9c/0xa0)
[<c0098fac>] (kthread+0x0/0xa0) from [<c007e6ec>] (do_exit+0x0/0x75c)
 r7:00000013 r6:c007e6ec r5:c0098fac r4:ca83fcf0
Code: bad PC value
---[ end trace b9eb0704bc1e1f71 ]---

/ # 
/ #

Anatoly

0 Pavel Botev over 10 years ago in reply to Anatoly Goldstein

TI__Guru**** 170625 points

mem=176M

Memory: 176MB = 176MB total

May be you are running out of memory. Can you try with providing more than 176MB memory to the linux kernel memory manager.

Are you using the ARAGO rootfs?
ti-ezsdk_dm814x-evm_5_04_00_11/filesystem/arago-base-tisdk-image-dm814x-evm.tar.gz

Can you try with other rootfs, not only with JFFS2? You can try with UBIFS, NFS, ext3 (MMC/SD), Ramdisk initrd, etc

Unable to handle kernel paging request at virtual address

Check if you are trying to access physical address directly. You’ll need to map the physically memory to virtual memory using linux kernal ioremap system call. See usb-musb.c for how the usb physical registers are map using ioremap

otg_base = ioremap(OMAP34XX_HSUSB_OTG_BASE, SZ_4K);

__raw_readl(otg_base + OTG_SYSSTATUS)))

Regards,
Pavel

0 Anatoly Goldstein over 10 years ago in reply to Pavel Botev

Intellectual 530 points

Hi, Pavel.

Just wanted to update you that we found the problem. Operating voltage of CPU was too low. After increasing voltage kernel crashes disappeared.

Regards,
Anatoly

Processors

Processors forum

AM3874 - Linux 2.6.37 kernel hangs during boot process