Hello
My sun8i-a83t-bananapi-m3 does not boot anymore in BE.
Others sunxi platform I have seems not affected (a10, a20, a64, h3, h5, h6)
I have bisected this problem:
git bisect start
# bad: [98d54f81e36ba3bf92172791eba5ca5bd813989b] Linux 5.6-rc4
git bisect bad 98d54f81e36ba3bf92172791eba5ca5bd813989b
# bad: [d5226fa6dbae0569ee43ecfc08bdcd6770fc4755] Linux 5.5
git bisect bad d5226fa6dbae0569ee43ecfc08bdcd6770fc4755
# good: [219d54332a09e8d8741c1e1982f5eae56099de85] Linux 5.4
git bisect good 219d54332a09e8d8741c1e1982f5eae56099de85
# bad: [8c39f71ee2019e77ee14f88b1321b2348db51820] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
git bisect bad 8c39f71ee2019e77ee14f88b1321b2348db51820
# bad: [3b397c7ccafe0624018cb09fc96729f8f6165573] Merge tag 'regmap-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regmap
git bisect bad 3b397c7ccafe0624018cb09fc96729f8f6165573
# good: [924ea58dadea23cc28b60d02b9c0896b7b168a6f] Merge tag 'mt76-for-kvalo-2019-11-20' of https://github.com/nbd168/wireless
git bisect good 924ea58dadea23cc28b60d02b9c0896b7b168a6f
# good: [3f3c8be973af10875cfa1e7b85a535b6ba76b44f] Merge tag 'for-linus-5.5a-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip
git bisect good 3f3c8be973af10875cfa1e7b85a535b6ba76b44f
# bad: [642356cb5f4a8c82b5ca5ebac288c327d10df236] Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
git bisect bad 642356cb5f4a8c82b5ca5ebac288c327d10df236
# good: [57d8154f15e89f53dfb412f4ed32ebe3c3d755a0] crypto: atmel-aes - Change data type for "lastc" buffer
git bisect good 57d8154f15e89f53dfb412f4ed32ebe3c3d755a0
# bad: [752272f16dd18f2cac58a583a8673c8e2fb93abb] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm
git bisect bad 752272f16dd18f2cac58a583a8673c8e2fb93abb
# good: [9477f4449b0b011ce1d058c09ec450bfcdaab784] KVM: VMX: Add helper to check reserved bits in IA32_PERF_GLOBAL_CTRL
git bisect good 9477f4449b0b011ce1d058c09ec450bfcdaab784
# bad: [cd7056ae34af0e9424da97bbc7d2b38246ba8a2c] Merge remote-tracking branch 'kvmarm/misc-5.5' into kvmarm/next
git bisect bad cd7056ae34af0e9424da97bbc7d2b38246ba8a2c
# bad: [c7892db5dd6afe921ead502aff7440a1e450d947] KVM: arm64: Select TASK_DELAY_ACCT+TASKSTATS rather than SCHEDSTATS
git bisect bad c7892db5dd6afe921ead502aff7440a1e450d947
# bad: [8564d6372a7d8a6d440441b8ed8020f97f744450] KVM: arm64: Support stolen time reporting via shared structure
git bisect bad 8564d6372a7d8a6d440441b8ed8020f97f744450
# bad: [55009c6ed2d24fc0f5521ab2482f145d269389ea] KVM: arm/arm64: Factor out hypercall handling from PSCI code
git bisect bad 55009c6ed2d24fc0f5521ab2482f145d269389ea
# bad: [6a7458485b390f48e481fcd4a0b20e6c5c843d2e] KVM: arm64: Document PV-time interface
git bisect bad 6a7458485b390f48e481fcd4a0b20e6c5c843d2e
# bad: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
git bisect bad dcac930e9901d765234bc15004db4f7d4416db71
# first bad commit: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
But bisect lead to a merge request.
Regards
On 03/03/2020 7:43 am, Corentin Labbe wrote:
> Hello
>
> My sun8i-a83t-bananapi-m3 does not boot anymore in BE.
> Others sunxi platform I have seems not affected (a10, a20, a64, h3, h5, h6)
>
> I have bisected this problem:
> git bisect start
> # bad: [98d54f81e36ba3bf92172791eba5ca5bd813989b] Linux 5.6-rc4
> git bisect bad 98d54f81e36ba3bf92172791eba5ca5bd813989b
> # bad: [d5226fa6dbae0569ee43ecfc08bdcd6770fc4755] Linux 5.5
> git bisect bad d5226fa6dbae0569ee43ecfc08bdcd6770fc4755
> # good: [219d54332a09e8d8741c1e1982f5eae56099de85] Linux 5.4
> git bisect good 219d54332a09e8d8741c1e1982f5eae56099de85
> # bad: [8c39f71ee2019e77ee14f88b1321b2348db51820] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
> git bisect bad 8c39f71ee2019e77ee14f88b1321b2348db51820
> # bad: [3b397c7ccafe0624018cb09fc96729f8f6165573] Merge tag 'regmap-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regmap
> git bisect bad 3b397c7ccafe0624018cb09fc96729f8f6165573
> # good: [924ea58dadea23cc28b60d02b9c0896b7b168a6f] Merge tag 'mt76-for-kvalo-2019-11-20' of https://github.com/nbd168/wireless
> git bisect good 924ea58dadea23cc28b60d02b9c0896b7b168a6f
> # good: [3f3c8be973af10875cfa1e7b85a535b6ba76b44f] Merge tag 'for-linus-5.5a-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip
> git bisect good 3f3c8be973af10875cfa1e7b85a535b6ba76b44f
> # bad: [642356cb5f4a8c82b5ca5ebac288c327d10df236] Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
> git bisect bad 642356cb5f4a8c82b5ca5ebac288c327d10df236
> # good: [57d8154f15e89f53dfb412f4ed32ebe3c3d755a0] crypto: atmel-aes - Change data type for "lastc" buffer
> git bisect good 57d8154f15e89f53dfb412f4ed32ebe3c3d755a0
> # bad: [752272f16dd18f2cac58a583a8673c8e2fb93abb] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm
> git bisect bad 752272f16dd18f2cac58a583a8673c8e2fb93abb
> # good: [9477f4449b0b011ce1d058c09ec450bfcdaab784] KVM: VMX: Add helper to check reserved bits in IA32_PERF_GLOBAL_CTRL
> git bisect good 9477f4449b0b011ce1d058c09ec450bfcdaab784
> # bad: [cd7056ae34af0e9424da97bbc7d2b38246ba8a2c] Merge remote-tracking branch 'kvmarm/misc-5.5' into kvmarm/next
> git bisect bad cd7056ae34af0e9424da97bbc7d2b38246ba8a2c
> # bad: [c7892db5dd6afe921ead502aff7440a1e450d947] KVM: arm64: Select TASK_DELAY_ACCT+TASKSTATS rather than SCHEDSTATS
> git bisect bad c7892db5dd6afe921ead502aff7440a1e450d947
> # bad: [8564d6372a7d8a6d440441b8ed8020f97f744450] KVM: arm64: Support stolen time reporting via shared structure
> git bisect bad 8564d6372a7d8a6d440441b8ed8020f97f744450
> # bad: [55009c6ed2d24fc0f5521ab2482f145d269389ea] KVM: arm/arm64: Factor out hypercall handling from PSCI code
> git bisect bad 55009c6ed2d24fc0f5521ab2482f145d269389ea
> # bad: [6a7458485b390f48e481fcd4a0b20e6c5c843d2e] KVM: arm64: Document PV-time interface
> git bisect bad 6a7458485b390f48e481fcd4a0b20e6c5c843d2e
> # bad: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
> git bisect bad dcac930e9901d765234bc15004db4f7d4416db71
> # first bad commit: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
>
> But bisect lead to a merge request.
FWIW once you've bisected to a merge commit, you can always then try
bisecting down the merged branch itself (i.e. between 5.4-rc3 and
e6ea46511b1a in this case) to narrow things down further.
Given that that branch is supposed to be a functionally-inert cleanup,
and (judging by the DTS) this platform apparently isn't using PSCI
anyway, it does seem a bit odd. Can you get any earlycon/earlyprintk
output to suggest what the actual cause of the boot failure is?
Robin.
On Tue, Mar 03, 2020 at 01:47:02PM +0000, Robin Murphy wrote:
> On 03/03/2020 7:43 am, Corentin Labbe wrote:
> > Hello
> >
> > My sun8i-a83t-bananapi-m3 does not boot anymore in BE.
> > Others sunxi platform I have seems not affected (a10, a20, a64, h3, h5, h6)
> >
> > I have bisected this problem:
> > git bisect start
> > # bad: [98d54f81e36ba3bf92172791eba5ca5bd813989b] Linux 5.6-rc4
> > git bisect bad 98d54f81e36ba3bf92172791eba5ca5bd813989b
> > # bad: [d5226fa6dbae0569ee43ecfc08bdcd6770fc4755] Linux 5.5
> > git bisect bad d5226fa6dbae0569ee43ecfc08bdcd6770fc4755
> > # good: [219d54332a09e8d8741c1e1982f5eae56099de85] Linux 5.4
> > git bisect good 219d54332a09e8d8741c1e1982f5eae56099de85
> > # bad: [8c39f71ee2019e77ee14f88b1321b2348db51820] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
> > git bisect bad 8c39f71ee2019e77ee14f88b1321b2348db51820
> > # bad: [3b397c7ccafe0624018cb09fc96729f8f6165573] Merge tag 'regmap-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regmap
> > git bisect bad 3b397c7ccafe0624018cb09fc96729f8f6165573
> > # good: [924ea58dadea23cc28b60d02b9c0896b7b168a6f] Merge tag 'mt76-for-kvalo-2019-11-20' of https://github.com/nbd168/wireless
> > git bisect good 924ea58dadea23cc28b60d02b9c0896b7b168a6f
> > # good: [3f3c8be973af10875cfa1e7b85a535b6ba76b44f] Merge tag 'for-linus-5.5a-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip
> > git bisect good 3f3c8be973af10875cfa1e7b85a535b6ba76b44f
> > # bad: [642356cb5f4a8c82b5ca5ebac288c327d10df236] Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
> > git bisect bad 642356cb5f4a8c82b5ca5ebac288c327d10df236
> > # good: [57d8154f15e89f53dfb412f4ed32ebe3c3d755a0] crypto: atmel-aes - Change data type for "lastc" buffer
> > git bisect good 57d8154f15e89f53dfb412f4ed32ebe3c3d755a0
> > # bad: [752272f16dd18f2cac58a583a8673c8e2fb93abb] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm
> > git bisect bad 752272f16dd18f2cac58a583a8673c8e2fb93abb
> > # good: [9477f4449b0b011ce1d058c09ec450bfcdaab784] KVM: VMX: Add helper to check reserved bits in IA32_PERF_GLOBAL_CTRL
> > git bisect good 9477f4449b0b011ce1d058c09ec450bfcdaab784
> > # bad: [cd7056ae34af0e9424da97bbc7d2b38246ba8a2c] Merge remote-tracking branch 'kvmarm/misc-5.5' into kvmarm/next
> > git bisect bad cd7056ae34af0e9424da97bbc7d2b38246ba8a2c
> > # bad: [c7892db5dd6afe921ead502aff7440a1e450d947] KVM: arm64: Select TASK_DELAY_ACCT+TASKSTATS rather than SCHEDSTATS
> > git bisect bad c7892db5dd6afe921ead502aff7440a1e450d947
> > # bad: [8564d6372a7d8a6d440441b8ed8020f97f744450] KVM: arm64: Support stolen time reporting via shared structure
> > git bisect bad 8564d6372a7d8a6d440441b8ed8020f97f744450
> > # bad: [55009c6ed2d24fc0f5521ab2482f145d269389ea] KVM: arm/arm64: Factor out hypercall handling from PSCI code
> > git bisect bad 55009c6ed2d24fc0f5521ab2482f145d269389ea
> > # bad: [6a7458485b390f48e481fcd4a0b20e6c5c843d2e] KVM: arm64: Document PV-time interface
> > git bisect bad 6a7458485b390f48e481fcd4a0b20e6c5c843d2e
> > # bad: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
> > git bisect bad dcac930e9901d765234bc15004db4f7d4416db71
> > # first bad commit: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
> >
> > But bisect lead to a merge request.
>
> FWIW once you've bisected to a merge commit, you can always then try
> bisecting down the merged branch itself (i.e. between 5.4-rc3 and
> e6ea46511b1a in this case) to narrow things down further.
>
> Given that that branch is supposed to be a functionally-inert cleanup,
> and (judging by the DTS) this platform apparently isn't using PSCI
> anyway, it does seem a bit odd. Can you get any earlycon/earlyprintk
> output to suggest what the actual cause of the boot failure is?
>
Hello
With earlycon I got:
bootz 0x42000000 0x43300000 0x43000000
## Loading init Ramdisk from Legacy Image at 43300000 ...
Image Name:
Image Type: ARM Linux RAMDisk Image (uncompressed)
Data Size: 32397255 Bytes = 30.9 MiB
Load Address: 00000000
Entry Point: 00000000
Verifying Checksum ... OK
## Flattened Device Tree blob at 43000000
Booting using the fdt blob at 0x43000000
Using Device Tree in place at 43000000, end 43008f07
Starting kernel ...
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 5.6.0-rc4 (compile@Red) (gcc version 8.3.0 (Gentoo 8.3.0-r1 p1.1)) #21 SMP Tue Mar 3 15:07:20 CET 2020
[ 0.000000] CPU: ARMv7 Processor [410fc075] revision 5 (ARMv7), cr=12c5387d
[ 0.000000] CPU: div instructions available: patching division code
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[ 0.000000] OF: fdt: Machine model: Banana Pi BPI-M3
[ 0.000000] earlycon: uart0 at MMIO32 0x01c28000 (options '')
[ 0.000000] printk: bootconsole [uart0] enabled
[ 0.000000] Memory policy: Data cache writealloc
[ 0.000000] cma: Reserved 16 MiB at 0xbf000000
[ 0.000000] percpu: Embedded 15 pages/cpu s31320 r8192 d21928 u61440
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 522752
[ 0.000000] Kernel command line: console=ttyS0,115200n8 root=/dev/ram0 earlycon=uart,mmio32,0x01c28000 ip=dhcp
[ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] Memory: 2019352K/2097152K available (7168K kernel code, 485K rwdata, 2832K rodata, 1024K init, 248K bss, 61416K reserved, 16384K cma-reserved, 1294336K highmem)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.000000] rcu: Hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] random: get_random_bytes called from start_kernel+0x2a4/0x440 with crng_init=0
[ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (virt).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
[ 0.000008] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
[ 0.008636] Switching to timer-based delay loop, resolution 41ns
[ 0.015439] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[ 0.025876] Console: colour dummy device 80x30
[ 0.030743] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=240000)
[ 0.041927] pid_max: default: 32768 minimum: 301
[ 0.047093] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.055003] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.064553] CPU: Testing write buffer coherency: ok
[ 0.070534] /cpus/cpu@0 missing clock-frequency property
[ 0.076282] /cpus/cpu@1 missing clock-frequency property
[ 0.082071] /cpus/cpu@2 missing clock-frequency property
[ 0.087816] /cpus/cpu@3 missing clock-frequency property
[ 0.093560] /cpus/cpu@100 missing clock-frequency property
[ 0.099498] /cpus/cpu@101 missing clock-frequency property
[ 0.105441] /cpus/cpu@102 missing clock-frequency property
[ 0.111363] /cpus/cpu@103 missing clock-frequency property
[ 0.117292] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[ 0.124164] Setting up static identity map for 0x40100000 - 0x40100060
[ 0.131496] ARM CCI driver probed
[ 0.135832] sunxi multi cluster SMP support installed
[ 0.141784] rcu: Hierarchical SRCU implementation.
[ 0.147537] smp: Bringing up secondary CPUs ...
I will try to redo the bisect
On 03/03/2020 2:21 pm, Corentin Labbe wrote:
> On Tue, Mar 03, 2020 at 01:47:02PM +0000, Robin Murphy wrote:
>> On 03/03/2020 7:43 am, Corentin Labbe wrote:
>>> Hello
>>>
>>> My sun8i-a83t-bananapi-m3 does not boot anymore in BE.
>>> Others sunxi platform I have seems not affected (a10, a20, a64, h3, h5, h6)
>>>
>>> I have bisected this problem:
>>> git bisect start
>>> # bad: [98d54f81e36ba3bf92172791eba5ca5bd813989b] Linux 5.6-rc4
>>> git bisect bad 98d54f81e36ba3bf92172791eba5ca5bd813989b
>>> # bad: [d5226fa6dbae0569ee43ecfc08bdcd6770fc4755] Linux 5.5
>>> git bisect bad d5226fa6dbae0569ee43ecfc08bdcd6770fc4755
>>> # good: [219d54332a09e8d8741c1e1982f5eae56099de85] Linux 5.4
>>> git bisect good 219d54332a09e8d8741c1e1982f5eae56099de85
>>> # bad: [8c39f71ee2019e77ee14f88b1321b2348db51820] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
>>> git bisect bad 8c39f71ee2019e77ee14f88b1321b2348db51820
>>> # bad: [3b397c7ccafe0624018cb09fc96729f8f6165573] Merge tag 'regmap-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regmap
>>> git bisect bad 3b397c7ccafe0624018cb09fc96729f8f6165573
>>> # good: [924ea58dadea23cc28b60d02b9c0896b7b168a6f] Merge tag 'mt76-for-kvalo-2019-11-20' of https://github.com/nbd168/wireless
>>> git bisect good 924ea58dadea23cc28b60d02b9c0896b7b168a6f
>>> # good: [3f3c8be973af10875cfa1e7b85a535b6ba76b44f] Merge tag 'for-linus-5.5a-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip
>>> git bisect good 3f3c8be973af10875cfa1e7b85a535b6ba76b44f
>>> # bad: [642356cb5f4a8c82b5ca5ebac288c327d10df236] Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
>>> git bisect bad 642356cb5f4a8c82b5ca5ebac288c327d10df236
>>> # good: [57d8154f15e89f53dfb412f4ed32ebe3c3d755a0] crypto: atmel-aes - Change data type for "lastc" buffer
>>> git bisect good 57d8154f15e89f53dfb412f4ed32ebe3c3d755a0
>>> # bad: [752272f16dd18f2cac58a583a8673c8e2fb93abb] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm
>>> git bisect bad 752272f16dd18f2cac58a583a8673c8e2fb93abb
>>> # good: [9477f4449b0b011ce1d058c09ec450bfcdaab784] KVM: VMX: Add helper to check reserved bits in IA32_PERF_GLOBAL_CTRL
>>> git bisect good 9477f4449b0b011ce1d058c09ec450bfcdaab784
>>> # bad: [cd7056ae34af0e9424da97bbc7d2b38246ba8a2c] Merge remote-tracking branch 'kvmarm/misc-5.5' into kvmarm/next
>>> git bisect bad cd7056ae34af0e9424da97bbc7d2b38246ba8a2c
>>> # bad: [c7892db5dd6afe921ead502aff7440a1e450d947] KVM: arm64: Select TASK_DELAY_ACCT+TASKSTATS rather than SCHEDSTATS
>>> git bisect bad c7892db5dd6afe921ead502aff7440a1e450d947
>>> # bad: [8564d6372a7d8a6d440441b8ed8020f97f744450] KVM: arm64: Support stolen time reporting via shared structure
>>> git bisect bad 8564d6372a7d8a6d440441b8ed8020f97f744450
>>> # bad: [55009c6ed2d24fc0f5521ab2482f145d269389ea] KVM: arm/arm64: Factor out hypercall handling from PSCI code
>>> git bisect bad 55009c6ed2d24fc0f5521ab2482f145d269389ea
>>> # bad: [6a7458485b390f48e481fcd4a0b20e6c5c843d2e] KVM: arm64: Document PV-time interface
>>> git bisect bad 6a7458485b390f48e481fcd4a0b20e6c5c843d2e
>>> # bad: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
>>> git bisect bad dcac930e9901d765234bc15004db4f7d4416db71
>>> # first bad commit: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
>>>
>>> But bisect lead to a merge request.
>>
>> FWIW once you've bisected to a merge commit, you can always then try
>> bisecting down the merged branch itself (i.e. between 5.4-rc3 and
>> e6ea46511b1a in this case) to narrow things down further.
>>
>> Given that that branch is supposed to be a functionally-inert cleanup,
>> and (judging by the DTS) this platform apparently isn't using PSCI
>> anyway, it does seem a bit odd. Can you get any earlycon/earlyprintk
>> output to suggest what the actual cause of the boot failure is?
>>
>
> Hello
>
> With earlycon I got:
>
> bootz 0x42000000 0x43300000 0x43000000
> ## Loading init Ramdisk from Legacy Image at 43300000 ...
> Image Name:
> Image Type: ARM Linux RAMDisk Image (uncompressed)
> Data Size: 32397255 Bytes = 30.9 MiB
> Load Address: 00000000
> Entry Point: 00000000
> Verifying Checksum ... OK
> ## Flattened Device Tree blob at 43000000
> Booting using the fdt blob at 0x43000000
> Using Device Tree in place at 43000000, end 43008f07
> Starting kernel ...
> [ 0.000000] Booting Linux on physical CPU 0x0
> [ 0.000000] Linux version 5.6.0-rc4 (compile@Red) (gcc version 8.3.0 (Gentoo 8.3.0-r1 p1.1)) #21 SMP Tue Mar 3 15:07:20 CET 2020
> [ 0.000000] CPU: ARMv7 Processor [410fc075] revision 5 (ARMv7), cr=12c5387d
> [ 0.000000] CPU: div instructions available: patching division code
> [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
> [ 0.000000] OF: fdt: Machine model: Banana Pi BPI-M3
> [ 0.000000] earlycon: uart0 at MMIO32 0x01c28000 (options '')
> [ 0.000000] printk: bootconsole [uart0] enabled
> [ 0.000000] Memory policy: Data cache writealloc
> [ 0.000000] cma: Reserved 16 MiB at 0xbf000000
> [ 0.000000] percpu: Embedded 15 pages/cpu s31320 r8192 d21928 u61440
> [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 522752
> [ 0.000000] Kernel command line: console=ttyS0,115200n8 root=/dev/ram0 earlycon=uart,mmio32,0x01c28000 ip=dhcp
> [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
> [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
> [ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
> [ 0.000000] Memory: 2019352K/2097152K available (7168K kernel code, 485K rwdata, 2832K rodata, 1024K init, 248K bss, 61416K reserved, 16384K cma-reserved, 1294336K highmem)
> [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
> [ 0.000000] rcu: Hierarchical RCU implementation.
> [ 0.000000] rcu: RCU event tracing is enabled.
> [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
> [ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
> [ 0.000000] random: get_random_bytes called from start_kernel+0x2a4/0x440 with crng_init=0
> [ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (virt).
> [ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
> [ 0.000008] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
> [ 0.008636] Switching to timer-based delay loop, resolution 41ns
> [ 0.015439] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
> [ 0.025876] Console: colour dummy device 80x30
> [ 0.030743] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=240000)
> [ 0.041927] pid_max: default: 32768 minimum: 301
> [ 0.047093] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
> [ 0.055003] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
> [ 0.064553] CPU: Testing write buffer coherency: ok
> [ 0.070534] /cpus/cpu@0 missing clock-frequency property
> [ 0.076282] /cpus/cpu@1 missing clock-frequency property
> [ 0.082071] /cpus/cpu@2 missing clock-frequency property
> [ 0.087816] /cpus/cpu@3 missing clock-frequency property
> [ 0.093560] /cpus/cpu@100 missing clock-frequency property
> [ 0.099498] /cpus/cpu@101 missing clock-frequency property
> [ 0.105441] /cpus/cpu@102 missing clock-frequency property
> [ 0.111363] /cpus/cpu@103 missing clock-frequency property
> [ 0.117292] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
> [ 0.124164] Setting up static identity map for 0x40100000 - 0x40100060
> [ 0.131496] ARM CCI driver probed
> [ 0.135832] sunxi multi cluster SMP support installed
> [ 0.141784] rcu: Hierarchical SRCU implementation.
> [ 0.147537] smp: Bringing up secondary CPUs ...
>
> I will try to redo the bisect
Hmm, if there was a horribly subtle endianness/uninitialised data bug
(or combination thereof) that led to somehow falling into the middle of
the PSCI or spectre code and issuing a spurious SMC/HVC to non-existent
firmware at secondary bringup, it might well look exactly like that...
If different values of CONFIG_PSCI and CONFIG_HARDEN_BRANCH_PREDICTOR
make any difference to a failing build then that might lend weight to
that theory. Assuming the initial bisection is reliable then
6848253ddeae and/or a5520eac4d2d would seem like the most likely
suspects for perturbing whatever subtlety is at play in this case.
Robin.
On Tue, Mar 03, 2020 at 05:50:20PM +0000, Robin Murphy wrote:
> On 03/03/2020 2:21 pm, Corentin Labbe wrote:
> > On Tue, Mar 03, 2020 at 01:47:02PM +0000, Robin Murphy wrote:
> >> On 03/03/2020 7:43 am, Corentin Labbe wrote:
> >>> Hello
> >>>
> >>> My sun8i-a83t-bananapi-m3 does not boot anymore in BE.
> >>> Others sunxi platform I have seems not affected (a10, a20, a64, h3, h5, h6)
> >>>
> >>> I have bisected this problem:
> >>> git bisect start
> >>> # bad: [98d54f81e36ba3bf92172791eba5ca5bd813989b] Linux 5.6-rc4
> >>> git bisect bad 98d54f81e36ba3bf92172791eba5ca5bd813989b
> >>> # bad: [d5226fa6dbae0569ee43ecfc08bdcd6770fc4755] Linux 5.5
> >>> git bisect bad d5226fa6dbae0569ee43ecfc08bdcd6770fc4755
> >>> # good: [219d54332a09e8d8741c1e1982f5eae56099de85] Linux 5.4
> >>> git bisect good 219d54332a09e8d8741c1e1982f5eae56099de85
> >>> # bad: [8c39f71ee2019e77ee14f88b1321b2348db51820] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net
> >>> git bisect bad 8c39f71ee2019e77ee14f88b1321b2348db51820
> >>> # bad: [3b397c7ccafe0624018cb09fc96729f8f6165573] Merge tag 'regmap-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regmap
> >>> git bisect bad 3b397c7ccafe0624018cb09fc96729f8f6165573
> >>> # good: [924ea58dadea23cc28b60d02b9c0896b7b168a6f] Merge tag 'mt76-for-kvalo-2019-11-20' of https://github.com/nbd168/wireless
> >>> git bisect good 924ea58dadea23cc28b60d02b9c0896b7b168a6f
> >>> # good: [3f3c8be973af10875cfa1e7b85a535b6ba76b44f] Merge tag 'for-linus-5.5a-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/xen/tip
> >>> git bisect good 3f3c8be973af10875cfa1e7b85a535b6ba76b44f
> >>> # bad: [642356cb5f4a8c82b5ca5ebac288c327d10df236] Merge git://git.kernel.org/pub/scm/linux/kernel/git/herbert/crypto-2.6
> >>> git bisect bad 642356cb5f4a8c82b5ca5ebac288c327d10df236
> >>> # good: [57d8154f15e89f53dfb412f4ed32ebe3c3d755a0] crypto: atmel-aes - Change data type for "lastc" buffer
> >>> git bisect good 57d8154f15e89f53dfb412f4ed32ebe3c3d755a0
> >>> # bad: [752272f16dd18f2cac58a583a8673c8e2fb93abb] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/virt/kvm/kvm
> >>> git bisect bad 752272f16dd18f2cac58a583a8673c8e2fb93abb
> >>> # good: [9477f4449b0b011ce1d058c09ec450bfcdaab784] KVM: VMX: Add helper to check reserved bits in IA32_PERF_GLOBAL_CTRL
> >>> git bisect good 9477f4449b0b011ce1d058c09ec450bfcdaab784
> >>> # bad: [cd7056ae34af0e9424da97bbc7d2b38246ba8a2c] Merge remote-tracking branch 'kvmarm/misc-5.5' into kvmarm/next
> >>> git bisect bad cd7056ae34af0e9424da97bbc7d2b38246ba8a2c
> >>> # bad: [c7892db5dd6afe921ead502aff7440a1e450d947] KVM: arm64: Select TASK_DELAY_ACCT+TASKSTATS rather than SCHEDSTATS
> >>> git bisect bad c7892db5dd6afe921ead502aff7440a1e450d947
> >>> # bad: [8564d6372a7d8a6d440441b8ed8020f97f744450] KVM: arm64: Support stolen time reporting via shared structure
> >>> git bisect bad 8564d6372a7d8a6d440441b8ed8020f97f744450
> >>> # bad: [55009c6ed2d24fc0f5521ab2482f145d269389ea] KVM: arm/arm64: Factor out hypercall handling from PSCI code
> >>> git bisect bad 55009c6ed2d24fc0f5521ab2482f145d269389ea
> >>> # bad: [6a7458485b390f48e481fcd4a0b20e6c5c843d2e] KVM: arm64: Document PV-time interface
> >>> git bisect bad 6a7458485b390f48e481fcd4a0b20e6c5c843d2e
> >>> # bad: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
> >>> git bisect bad dcac930e9901d765234bc15004db4f7d4416db71
> >>> # first bad commit: [dcac930e9901d765234bc15004db4f7d4416db71] Merge remote-tracking branch 'arm64/for-next/smccc-conduit-cleanup' into kvm-arm64/stolen-time
> >>>
> >>> But bisect lead to a merge request.
> >>
> >> FWIW once you've bisected to a merge commit, you can always then try
> >> bisecting down the merged branch itself (i.e. between 5.4-rc3 and
> >> e6ea46511b1a in this case) to narrow things down further.
> >>
> >> Given that that branch is supposed to be a functionally-inert cleanup,
> >> and (judging by the DTS) this platform apparently isn't using PSCI
> >> anyway, it does seem a bit odd. Can you get any earlycon/earlyprintk
> >> output to suggest what the actual cause of the boot failure is?
> >>
> >
> > Hello
> >
> > With earlycon I got:
> >
> > bootz 0x42000000 0x43300000 0x43000000
> > ## Loading init Ramdisk from Legacy Image at 43300000 ...
> > Image Name:
> > Image Type: ARM Linux RAMDisk Image (uncompressed)
> > Data Size: 32397255 Bytes = 30.9 MiB
> > Load Address: 00000000
> > Entry Point: 00000000
> > Verifying Checksum ... OK
> > ## Flattened Device Tree blob at 43000000
> > Booting using the fdt blob at 0x43000000
> > Using Device Tree in place at 43000000, end 43008f07
> > Starting kernel ...
> > [ 0.000000] Booting Linux on physical CPU 0x0
> > [ 0.000000] Linux version 5.6.0-rc4 (compile@Red) (gcc version 8.3.0 (Gentoo 8.3.0-r1 p1.1)) #21 SMP Tue Mar 3 15:07:20 CET 2020
> > [ 0.000000] CPU: ARMv7 Processor [410fc075] revision 5 (ARMv7), cr=12c5387d
> > [ 0.000000] CPU: div instructions available: patching division code
> > [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
> > [ 0.000000] OF: fdt: Machine model: Banana Pi BPI-M3
> > [ 0.000000] earlycon: uart0 at MMIO32 0x01c28000 (options '')
> > [ 0.000000] printk: bootconsole [uart0] enabled
> > [ 0.000000] Memory policy: Data cache writealloc
> > [ 0.000000] cma: Reserved 16 MiB at 0xbf000000
> > [ 0.000000] percpu: Embedded 15 pages/cpu s31320 r8192 d21928 u61440
> > [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 522752
> > [ 0.000000] Kernel command line: console=ttyS0,115200n8 root=/dev/ram0 earlycon=uart,mmio32,0x01c28000 ip=dhcp
> > [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
> > [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
> > [ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
> > [ 0.000000] Memory: 2019352K/2097152K available (7168K kernel code, 485K rwdata, 2832K rodata, 1024K init, 248K bss, 61416K reserved, 16384K cma-reserved, 1294336K highmem)
> > [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
> > [ 0.000000] rcu: Hierarchical RCU implementation.
> > [ 0.000000] rcu: RCU event tracing is enabled.
> > [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
> > [ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
> > [ 0.000000] random: get_random_bytes called from start_kernel+0x2a4/0x440 with crng_init=0
> > [ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (virt).
> > [ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
> > [ 0.000008] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
> > [ 0.008636] Switching to timer-based delay loop, resolution 41ns
> > [ 0.015439] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
> > [ 0.025876] Console: colour dummy device 80x30
> > [ 0.030743] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=240000)
> > [ 0.041927] pid_max: default: 32768 minimum: 301
> > [ 0.047093] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
> > [ 0.055003] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
> > [ 0.064553] CPU: Testing write buffer coherency: ok
> > [ 0.070534] /cpus/cpu@0 missing clock-frequency property
> > [ 0.076282] /cpus/cpu@1 missing clock-frequency property
> > [ 0.082071] /cpus/cpu@2 missing clock-frequency property
> > [ 0.087816] /cpus/cpu@3 missing clock-frequency property
> > [ 0.093560] /cpus/cpu@100 missing clock-frequency property
> > [ 0.099498] /cpus/cpu@101 missing clock-frequency property
> > [ 0.105441] /cpus/cpu@102 missing clock-frequency property
> > [ 0.111363] /cpus/cpu@103 missing clock-frequency property
> > [ 0.117292] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
> > [ 0.124164] Setting up static identity map for 0x40100000 - 0x40100060
> > [ 0.131496] ARM CCI driver probed
> > [ 0.135832] sunxi multi cluster SMP support installed
> > [ 0.141784] rcu: Hierarchical SRCU implementation.
> > [ 0.147537] smp: Bringing up secondary CPUs ...
> >
> > I will try to redo the bisect
>
> Hmm, if there was a horribly subtle endianness/uninitialised data bug
> (or combination thereof) that led to somehow falling into the middle of
> the PSCI or spectre code and issuing a spurious SMC/HVC to non-existent
> firmware at secondary bringup, it might well look exactly like that...
>
> If different values of CONFIG_PSCI and CONFIG_HARDEN_BRANCH_PREDICTOR
> make any difference to a failing build then that might lend weight to
> that theory. Assuming the initial bisection is reliable then
> 6848253ddeae and/or a5520eac4d2d would seem like the most likely
> suspects for perturbing whatever subtlety is at play in this case.
>
Hello
I have tried to disable CONFIG_PSCI and CONFIG_HARDEN_BRANCH_PREDICTOR without any visible change.
Furthermore, the problem seems to happen on random place but replicable.
For example I hit the problem on v5.3 v5.1 and v5.1-rc4 but not on v5.4 v5.2 and v5.0.
But when the kernel boot, at least SMP is still non-functionnal:
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 5.2.0 (compile@Red) (gcc version 8.3.0 (Gentoo 8.3.0-r1 p1.1)) #74 SMP Thu Mar 5 18:16:17 CET 2020
[ 0.000000] CPU: ARMv7 Processor [410fc075] revision 5 (ARMv7), cr=12c5387d
[ 0.000000] CPU: div instructions available: patching division code
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[ 0.000000] OF: fdt: Machine model: Banana Pi BPI-M3
[ 0.000000] earlycon: uart0 at MMIO32 0x01c28000 (options '')
[ 0.000000] printk: bootconsole [uart0] enabled
[ 0.000000] Memory policy: Data cache writealloc
[ 0.000000] cma: Reserved 16 MiB at 0x6f000000
[ 0.000000] percpu: Embedded 16 pages/cpu s35288 r8192 d22056 u65536
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 522752
[ 0.000000] Kernel command line: console=ttyS0,115200n8 root=/dev/ram0 earlycon=uart,mmio32,0x01c28000 ip=dhcp
[ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[ 0.000000] Memory: 2022028K/2097152K available (6144K kernel code, 460K rwdata, 2512K rodata, 1024K init, 243K bss, 58740K reserved, 16384K cma-reserved, 1310720K highmem)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.000000] rcu: Hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] random: get_random_bytes called from start_kernel+0x29c/0x434 with crng_init=0
[ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (virt).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
[ 0.000010] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
[ 0.008648] Switching to timer-based delay loop, resolution 41ns
[ 0.015394] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[ 0.025772] Console: colour dummy device 80x30
[ 0.030645] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=240000)
[ 0.041811] pid_max: default: 32768 minimum: 301
[ 0.046975] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes)
[ 0.054128] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes)
[ 0.062813] CPU: Testing write buffer coherency: ok
[ 0.068770] /cpus/cpu@0 missing clock-frequency property
[ 0.074519] /cpus/cpu@1 missing clock-frequency property
[ 0.080284] /cpus/cpu@2 missing clock-frequency property
[ 0.086015] /cpus/cpu@3 missing clock-frequency property
[ 0.091762] /cpus/cpu@100 missing clock-frequency property
[ 0.097695] /cpus/cpu@101 missing clock-frequency property
[ 0.103626] /cpus/cpu@102 missing clock-frequency property
[ 0.109563] /cpus/cpu@103 missing clock-frequency property
[ 0.115493] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[ 0.122353] Setting up static identity map for 0x40100000 - 0x40100060
[ 0.129704] ARM CCI driver probed
[ 0.133988] sunxi multi cluster SMP support installed
[ 0.139930] rcu: Hierarchical SRCU implementation.
[ 0.145669] smp: Bringing up secondary CPUs ...
[ 1.161271] CPU1: failed to come online
[ 2.201772] CPU2: failed to come online
[ 3.242379] CPU3: failed to come online
[ 4.282996] CPU4: failed to come online
[ 5.323613] CPU5: failed to come online
[ 6.364233] CPU6: failed to come online
[ 7.404842] CPU7: failed to come online
[ 7.409038] smp: Brought up 1 node, 1 CPU
[ 7.413357] SMP: Total of 1 processors activated (48.00 BogoMIPS).
[ 7.420045] CPU: All CPU(s) started in SVC mode.
Sometime(5.3 and v5.4-rc3 for example) instead of behing stuck, it reboot with
BUG: spinlock cpu recursion on CPU#0, swapper/0/0
This replicable alternate of working/non-working is very strange.
I have started to run boot multiple times to be sure it is really replicable (2 3 boots is not enough).