alonedriver
Posts: 5
Joined: Mon Mar 11, 2019 5:10 pm

Ras3 crashes after update

Mon Mar 11, 2019 5:16 pm

Regular update results in an unrecoverable crash in system... today.

The following packages will be upgraded:
libopenjp2-7 raspi-copies-and-fills
2 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 117 kB of archives.
After this operation, 6,144 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.raspberrypi.org/debian stretch/main armhf raspi-copies-and-fills armhf 0.8 [8,520 B]
Get:2 http://mirrors.pidginhost.com/raspbian/raspbian stretch/main armhf libopenjp2-7 armhf 2.1.2-1.1+deb9u3 [108 kB]
Fetched 117 kB in 11s (10.5 kB/s)
Reading changelogs... Done
(Reading database ... 158545 files and directories currently installed.)
Preparing to unpack .../libopenjp2-7_2.1.2-1.1+deb9u3_armhf.deb ...
Unpacking libopenjp2-7:armhf (2.1.2-1.1+deb9u3) over (2.1.2-1.1+deb9u2) ...
Preparing to unpack .../raspi-copies-and-fills_0.8_armhf.deb ...
Unpacking raspi-copies-and-fills (0.8) over (0.6) ...
Setting up libopenjp2-7:armhf (2.1.2-1.1+deb9u3) ...
Setting up raspi-copies-and-fills (0.8) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
dpkg: error processing package libc-bin (--configure):
subprocess installed post-installation script was killed by signal (Segmentation fault)
dpkg: error: error executing hook 'if { test "$DPKG_HOOK_ACTION" = add-architecture || test "$DPKG_HOOK_ACTION" = remove-architecture; } && test -x /usr/share/pkg-config-dpkghook; then /usr/share/pkg-config-dpkghook update; fi', exit code 11
Usage:
glib20.mo [OPTION…]

sh: 1: 34:ln=01: not found
sh: 1: 36:mh=00:pi=40: not found
sh: 1: 33:so=01: not found
sh: 1: 35:do=01: not found
sh: 1: 35:bd=40: not found
sh: 1: 33: not found
sh: 1: 01:cd=40: not found
sh: 1: 33: not found
sh: 1: 01:or=40: not found
sh: 1: 31: not found
sh: 1: 01:mi=00:su=37: not found
sh: 1: 41:sg=30: not found
sh: 1: 43:ca=30: not found
sh: 1: 41:tw=30: not found
sh: 1: 42:ow=34: not found
sh: 1: 42:st=37: not found
sh: 1: 44:ex=01: not found
sh: 1: 32:*.tar=01: not found
sh: 1: 31:*.tgz=01: not found
sh: 1: 31:*.arc=01: not found
sh: 1: 31:*.arj=01: not found
sh: 1: 31:*.taz=01: not found
sh: 1: 31:*.lha=01: not found
sh: 1: 31:*.lz4=01: not found
sh: 1: 31:*.lzh=01: not found
sh: 1: 31:*.lzma=01: not found
sh: 1: 31:*.tlz=01: not found
sh: 1: 31:*.txz=01: not found
sh: 1: 31:*.tzo=01: not found
sh: 1: 31:*.t7z=01: not found
sh: 1: 31:*.zip=01: not found
sh: 1: 31:*.z=01: not found
sh: 1: 31:*.Z=01: not found
sh: 1: 31:*.dz=01: not found
sh: 1: 31:*.gz=01: not found
sh: 1: 31:*.lrz=01: not found
sh: 1: 31:*.lz=01: not found
sh: 1: 31:*.lzo=01: not found
sh: 1: 31:*.xz=01: not found
sh: 1: 31:*.zst=01: not found
sh: 1: 31:*.tzst=01: not found
sh: 1: 31:*.bz2=01: not found
sh: 1: 31:*.bz=01: not found
sh: 1: 31:*.tbz=01: not found
sh: 1: 31:*.tbz2=01: not found
sh: 1: 31:*.tz=01: not found
sh: 1: 31:*.deb=01: not found
sh: 1: 31:*.rpm=01: not found
sh: 1: 31:*.jar=01: not found
sh: 1: 31:*.war=01: not found
sh: 1: 31:*.ear=01: not found
sh: 1: 31:*.sar=01: not found
sh: 1: 31:*.rar=01: not found
sh: 1: 31:*.alz=01: not found
sh: 1: 31:*.ace=01: not found
sh: 1: 31:*.zoo=01: not found
sh: 1: 31:*.cpio=01: not found
sh: 1: 31:*.7z=01: not found
sh: 1: 31:*.rz=01: not found
sh: 1: 31:*.cab=01: not found
sh: 1: 31:*.jpg=01: not found
sh: 1: 35:*.jpeg=01: not found
sh: 1: 35:*.mjpg=01: not found
sh: 1: 35:*.mjpeg=01: not found
sh: 1: 35:*.gif=01: not found
sh: 1: 35:*.bmp=01: not found
sh: 1: 35:*.pbm=01: not found
sh: 1: 35:*.pgm=01: not found
sh: 1: 35:*.ppm=01: not found
sh: 1: 35:*.tga=01: not found
sh: 1: 35:*.xbm=01: not found
sh: 1: 35:*.xpm=01: not found
sh: 1: 35:*.tif=01: not found
sh: 1: 35:*.tiff=01: not found
sh: 1: 35:*.png=01: not found
sh: 1: 35:*.svg=01: not found
sh: 1: 35:*.svgz=01: not found
sh: 1: 35:*.mng=01: not found
sh: 1: 35:*.pcx=01: not found
sh: 1: 35:*.mov=01: not found
sh: 1: 35:*.mpg=01: not found
sh: 1: 35:*.mpeg=01: not found
sh: 1: 35:*.m2v=01: not found
sh: 1: 35:*.mkv=01: not found
sh: 1: 35:*.webm=01: not found
sh: 1: 35:*.ogm=01: not found
sh: 1: 35:*.mp4=01: not found
sh: 1: 35:*.m4v=01: not found
sh: 1: 35:*.mp4v=01: not found
sh: 1: 35:*.vob=01: not found
sh: 1: 35:*.qt=01: not found
sh: 1: 35:*.nuv=01: not found
sh: 1: 35:*.wmv=01: not found
sh: 1: 35:*.asf=01: not found
sh: 1: 35:*.rm=01: not found
sh: 1: 35:*.rmvb=01: not found
sh: 1: 35:*.flc=01: not found
sh: 1: 35:*.avi=01: not found
sh: 1: 35:*.fli=01: not found
sh: 1: 35:*.flv=01: not found
sh: 1: 35:*.gl=01: not found
sh: 1: 35:*.dl=01: not found
sh: 1: 35:*.xcf=01: not found
sh: 1: 35:*.xwd=01: not found
sh: 1: 35:*.yuv=01: not found
sh: 1: 35:*.cgm=01: not found
sh: 1: 35:*.emf=01: not found
sh: 1: 35:*.ogv=01: not found
sh: 1: 35:*.ogx=01: not found
sh: 1: 35:*.aac=00: not found
sh: 1: 36:*.au=00: not found
sh: 1: 36:*.flac=00: not found
sh: 1: 36:*.m4a=00: not found
sh: 1: 36:*.mid=00: not found
sh: 1: 36:*.midi=00: not found
sh: 1: 36:*.mka=00: not found
sh: 1: 36:*.mp3=00: not found
sh: 1: 36:*.mpc=00: not found
sh: 1: 36:*.ogg=00: not found
sh: 1: 36:*.ra=00: not found
sh: 1: 36:*.wav=00: not found
sh: 1: 36:*.oga=00: not found
sh: 1: 36:*.opus=00: not found
sh: 1: 36:*.spx=00: not found
sh: 1: 36:*.xspf=00: not found
sh: 1: 36:: not found
E: Sub-process /usr/bin/dpkg returned an error code (2)
E: Problem executing scripts DPkg::Post-Invoke '/usr/bin/test -e /usr/share/dbus-1/system-services/org.freedesktop.PackageKit.service && /usr/bin/test -S /var/run/dbus/system_bus_socket && /usr/bin/gdbus call --system --dest org.freedesktop.PackageKit --object-path /org/freedesktop/PackageKit --timeout 4 --method org.freedesktop.PackageKit.StateHasChanged cache-update > /dev/null; /bin/echo > /dev/null'
E: Sub-process returned an error code

trying to reboot not working...
reboot
Failed to connect to bus: Invalid argument��vP��(��vH������vP����L`�v-=[

Tried the update in 2 machines failes both.

Hard reboot does not help... crash in booting sequence.

ANY IDEAS or HELP?

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:17 pm

Note to other users: DO NOT UPGRADE

I'm doing my best to have the update pulled ASAP.

If you can, take the card out and remove /etc/ld.so.preload . That should get you back into a working state.

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:21 pm

Okay, the responsible package has been removed. That was a serious mistake on my behalf and I apologise. Really can't test things enough.

I hope not many others have been bitten by this.

alonedriver
Posts: 5
Joined: Mon Mar 11, 2019 5:10 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:30 pm

i have no physical access to the machines, just remote access... any ideas?

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:37 pm

Oh no, that's the worst case scenario.

If you can remove /etc/ld.so.preload, you may be able to recover it, but I had no luck trying that without taking the card out.

alonedriver
Posts: 5
Joined: Mon Mar 11, 2019 5:10 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:39 pm

No luck...

If there is any ideas just post them... unfortunately machines are sitting thousands km away...

alonedriver
Posts: 5
Joined: Mon Mar 11, 2019 5:10 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:42 pm

can i overwrite that file from vnc viewer somehow / transfer a working file or something like that?
or edit something else?

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 5:59 pm

rm is one of the simplest things to run, so if that doesn't work, I don't think anything else will. Everything I tried resulted in corrupted memory and segfaults.

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 6:10 pm

Try "LD_PRELOAD=/usr/lib/arm-linux-gnueabihf/libarmmem-v6l.so sudo rm /etc/ld.so.preload"

v6 version seems to be fine and LD_PRELOAD should take precedence over ld.so.preload, so maybe that will work.

User avatar
DougieLawson
Posts: 42382
Joined: Sun Jun 16, 2013 11:19 pm
Location: A small cave in deepest darkest Basingstoke, UK

Re: Ras3 crashes after update

Mon Mar 11, 2019 6:35 pm

Wow! I'd just got to libarmmem.so being the problem when I found this thread. Only broke four out of eighteen raspberries.
Languages using left-hand whitespace for syntax are ridiculous

DMs sent on https://twitter.com/DougieLawson or LinkedIn will be answered next month.
Fake doctors - are all on my foes list.

The use of crystal balls and mind reading is prohibited.

rpbit
Posts: 11
Joined: Mon Mar 11, 2019 7:53 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 11:08 pm

I was also affected by this update, see viewtopic.php?f=28&t=235600&p=1440779.

But it still shows up on my other Raspis, is it safe to update now?

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 11:20 pm

version 0.10 should be safe.

rpbit
Posts: 11
Joined: Mon Mar 11, 2019 7:53 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 11:25 pm

ok, all fine now.

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Mon Mar 11, 2019 11:26 pm

Again, sorry about that.

User avatar
DougieLawson
Posts: 42382
Joined: Sun Jun 16, 2013 11:19 pm
Location: A small cave in deepest darkest Basingstoke, UK

Re: Ras3 crashes after update

Tue Mar 12, 2019 5:50 am

ShiftPlusOne wrote:
Mon Mar 11, 2019 11:26 pm
Again, sorry about that.
No problem. You found the problem before I'd shot 16 out of 18 raspberries dead. The hardest fix was my weather station - it's out of doors and I had to dismantle the case to get the SDCard back into the slot.

The sudo rm /etc/ld.so.preload fix is easy enough.

The best thing was when I was fsck'ing one of the hard drives I found some archived SDCard images that I'd forgotten about but contain something I was looking for after my NAS had a catastrophic HD failure. "Clouds and silver linings."
Languages using left-hand whitespace for syntax are ridiculous

DMs sent on https://twitter.com/DougieLawson or LinkedIn will be answered next month.
Fake doctors - are all on my foes list.

The use of crystal balls and mind reading is prohibited.

pmunts
Posts: 7
Joined: Fri Nov 08, 2013 7:19 pm

Re: Ras3 crashes after update

Wed Mar 13, 2019 8:38 am

raspi-copies-and-fills version 0.10 breaks the Subversion command line client with existing checkouts. I had to manually downgrade to 0.5-1 to get Subversion working again.

With 0.10 svn status --no-ignore generates a lot of this:

! S python/Make/modularity/GPIO.py
! S python/Make/modularity/MeArm.py
! S python/Make/modularity/ZeroMQ.odt
! S python/Make/modularity/ZeroMQ.pdf
! S python/Make/modularity/bar
! S python/Make/modularity/cgi-bin
! S python/Make/modularity/client1.py
! S python/Make/modularity/client2.py
! S python/Make/modularity/client3.py
! S python/Make/modularity/client_lights.py
! S python/Make/modularity/foo
! S python/Make/modularity/server1.py
! S python/Make/modularity/server2.py
! S python/Make/modularity/server3.py
! S python/Make/modularity/server_lights.py
! S python/Make/modularity/test1.py
! S python/Make/modularity/test2.py
! S python/Make/modularity/test_robot.py
! S python/Make/modularity/webserver
! S python/Make/modularity/webserver.odt
! S python/Make/modularity/webserver.pdf
! S python/Make/modularity/zmq

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Wed Mar 13, 2019 4:46 pm

pmunts wrote:
Wed Mar 13, 2019 8:38 am
raspi-copies-and-fills version 0.10 breaks the Subversion command line client with existing checkouts. I had to manually downgrade to 0.5-1 to get Subversion working again.

With 0.10 svn status --no-ignore generates a lot of this:

! S python/Make/modularity/GPIO.py
! S python/Make/modularity/MeArm.py
! S python/Make/modularity/ZeroMQ.odt
! S python/Make/modularity/ZeroMQ.pdf
! S python/Make/modularity/bar
! S python/Make/modularity/cgi-bin
! S python/Make/modularity/client1.py
! S python/Make/modularity/client2.py
! S python/Make/modularity/client3.py
! S python/Make/modularity/client_lights.py
! S python/Make/modularity/foo
! S python/Make/modularity/server1.py
! S python/Make/modularity/server2.py
! S python/Make/modularity/server3.py
! S python/Make/modularity/server_lights.py
! S python/Make/modularity/test1.py
! S python/Make/modularity/test2.py
! S python/Make/modularity/test_robot.py
! S python/Make/modularity/webserver
! S python/Make/modularity/webserver.odt
! S python/Make/modularity/webserver.pdf
! S python/Make/modularity/zmq
Having trouble reproducing this one. I checked out a random repo and ran the command you gave.

If you go to 0.10 and comment out the line in /etc/ld.so.preload, does the problem go away? Do you have reliable steps to reproduce the issue?

rayjoh
Posts: 27
Joined: Thu May 23, 2013 11:48 am

Re: Ras3 crashes after update

Wed Mar 13, 2019 6:01 pm

ShiftPlusOne wrote:
Wed Mar 13, 2019 4:46 pm
pmunts wrote:
Wed Mar 13, 2019 8:38 am
raspi-copies-and-fills version 0.10 breaks the Subversion command line client with existing checkouts. I had to manually downgrade to 0.5-1 to get Subversion working again.
Having trouble reproducing this one. I checked out a random repo and ran the command you gave.

If you go to 0.10 and comment out the line in /etc/ld.so.preload, does the problem go away? Do you have reliable steps to reproduce the issue?
Removing /etc/ld.so.preload cured my problem with subversion
-- Raymond

deathkid535
Posts: 1
Joined: Wed Mar 13, 2019 11:12 pm

Re: Ras3 crashes after update

Wed Mar 13, 2019 11:31 pm

Version 0.10 also seems to break some Plex functionality.

Code: Select all

LD_PRELOAD=/usr/lib/arm-linux-gnueabihf/libarmmem-v6l.so sudo rm /etc/ld.so.preload
Worked for me but I imagine there are quite a lot confused users out there who don't know about this. You might want to look into it.

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Thu Mar 14, 2019 12:18 am

Kodi devs are also reporting issues. We'll roll back. Thanks, everyone.

JAW206
Posts: 1
Joined: Thu Mar 14, 2019 5:42 am

Re: Ras3 crashes after update

Thu Mar 14, 2019 5:47 am

deathkid535 wrote:
Wed Mar 13, 2019 11:31 pm
Version 0.10 also seems to break some Plex functionality.

Code: Select all

LD_PRELOAD=/usr/lib/arm-linux-gnueabihf/libarmmem-v6l.so sudo rm /etc/ld.so.preload
Worked for me but I imagine there are quite a lot confused users out there who don't know about this. You might want to look into it.
Hello, what exactly does this command do? I am new to Linux in general and while it fixed the problem with my Plex server, after running this command the /var/lib/plexmediaserver folder seems to have gone missing.

rpbit
Posts: 11
Joined: Mon Mar 11, 2019 7:53 pm

Re: Ras3 crashes after update

Thu Mar 14, 2019 6:07 pm

I would like to add that raspi-copies-and-fills seems to also "break" Chromium in a weird way.

If i type an url into chromium and hit enter i almost always get directed to the default search engine which shows me the results for that url. This is not the case if i don't update to the latest raspi-copies-and-fills. And this update is still available today. So i would recommend to stay away from that specific package (i put it on hold via sudo apt-mark hold raspi-copies-and-fills on all my raspis).

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Thu Mar 14, 2019 8:20 pm

What a mess :(

0.11 is out, rolling everything back to as it was in 0.6.

User avatar
davidcoton
Posts: 6960
Joined: Mon Sep 01, 2014 2:37 pm
Location: Cambridge, UK

Re: Ras3 crashes after update

Thu Mar 14, 2019 8:58 pm

ShiftPlusOne wrote:
Thu Mar 14, 2019 8:20 pm
What a mess :(

0.11 is out, rolling everything back to as it was in 0.6.
You can take pride in this...
When your stuff breaks, it does it big time. :lol:
Location: 345th cell on the right of the 210th row of L2 cache

User avatar
ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6394
Joined: Fri Jul 29, 2011 5:36 pm

Re: Ras3 crashes after update

Thu Mar 14, 2019 9:09 pm

davidcoton wrote:
Thu Mar 14, 2019 8:58 pm
ShiftPlusOne wrote:
Thu Mar 14, 2019 8:20 pm
What a mess :(

0.11 is out, rolling everything back to as it was in 0.6.
You can take pride in this...
When your stuff breaks, it does it big time. :lol:
That's true. If nobody has to travel thousands of kilometres to fix it, why even bother. :oops:

Return to “Troubleshooting”