Increased CPU load (100%) since update - caused by "univention-appcenter-listener-converter"

Hi all,

since l have updated owncloud to version 10.4.1 last Wednesday, I see now an increased CPU-Load by 100% (nothing critical yet).
CPU-Usage

I dont think this related to owncloud itself, but when I run top and ps I see 2 suspicious processes that I havent noticed before.
univention-appc load
and

htop

“univention-appcenter-listener-converter owncloud” - what is this doing?
Any hint for how to dig deeper here or to troubleshoot this would be much appreciated.

BR
Thomas

I did the update on Tuesday. Same experience.
Anmerkung 2020-09-04 085708

Hi,

I was able to reproduce this in my UCS test environment, right after updating ownCloud to version 10.4.1 a new process is starting over and over again in a loop - It starts, causes high CPU load and then ends (every 5 seconds).

This python script seems to be the culprit: “usr/bin/python2.7 /usr/share/univention-appcenter-listener-converter owncloud

top

As I am not the only one affected by this it would be great if someone from UCS staff could have a look.

thx and BR,
Thomas

1 Like

please let me know, if I can provide additional infos (e.g. log-files) for the analysis - I’d be happy to do so.

I have filed a bug for this now:
https://forge.univention.org/bugzilla/show_bug.cgi?id=52000

1 Like

Hello,

thank you for bringing this up. What does the logfile /var/log/univention/listener_modules/owncloud.log say?

And are there other apps affected, like for example OpenProject or itslearning Connector?

Best regards,
Nico

Hello Nico,

thx for you reply.

Prod-System:
/var/log/univention/listener_modules/owncloud.log is full with this 2 records (logged every 5 seconds):

2020-09-16 17:09:24 INFO Using App account connection
2020-09-16 17:09:24 INFO EntryUUID 97d7d956-c86f-1037-94ec-572fc949ef04 not found
2020-09-16 17:09:30 INFO Using App account connection
2020-09-16 17:09:31 INFO EntryUUID 97d7d956-c86f-1037-94ec-572fc949ef04 not found
2020-09-16 17:09:37 INFO Using App account connection
2020-09-16 17:09:38 INFO EntryUUID 97d7d956-c86f-1037-94ec-572fc949ef04 not found
2020-09-16 17:09:44 INFO Using App account connection
2020-09-16 17:09:44 INFO EntryUUID 97d7d956-c86f-1037-94ec-572fc949ef04 not found
2020-09-16 17:09:51 INFO Using App account connection
2020-09-16 17:09:51 INFO EntryUUID 97d7d956-c86f-1037-94ec-572fc949ef04 not found

Test-System:
2020-09-11 08:44:03 INFO Using App account connection
2020-09-11 08:44:04 INFO conversion of uid=ucs-sso,cn=users,dc=xxxxx-tst,dc=intranet (id: 1d4fcfce-0aab-103a-8ef7-13b68f9793cf, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-743900.json)
2020-09-11 08:44:04 INFO conversion of uid=join-slave,cn=users,dc=xxxxx-tst,dc=intranet (id: bc303b0c-0aaa-103a-9ad1-4d21bee079d1, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-757021.json)
2020-09-11 08:44:04 INFO conversion of uid=testuser_1,cn=users,dc=xxxxx-tst,dc=intranet (id: 82ad194c-0ab2-103a-82bd-7fc1bb327b83, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-758839.json)
2020-09-11 08:44:04 INFO conversion of uid=testuser_2,cn=users,dc=xxxxx-tst,dc=intranet (id: a23af1f8-0ab2-103a-82cf-7fc1bb327b83, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-760982.json)
2020-09-11 08:44:04 INFO conversion of uid=join-backup,cn=users,dc=xxxxx-tst,dc=intranet (id: bbeffaba-0aaa-103a-9abf-4d21bee079d1, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-763060.json)
2020-09-11 08:44:04 INFO conversion of uid=Administrator,cn=users,dc=xxxxx-tst,dc=intranet (id: aac8602e-0aaa-103a-9a1a-4d21bee079d1, file: /var/lib/univention-appcenter/apps/owncloud/data/listener/2020-09-11-08-44-02-765027.json)
2020-09-11 08:44:05 INFO Success! Removing consumed files

univention-app info (prod):

UCS: 4.4-5 errata737

Installed: adconnector=12.0 fetchmail=6.3.26 kde=5.8 kopano-core=8.7.1.0-1 kopano-webapp=3.5.14.2539-2 kopano-webmeetings=3.0.1.100 letsencrypt=1.2.2-8 onlyoffice-ds=5.6.3.2 owncloud=10.4.1 samba-memberserver=4.7 z-push-kopano=2.4.5 4.3/guacamole=0.9.13-univention14

univention-app info (test system):

UCS: 4.4-5 errata750

Installed: bareos=18.2.7 bluespice=3.1.9-ucs.1 fetchmail=6.3.26 kopano-core=8.7.1.0-1 kopano-meet=2.2.3_0-1 kopano-webapp=3.5.14.2539-2 nagios=4.3 onlyoffice-ds=5.6.2.2 owncloud=10.4.1 rocketchat=3.5.3 wordpress=5.2.3 z-push-kopano=2.4.5 4.3/openid-connect-provider=2.0-konnect-0.33.3

On both systmes only “listener-converter owncloud” is showing this behavior.

Please let me know if there is more information I could provide (e.g. log files).

I will also update the ticket accordingly: (https://forge.univention.org/bugzilla/show_bug.cgi?id=52000)

Best regards,
Thomas

update: I have also deployed OpenProject from the App-Center on my test-system and it shows the same behavior:

top

Hello @tpfann,

thank you very much for providing more information.

Does the listener.log for OpenProject show the same “EntryUUID … not found” lines as for ownCloud?

Best regards,
Nico

Hello Nico,

the “EntryUUID … not found” I can see only on my production system (needs to be fixed also but I dont think this is the root cause).

Nevertheless „listener-converters“ (owncloud AND openproject) are causing high load on my test system as well (identical to prod-system).

Please find attached to the bugzilla-ticket the listener.logs from my test envrionment.

Best regards
Thomas