70kopano4ucs join failed

thhoe · November 22, 2018, 6:41am

Hello, everybody,
yesterday I updated my mail server.

root@rohrpostix:~# univention-app info
UCS: 4.3-2 errata331
Installed: benno-mailarchiv=2.4.6 fetchmail=6.3.26 kopano-core=8.6.8.2 kopano-webapp=3.4.22.1782 z-push-kopano=2.4.4
Upgradable:

After the update the Join-Script 70kopano4ucs is pending. The log file says:

RUNNING 70kopano4ucs.inst
2018-11-22 07:07:22.047937873+01:00 (in joinscript_init)
Object exists: cn=services,cn=univention,dc=thhoe,dc=de
Object exists: cn=SMTP,cn=services,cn=univention,dc=thhoe,dc=de
WARNING: cannot append SMTP to service, value exists
No modification: cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de
Object exists: cn=services,cn=univention,dc=thhoe,dc=de
Object exists: cn=IMAP,cn=services,cn=univention,dc=thhoe,dc=de
WARNING: cannot append IMAP to service, value exists
No modification: cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de
Object exists: cn=services,cn=univention,dc=thhoe,dc=de
Object exists: cn=Kopano,cn=services,cn=univention,dc=thhoe,dc=de
WARNING: cannot append Kopano to service, value exists
No modification: cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de
Object exists: ou=Kopano Addresslists,dc=thhoe,dc=de
Object exists: cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopano,dc=thhoe,dc=de
Object exists: cn=contacts,cn=kopano,dc=thhoe,dc=de
Object exists: cn=non-active,cn=kopano,dc=thhoe,dc=de
Object exists: cn=kopano-group,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopano-group-hidden,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopano-group-sendas,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopano-role,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=k4uUserSendAsPrivilege,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=SendAsPrivilege,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopano-user-hidden,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=MRAccept,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=MRProcess,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=MRAcceptConflictingTimes,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=MRAcceptRecurringItems,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=quotaOverride,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=quotaWarn,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=quotaSoft,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=quotaHard,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopanoEnabledFeature,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
Object exists: cn=kopanoDisabledFeature,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
LDAP Error: Undefined attribute type: kopanoMrAcceptRecurring: attribute type undefined

JOINERR:FAILED: /usr/lib/univention-install/70kopano4ucs.inst
EXITCODE=3

What can I do to make the join work?

Thomas

thhoe · November 22, 2018, 7:04am

After my repair attempts, I can’t log on to kopano. Neither at the webapp nor via Outlook.

fbartels · November 22, 2018, 7:33am

that sounds like the ldap schema update was not installed. This should have no impact on kopano-server starting, though.

Which were? Please provide logging of kopano-server: https://wiki.z-hub.io/display/K4U/Debugging+Kopano+on+Univention

thhoe · November 22, 2018, 10:25am

That’s not impossible. I have started the update a 2nd time, because it did not continue with the 1st time. There was no error message, so I didn’t think about it anymore.

At the web interface “ALLE AUSSTEHENDEN JOIN-SKRIPTE AUSFÜHREN” with reboot and “ERNEUT BEITRETEN” with reboot.
I didn’t notice that I could no longer log in until after the second reboot. Probably however it did not go also after the 1., but before.

# exactly installed versions:
ii  kopano-server-packages                              8.6.8.2-0+22.2                                   all          Metapackage to install the entire Kopano Core stack
ii  kopano-webapp                                       3.4.22.1782+80.1                                 all          New and improved WebApp for Kopano
ii  kopano-webapp-plugin-desktopnotifications           2.0.1.6+16.1                                     all          Kopano WebApp Desktop notifications plugin
ii  kopano-webapp-plugin-filepreviewer                  2.0.0.15+11.1                                    all          Kopano File previewer plugin
ii  kopano-webapp-plugin-files                          2.1.4.293+80.1                                   all          Adds Files functionality to Kopano enabling access to WebDAV and other files backends.
ii  kopano-webapp-plugin-filesbackend-owncloud          2.1.0.84+35.1                                    all          Adds Owncloud specific functionality to Kopano Files plugin.
ii  kopano-webapp-plugin-filesbackend-smb               2.1.0.48+28.1                                    all          Adds Samba specific functionality to Kopano Files plugin.
ii  kopano-webapp-plugin-folderwidgets                  3.4.22.1782+80.1                                 all          Kopano WebApp folder widgets plugin
ii  kopano-webapp-plugin-mdm                            2.1.0.97+33.1                                    all          Kopano WebApp MDM plugin
ii  kopano-webapp-plugin-smime                          2.2.0.171+19.1                                   all          Kopano WebApp S/MIME plugin
ii  kopano-webapp-plugin-spell                          2.0.0.17+34.1                                    all          Kopano WebApp Spellchecker plugin
ii  kopano-webapp-plugin-spell-de-de                    2.0.0.3+22.1                                     all          Kopano WebApp Spellchecker German dictionary plugin
ii  kopano-webapp-plugin-spell-en                       2.0.0.1+22.1                                     all          Kopano WebApp Spellchecker English dictionary plugin
ii  kopano-webapp-plugin-spell-nl                       2.0.0.1+23.1                                     all          Kopano WebApp Spellchecker Dutch dictionary plugin
ii  kopano-webapp-plugin-titlecounter                   3.4.22.1782+80.1                                 all          Kopano WebApp Titlecounter plugin
ii  kopano-webapp-plugin-webappmanual                   3.4.22.1782+80.1                                 all          Kopano WebApp Manual plugin
ii  kopano4ucs                                          1.5.13                                           all          Kopano4ucs integration package for Univention Corporate Server
ii  kopano4ucs-lib                                      1.5.13                                           all          Library package for common Kopano4ucs functions
ii  kopano4ucs-schema                                   1.5.13                                           all          LDAP schema for the Kopano4ucs integration
ii  kopano4ucs-udm                                      1.5.13                                           all          UDM extensions for the Kopano4ucs integration
ii  kopano4ucs-webapp                                   1.5.13                                           all          Kopano4ucs kopano-webapp integration package for Univention Corporate Server
ii  kopano4ucs-z-push                                   1.4.18                                           all          Meta package for Z-Push installation
ii  z-push-kopano                                       2.4.4+0-0                                        all          Z-Push for Kopano
ii  z-push-kopano-gabsync                               2.4.4+0-0                                        all          GAB sync for Kopano

# Univention version and installed app versions:

# for kopano-server
journalctl -u kopano-server
-- Reboot --
Nov 22 09:12:55 rohrpostix systemd[1]: Started Kopano Core Storage Server.
Nov 22 09:12:56 rohrpostix kopano-server[1568]: Thu Nov 22 09:12:56 2018: [=======] Starting kopano-server version 8.6.8 (pid 1568)
Nov 22 09:12:56 rohrpostix kopano-server[1568]: Thu Nov 22 09:12:56 2018: [error  ] Coredumps will not be generated: kopano-server requires the fs.suid_dumpable sysctl to contain the value 2, not 0. See kopano-coredump(5) for details.
Nov 22 09:15:04 rohrpostix kopano-server[1568]: Thu Nov 22 09:15:04 2018: [warning] LDAP (simple) bind on cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de failed: Invalid credentials
Nov 22 09:15:04 rohrpostix kopano-server[1568]: Thu Nov 22 09:15:04 2018: [crit   ] Cannot instantiate user plugin: Failure connecting any of the LDAP servers
Nov 22 09:15:04 rohrpostix kopano-server[1568]: Thu Nov 22 09:15:04 2018: [crit   ] Unable to instantiate user plugin

Since then, the log has been full of similar messages:

Nov 22 10:50:39 rohrpostix kopano-server[1568]: Thu Nov 22 10:50:39 2018: [crit   ] Cannot instantiate user plugin: Failure connecting any of the LDAP servers
Nov 22 10:50:39 rohrpostix kopano-server[1568]: Thu Nov 22 10:50:39 2018: [crit   ] Unable to instantiate user plugin
Nov 22 10:50:41 rohrpostix kopano-server[1568]: Thu Nov 22 10:50:41 2018: [warning] LDAP (simple) bind on cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de failed: Invalid credentials
Nov 22 10:50:41 rohrpostix kopano-server[1568]: Thu Nov 22 10:50:41 2018: [crit   ] Cannot instantiate user plugin: Failure connecting any of the LDAP servers
Nov 22 10:50:41 rohrpostix kopano-server[1568]: Thu Nov 22 10:50:41 2018: [crit   ] Unable to instantiate user plugin
Nov 22 11:00:00 rohrpostix kopano-server[1568]: Thu Nov 22 11:00:00 2018: [warning] LDAP (simple) bind on cn=rohrpostix,cn=memberserver,cn=computers,dc=thhoe,dc=de failed: Invalid credentials
Nov 22 11:00:00 rohrpostix kopano-server[1568]: Thu Nov 22 11:00:00 2018: [crit   ] Cannot instantiate user plugin: Failure connecting any of the LDAP servers
Nov 22 11:00:00 rohrpostix kopano-server[1568]: Thu Nov 22 11:00:00 2018: [crit   ] Unable to instantiate user plugin

How should I repair the installation?
I can only think of one “reinstall”.

Thomas

fbartels · November 22, 2018, 10:46am

Hi @thhoe,

that looks like your ldap isn’t running (most likely because the schema update failed). I had that with an earlier upgrade of the integration package, but this was fixed afterwards.

Can you post the output of journalctl -u slapd -n 50?

I have uploaded the previous version of the schema at https://nextcloud.kopano.com/index.php/s/pXMngBiMNysmn8a, a (probable) quick fix would be to replace the version in /var/lib/univention-ldap/local-schema with this one.

I would still be important to understand though, why it failed on your system, but not on the various test systems.

thhoe · November 22, 2018, 12:12pm

Hello,

thank you so much for your support.

root@rohrpostix:~# journalctl -u slapd -n 50
-- No entries --

On another member server the same output is installed.

I’m afraid that hasn’t helped yet.
File changed, reboot, domain-join aborts with error.

LDAP Error: Undefined attribute type: kopanoMrAcceptRecurring: attribute type undefined

__JOINERR__:FAILED: /usr/lib/univention-install/70kopano4ucs.inst


**************************************************************************
* Join failed!                                                           *
* Contact your system administrator                                      *
**************************************************************************
* Message:  Please visit https://help.univention.com/t/8842 for common problems during the join and how to fix them -- FAILED: 70kopano4ucs.inst
**************************************************************************
Thu Nov 22 12:49:17 CET 2018: finish /usr/sbin/univention-join

Auf dem DC-Master ist das selbe Schema installiert.

I rebooted the DC Master. Now the slapd doesn’t run anymore. So the error seems to be caused here.

Thomas

fbartels · November 22, 2018, 12:23pm

then what is logged from slapd on that system?

damrose · November 22, 2018, 12:25pm

Additional question: Which kopano4ucs-schema package version is installed on the DC Master

thhoe · November 22, 2018, 12:55pm

Hello,

The slapd is running again. I had damaged the file /var/lib/univention-ldap/local-schema when comparing.

root@majestix:~# dpkg -l | grep -w kopano4ucs
ii  kopano4ucs-lib                                      1.4.18                                           all          Library package for common Kopano4ucs functions
ii  kopano4ucs-schema                                   1.4.18                                           all          LDAP schema for the Kopano4ucs integration
ii  kopano4ucs-udm                                      1.4.18                                           all          UDM extensions for the Kopano4ucs integration
root@majestix:~#

damrose · November 22, 2018, 1:24pm

Please update the packages on the DC Master and all DC Backups via univention-app install --only-master-packages --do-not-install-master-packages-remotely kopano-core
Then, run the join scripts again.

Logs from that App update would be interesting.
From the server where the update was started (probably your DC master) and the server kopano is installed
/var/log/univention/*appcenter*.log

thhoe · November 22, 2018, 1:43pm

Hello,

OK

same bug

Object exists: cn=kopanoDisabledFeature,cn=kopano,cn=custom attributes,cn=univention,dc=thhoe,dc=de
LDAP Error: Undefined attribute type: kopanoMrAcceptRecurring: attribute type undefined

__JOINERR__:FAILED: /usr/lib/univention-install/70kopano4ucs.inst


**************************************************************************
* Join failed!                                                           *
* Contact your system administrator                                      *
**************************************************************************
* Message:  Please visit https://help.univention.com/t/8842 for common problems during the join and how to fix them -- FAILED: 70kopano4ucs.inst
**************************************************************************
Thu Nov 22 14:37:03 CET 2018: finish /usr/sbin/univention-join

fbartels · November 22, 2018, 1:48pm

I think in this exact moment this could be because the 8.6.8.2 release was taken down because of Mails stuck in queue after todays update to Kopano 8.6.8.2.

thhoe · November 22, 2018, 2:12pm

I changed /var/lib/univention-ldap/local-schema to the member server. Maybe that’s why it still doesn’t work? How can I fix this?

The reason for the update is the new UCS updates. I did the update via the console. First the DC-Master, then DC-Backup and both memberservers at the same time.
The mistake I probably made is the command on the console.

echo -e '\n\nmanuelles Update ueber console \n'`date` >> /var/log/univention/updater.log \
&& screen univention-upgrade --ignoressh --noninteractive  \
&& ucr get update/reboot/required >> /var/log/univention/updater.log \
&& less -N +G /var/log/univention/updater.log

The question if I want to update kopano was not answered, the process was frozen. After that I restarted the update on another console. That something didn’t work was only noticed today.

root@rohrpostix:~# mailq
Mail queue is empty
root@rohrpostix:~#

fbartels · November 22, 2018, 3:40pm

I would ignore the join scripts for now and see that slapd starts again. once that is done you can login to kopano again.

thhoe · November 22, 2018, 3:51pm

I have connected to the Testapp-center and installed the update.
Slapd is running, but I can’t log in to kopano.
The join-script reports the same error again.

damrose · November 22, 2018, 4:35pm

The app was just re-released, package updates should be available on affected systems.

thhoe · November 22, 2018, 4:35pm

In der Systemdiagnose steht:

STDOUT: Warning: 'kopano4ucs' is not configured. 
Error: Not all install files configured: 1 missing

Liegt der Fehler vielleicht hier?

fbartels · November 22, 2018, 8:07pm

Can you post the logging of Kopano-server from such a log in attempt? (and maybe from startup)

thhoe · November 23, 2018, 6:30am

Hello fbartels, hello damrose,

I was able to solve the problem with their clues.
When diagnosing the system (I should have done it as 1.) there was an error with the SSL certificates.
My last steps were:

Disabling the firewall between DC master and mail server, system diagnostics is now without problems.
Update of the DC-Master with the test version, so that the Master and Mailserver are the same version.
Update from /var/lib/univention-ldap/local-schema/kopano4ucs.schema to the mailserver, which I had changed at the beginning.
Execute all outstanding join scripts on the mail server. This time without problems.
Reboot the mail server.

I suspect that the error occurred because the DC master was not actualized during the mail server update. What exactly goes wrong in the firewall I still have to analyze.

Many thanks for the support.

Thomas

Translated with www.DeepL.com/Translator

thhoe · November 23, 2018, 6:56am

Hello,

I was faster than I thought.
I configured the firewall according to this document.
When analyzing the open firewall I noticed that port 80-tcp is used.
This port was not open until now, because I don’t use UVMM.
I now have the following ports open:

TCP: 22, 443, 6669, 6670, 80
TCP/UDP: 37, 53, 88, 123, 464, 749, 7389, 7636
Should I continue to share ports, possibly for docker apps? Benno-Mailarchiv is still running on the mailserver.

Translated with www.DeepL.com/Translator