Problems after Kopano reinstallation

pixel · December 27, 2019, 2:05pm

Hi@all,

I have completely rebuilt Kopano and the underlying UCS. Before that I backed up the database of Kopano and the directory with the attachments:

service kopano-dagent stop && service kopano-gateway stop && service kopano-ical stop && service kopano-monitor stop && service kopano-presence stop && service kopano-search stop && service kopano-server stop && service kopano-spooler stop

cd /var
tar cvfz kopano_attachment.tar.gz /var/lib/kopano/attachments
mysqldump --user=root -p"$(cat /etc/mysql.secret)" --single-transaction --routines kopano -r kopano.sql

After reinstalling UCS and reinstalling Kopano I restored the database and the attachments directory.

I can login to Kopano but only the shared folders are available. The user data (mails, calendar, contacts, tasks, notes) are completely empty.

In the log file I get the following messages:

Dez 27 14:35:36 com01 kopano-search[346]: 2019-12-27 14:35:36,975 - index0 - WARNING - output on stderr:
Dez 27 14:35:36 com01 kopano-search[346]: parser error : out of memory error
Dez 27 14:35:36 com01 kopano-search[346]: -:2: parser error : out of memory error
Dez 27 14:35:36 com01 kopano-search[346]: table:table-cell office:value-type="string" calcext:value-type="string"><text:p>
Dez 27 14:35:36 com01 kopano-search[346]:                                                                                ^
Dez 27 14:35:36 com01 kopano-search[346]: parser error : out of memory error
Dez 27 14:35:36 com01 kopano-search[346]: -:2: parser error : out of memory error
Dez 27 14:35:36 com01 kopano-search[346]: table:table-cell office:value-type="string" calcext:value-type="string"><text:p>
Dez 27 14:35:36 com01 kopano-search[346]:                                                                                ^
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error: element text
Dez 27 14:35:36 com01 kopano-search[346]: xsltCopyText: text allocation failed
Dez 27 14:35:36 com01 kopano-search[346]: runtime error
Dez 27 14:35:36 com01 kopano-search[346]: Internal error in xsltCopyText(): Failed to copy the string.
Dez 27 14:35:36 com01 kopano-search[346]: ..
Dez 27 14:35:36 com01 kopano-search[346]: 2019-12-27 14:35:36,977 - index0 - WARNING - return code = 10
...
Dez 27 14:38:10 com01 kopano-search[346]: 2019-12-27 14:38:10,495 - index0 - WARNING - output on stderr:
Dez 27 14:38:10 com01 kopano-search[346]: ./word/document.xml:2: parser error : Opening and ending tag mismatch: hyperlink line 2 and p
Dez 27 14:38:10 com01 kopano-search[346]: y" endcap="flat" joinstyle="round" weight="3960"/></v:rect></w:pict></w:r></w:p>
Dez 27 14:38:10 com01 kopano-search[346]:                                                                                ^
Dez 27 14:38:10 com01 kopano-search[346]: ./word/document.xml:2: parser error : Opening and ending tag mismatch: p line 2 and body
Dez 27 14:38:10 com01 kopano-search[346]: /><w:formProt w:val="false"/><w:textDirection w:val="lrTb"/></w:sectPr></w:body>
Dez 27 14:38:10 com01 kopano-search[346]:                                                                                ^
Dez 27 14:38:10 com01 kopano-search[346]: ./word/document.xml:2: parser error : Opening and ending tag mismatch: body line 2 and document
Dez 27 14:38:10 com01 kopano-search[346]:  w:val="false"/><w:textDirection w:val="lrTb"/></w:sectPr></w:body></w:document>
Dez 27 14:38:10 com01 kopano-search[346]:                                                                                ^
Dez 27 14:38:10 com01 kopano-search[346]: ./word/document.xml:2: parser error : Premature end of data in tag document line 2
Dez 27 14:38:10 com01 kopano-search[346]:  w:val="false"/><w:textDirection w:val="lrTb"/></w:sectPr></w:body></w:document>
Dez 27 14:38:10 com01 kopano-search[346]:                                                                                ^
Dez 27 14:38:10 com01 kopano-search[346]: unable to pars..
...
Dez 27 14:43:00 com01 kopano-search[346]: 2019-12-27 14:43:00,385 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:43:00 com01 kopano-search[346]:     try: yield
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:43:00 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:43:00 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:43:00 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:43:00 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:43:00 com01 kopano-search[346]: 2019-12-27 14:43:00,518 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:43:00 com01 kopano-search[346]:     try: yield
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:43:00 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:43:00 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:43:00 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:43:00 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:43:00 com01 kopano-search[346]: 2019-12-27 14:43:00,536 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:43:00 com01 kopano-search[346]:     try: yield
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:43:00 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:43:00 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:43:00 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:43:00 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:43:00 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:43:04 com01 kopano-search[346]: 2019-12-27 14:43:04,931 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:43:04 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:43:04 com01 kopano-search[346]:     try: yield
Dez 27 14:43:04 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:43:04 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:43:04 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:43:04 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:43:04 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:43:04 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:43:04 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:43:08 com01 kopano-search[346]: 2019-12-27 14:43:08,435 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:43:08 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:43:08 com01 kopano-search[346]:     try: yield
Dez 27 14:43:08 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:43:08 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:43:08 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:43:08 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:43:08 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:43:08 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:43:08 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:45:00 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:01 com01 CRON[15671]: pam_unix(cron:session): session opened for user root by (uid=0)
Dez 27 14:45:01 com01 CRON[15670]: pam_unix(cron:session): session opened for user root by (uid=0)
Dez 27 14:45:01 com01 CRON[15669]: pam_unix(cron:session): session opened for user root by (uid=0)
Dez 27 14:45:01 com01 CRON[15681]: (root) CMD (if [ -x /usr/bin/mrtg ] && [ -r /etc/mrtg.cfg ] && [ -d "$(grep '^[[:space:]]*[^#]*[[:space:]]*WorkDir' /etc/mrtg.cfg | awk '{ print $NF }')" ]; then mkdir -p /var/log/mrtg ; env LANG=C /usr/bin/mrtg /etc/mrtg.cfg 2>&1 | tee -a /var/log/mrtg/mrtg.log ; fi)
Dez 27 14:45:01 com01 CRON[15669]: pam_unix(cron:session): session closed for user root
Dez 27 14:45:01 com01 CRON[15685]: (root) CMD (  [ -x /usr/lib/univention-pam/ldap-group-to-file.py ] && /usr/lib/univention-pam/ldap-group-to-file.py --check_member)
Dez 27 14:45:01 com01 CRON[15687]: (root) CMD (/usr/sbin/univention-mrtg)
Dez 27 14:45:02 com01 CRON[15671]: pam_unix(cron:session): session closed for user root
Dez 27 14:45:02 com01 CRON[15670]: pam_unix(cron:session): session closed for user root
Dez 27 14:45:28 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:28 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:28 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:51 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:51 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:51 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:51 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:55 com01 kopano-server[1707]: LDAP search error: Can't contact LDAP server. Will unbind, reconnect and retry.
Dez 27 14:45:55 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:55 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:55 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:45:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:46:00 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:46:00 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:46:22 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:46:22 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:46:37 com01 kopano-search[346]: 2019-12-27 14:46:37,675 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:46:37 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:46:37 com01 kopano-search[346]:     try: yield
Dez 27 14:46:37 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:46:37 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:46:37 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:46:37 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:46:37 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:46:37 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:46:37 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:47:20 com01 kopano-search[346]: 2019-12-27 14:47:20,021 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:47:20 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:47:20 com01 kopano-search[346]:     try: yield
Dez 27 14:47:20 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:47:20 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:47:20 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:47:20 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:47:20 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:47:20 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:47:20 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:47:20 com01 kopano-search[346]: 2019-12-27 14:47:20,404 - index0 - WARNING - output on stderr:
Dez 27 14:47:20 com01 kopano-search[346]: [This was fast-saved 12 times. Some information is lost]
Dez 27 14:47:20 com01 kopano-search[346]: ..
Dez 27 14:47:20 com01 kopano-search[346]: 2019-12-27 14:47:20,456 - index0 - WARNING - output on stderr:
Dez 27 14:47:20 com01 kopano-search[346]: [This was fast-saved 11 times. Some information is lost]
Dez 27 14:47:20 com01 kopano-search[346]: ..
Dez 27 14:47:23 com01 kopano-search[346]: 2019-12-27 14:47:23,843 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:47:23 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:47:23 com01 kopano-search[346]:     try: yield
Dez 27 14:47:23 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:47:23 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:47:23 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:47:23 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:47:23 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:47:23 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:47:23 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:47:24 com01 kopano-search[346]: 2019-12-27 14:47:24,123 - index0 - ERROR - Traceback (most recent call last):
Dez 27 14:47:24 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 14:47:24 com01 kopano-search[346]:     try: yield
Dez 27 14:47:24 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 14:47:24 com01 kopano-search[346]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 14:47:24 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 14:47:24 com01 kopano-search[346]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 14:47:24 com01 kopano-search[346]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 14:47:24 com01 kopano-search[346]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 14:47:24 com01 kopano-search[346]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 14:48:07 com01 kopano-search[346]: 2019-12-27 14:48:07,098 - index0 - WARNING - output on stderr:
Dez 27 14:48:07 com01 kopano-search[346]: File is encrypted
Dez 27 14:48:07 com01 kopano-search[346]: ..
Dez 27 14:48:07 com01 kopano-search[346]: 2019-12-27 14:48:07,099 - index0 - WARNING - return code = 69
Dez 27 14:48:09 com01 kopano-search[346]: 2019-12-27 14:48:09,525 - index0 - WARNING - output on stderr:
Dez 27 14:48:09 com01 kopano-search[346]: File is encrypted
Dez 27 14:48:09 com01 kopano-search[346]: ..
Dez 27 14:48:09 com01 kopano-search[346]: 2019-12-27 14:48:09,525 - index0 - WARNING - return code = 69
Dez 27 14:49:52 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:52 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:54 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:54 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:55 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:55 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"
Dez 27 14:49:56 com01 kopano-server[1707]: Error while connecting to search on "file:///var/run/kopano/search.sock"

What have I done wrong?

pixel · December 27, 2019, 2:19pm

Some more background:

The Master was also newly installed
The users were created with the same name
The domain was “gehr.lan” and is now “gehr.local”
The IP addresses are the same
The host names are different
The public folders are all present after the restore
The “old” environment is still present (not in the network)

fbartels · December 27, 2019, 2:29pm

Hi @pixel,

is because of

because the unique ids of the users have changed (change compared to the state of the database import) kopano-server decided to delete the old users and create new ones (even though they may have the same name). The old stores exist as orphans in your database and can be reconnected to the new users.

pixel · December 27, 2019, 2:45pm

Okay, I almost thought that was it

how can I do this or is there a documentary about it?

fbartels · December 27, 2019, 2:54pm

https://documentation.kopano.io/kopanocore_administrator_manual/user_management.html?highlight=orphan#reattaching-stores-from-deleted-users

pixel · December 27, 2019, 3:25pm

Thanks a lot. The data is all there

But I can’t send it. I get the error message in WebApp:

“The message could not be saved.”

Details:

MAPIException: MAPI error  in /usr/share/kopano-webapp/server/includes/core/class.operations.php:2743Stack trace:#0 /usr/share/kopano-webapp/server/includes/core/class.operations.php(2743): mapi_savechanges(Resource id #18)#1 /usr/share/kopano-webapp/server/includes/modules/class.createmailitemmodule.php(180): Operations->submitMessage(Resource id #13, '\x00\x00\x00\x00S\xC8\xEAgyRD$\xBA\xB0\x1F...', Array, Array, Array, Array, false, false, false, false, false)#2 /usr/share/kopano-webapp/server/includes/modules/class.itemmodule.php(202): CreateMailItemModule->save(Resource id #13, '\x00\x00\x00\x00S\xC8\xEAgyRD$\xBA\xB0\x1F...', false, Array)#3 /usr/share/kopano-webapp/server/includes/core/class.jsonrequest.php(57): ItemModule->execute()#4 /usr/share/kopano-webapp/kopano.php(145): JSONRequest->execute('{"zarafa":{"cre...')#5 {main}

fbartels · December 27, 2019, 3:46pm

sorry, with webapp I cannot help.

pixel · December 27, 2019, 3:50pm

okay, I’ll try the Kopano forum. I also get an error in the log when restarting the kopano server:

Dez 27 16:48:14 com01 kopano-server[1741]: Shutting down
Dez 27 16:48:14 com01 kopano-search[444]: 2019-12-27 16:48:14,823 - search - ERROR - Traceback (most recent call last):
Dez 27 16:48:14 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 16:48:14 com01 kopano-search[444]:     try: yield
Dez 27 16:48:14 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 393, in incremental_sync
Dez 27 16:48:14 com01 kopano-search[444]:     new_state = self.server.sync(importer, self.state, log=self.log)
Dez 27 16:48:14 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/server.py", line 866, in sync
Dez 27 16:48:14 com01 kopano-search[444]:     return _ics.sync(self, self.mapistore, importer, state, max_changes, window=window, begin=begin, end=end, stats=stats)
Dez 27 16:48:14 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/ics.py", line 253, in sync
Dez 27 16:48:14 com01 kopano-search[444]:     exporter.Config(stream, flags, importer, restriction, None, None, 0)
Dez 27 16:48:14 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/MAPICore.py", line 1906, in Config
Dez 27 16:48:14 com01 kopano-search[444]:     return _MAPICore.IExchangeExportChanges_Config(self, lpStream, ulFlags, lpUnk, lpRestriction, lpIncludeProps, lpExcludeProps, ulBufferSize)
Dez 27 16:48:14 com01 kopano-search[444]: MAPI.Struct.MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)
Dez 27 16:48:15 com01 kopano-spooler[440]: Unable to get outgoing queue count: network error (80040115)
Dez 27 16:48:15 com01 kopano-spooler[440]: ProcessQueue: ProcessAllEntries failed: network error (80040115)
Dez 27 16:48:15 com01 kopano-spooler[440]: Server connection lost. Reconnecting in 3 seconds...
Dez 27 16:48:18 com01 kopano-spooler[440]: Logon to file:///var/run/kopano/server.sock: Remote side closed connection.
Dez 27 16:48:18 com01 kopano-spooler[440]: HrLogon server "default:" user "SYSTEM": network error
Dez 27 16:48:18 com01 kopano-spooler[440]: Unable to open admin session: network error (80040115)
Dez 27 16:48:19 com01 kopano-search[444]: 2019-12-27 16:48:19,829 - search - ERROR - Traceback (most recent call last):
Dez 27 16:48:19 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 16:48:19 com01 kopano-search[444]:     try: yield
Dez 27 16:48:19 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 393, in incremental_sync
Dez 27 16:48:19 com01 kopano-search[444]:     new_state = self.server.sync(importer, self.state, log=self.log)
Dez 27 16:48:19 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/server.py", line 866, in sync
Dez 27 16:48:19 com01 kopano-search[444]:     return _ics.sync(self, self.mapistore, importer, state, max_changes, window=window, begin=begin, end=end, stats=stats)
Dez 27 16:48:19 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/kopano/ics.py", line 253, in sync
Dez 27 16:48:19 com01 kopano-search[444]:     exporter.Config(stream, flags, importer, restriction, None, None, 0)
Dez 27 16:48:19 com01 kopano-search[444]:   File "/usr/lib/python3/dist-packages/MAPICore.py", line 1906, in Config
Dez 27 16:48:19 com01 kopano-search[444]:     return _MAPICore.IExchangeExportChanges_Config(self, lpStream, ulFlags, lpUnk, lpRestriction, lpIncludeProps, lpExcludeProps, ulBufferSize)
Dez 27 16:48:19 com01 kopano-search[444]: MAPI.Struct.MAPIErrorNetworkError: MAPI error 80040115 (MAPI_E_NETWORK_ERROR)
Dez 27 16:48:20 com01 kopano-server[1741]: Error in my_thread_global_end(): 11 threads didn't exit
Dez 27 16:48:20 com01 kopano-server[1741]: Server shutdown complete.
Dez 27 16:48:20 com01 systemd[1]: Stopped Kopano Groupware Core Storage Server.
Dez 27 16:48:20 com01 systemd[1]: Started Kopano Groupware Core Storage Server.
Dez 27 16:48:20 com01 kopano-server[11390]: Starting kopano-server version 8.7.9 (pid 11390 uid 0)
Dez 27 16:48:20 com01 kopano-server[11390]: Starting kopano-server version 8.7.9 (pid 11390 uid 998)

fbartels · December 27, 2019, 3:57pm

Its feel quite normal that kopano-search and spooler will throw connection errors when what they are connecting against is being restarted. Those errors will have been there before as well.

pixel · December 27, 2019, 4:08pm

I don’t know if it has anything to do with this but this error message:

Dez 27 17:03:18 com01 kopano-search[11636]: 2019-12-27 17:03:18,018 - index0 - ERROR - Traceback (most recent call last):
Dez 27 17:03:18 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 17:03:18 com01 kopano-search[11636]:     try: yield
Dez 27 17:03:18 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 17:03:18 com01 kopano-search[11636]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 17:03:18 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 17:03:18 com01 kopano-search[11636]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 17:03:18 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 17:03:18 com01 kopano-search[11636]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 17:03:18 com01 kopano-search[11636]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 17:04:10 com01 kopano-search[11636]: 2019-12-27 17:04:10,526 - index0 - ERROR - Traceback (most recent call last):
Dez 27 17:04:10 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 17:04:10 com01 kopano-search[11636]:     try: yield
Dez 27 17:04:10 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 17:04:10 com01 kopano-search[11636]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 17:04:10 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 17:04:10 com01 kopano-search[11636]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 17:04:10 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 17:04:10 com01 kopano-search[11636]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 17:04:10 com01 kopano-search[11636]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 17:04:10 com01 kopano-search[11636]: 2019-12-27 17:04:10,914 - index0 - WARNING - output on stderr:
Dez 27 17:04:10 com01 kopano-search[11636]: [This was fast-saved 12 times. Some information is lost]
Dez 27 17:04:10 com01 kopano-search[11636]: ..
Dez 27 17:04:10 com01 kopano-search[11636]: 2019-12-27 17:04:10,970 - index0 - WARNING - output on stderr:
Dez 27 17:04:10 com01 kopano-search[11636]: [This was fast-saved 11 times. Some information is lost]
Dez 27 17:04:10 com01 kopano-search[11636]: ..
Dez 27 17:04:14 com01 kopano-search[11636]: 2019-12-27 17:04:14,394 - index0 - ERROR - Traceback (most recent call last):
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 17:04:14 com01 kopano-search[11636]:     try: yield
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 17:04:14 com01 kopano-search[11636]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 17:04:14 com01 kopano-search[11636]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 17:04:14 com01 kopano-search[11636]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 17:04:14 com01 kopano-search[11636]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 17:04:14 com01 kopano-search[11636]: 2019-12-27 17:04:14,680 - index0 - ERROR - Traceback (most recent call last):
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano/log.py", line 103, in log_exc
Dez 27 17:04:14 com01 kopano-search[11636]:     try: yield
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/__init__.py", line 274, in update
Dez 27 17:04:14 com01 kopano-search[11636]:     attach_text.append(plaintext.get(attachment, mimetype=attachment.mimetype, log=self.log))
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 107, in get
Dez 27 17:04:14 com01 kopano-search[11636]:     ext, mimetype, data = ext_mime_data(f, filename, mimetype, log)
Dez 27 17:04:14 com01 kopano-search[11636]:   File "/usr/lib/python3/dist-packages/kopano_search/plaintext.py", line 96, in ext_mime_data
Dez 27 17:04:14 com01 kopano-search[11636]:     mimetype = magic.from_buffer(data, mime=True)
Dez 27 17:04:14 com01 kopano-search[11636]: AttributeError: module 'magic' has no attribute 'from_buffer'
Dez 27 17:04:57 com01 kopano-search[11636]: 2019-12-27 17:04:57,463 - index0 - WARNING - output on stderr:
Dez 27 17:04:57 com01 kopano-search[11636]: File is encrypted
Dez 27 17:04:57 com01 kopano-search[11636]: ..
Dez 27 17:04:57 com01 kopano-search[11636]: 2019-12-27 17:04:57,463 - index0 - WARNING - return code = 69
Dez 27 17:04:59 com01 kopano-search[11636]: 2019-12-27 17:04:59,849 - index0 - WARNING - output on stderr:
Dez 27 17:04:59 com01 kopano-search[11636]: File is encrypted
Dez 27 17:04:59 com01 kopano-search[11636]: ..

I also get some time after the service has been restarted