Mails in Outlook 2016 no longer consistent after upgrade to Kopano Core 8.6.8.2

tpfann · November 27, 2018, 3:12pm

Very strange

I have now also enabled the WBXML logging on user level.
I made the following observation:

ActiveSync to Outlook (empty mail again):

27/11/2018 15:25:34 [52758] [DEBUG] LoopDetection->Detect(): folderid:'U8f1e2' uuid:'cd79093a-380a-407e-9beb-0371571d87d4' counter:'57' max:'512' queued:'1'
27/11/2018 15:25:34 [52758] [DEBUG] PHPWrapper->ImportMessageChange(): Getting message from MAPIProvider, sourcekey: '0ee843f10bcd460cb98d440c5eed76bd86fa00000000', parentsourcekey: '0ee843f10bcd460cb98d440c5eed76bd3a0000000000', entryid: '0000000099811161ecb746208ffd513c7d44f03d0100000005000000d20b9abe70c440eeae813a597af7b25400000000'
27/11/2018 15:25:34 [52758] [DEBUG] BodyPreference types: 4
27/11/2018 15:25:34 [52758] [DEBUG] GetBodyPreferenceBestMatch: 4
27/11/2018 15:25:34 [52758] [DEBUG] bpo: truncation size:'0', allornone:'1', preview:'0'
27/11/2018 15:25:34 [52758] [ERROR] MAPIProvider->imtoinet(): got no stream or content from mapi_inetmapi_imtoinet()
27/11/2018 15:25:34 [52758] [WBXML] O     <Perform>
27/11/2018 15:25:34 [52758] [WBXML] O      <Add>
27/11/2018 15:25:34 [52758] [WBXML] O       <ServerEntryId>
27/11/2018 15:25:34 [52758] [WBXML] O       U8f1e2:0ee843f10bcd460cb98d440c5eed76bd86fa00000000
27/11/2018 15:25:34 [52758] [WBXML] O       </ServerEntryId>
27/11/2018 15:25:34 [52758] [WBXML] O       <Data>
27/11/2018 15:25:34 [52758] [WBXML] O        <POOMMAIL:To>
27/11/2018 15:25:34 [52758] [WBXML] O        user1@domain.de
27/11/2018 15:25:34 [52758] [WBXML] O        </POOMMAIL:To>
27/11/2018 15:25:34 [52758] [WBXML] O        <POOMMAIL:From>
27/11/2018 15:25:34 [52758] [WBXML] O        "fbartels" <noreply@help.univention.com>
27/11/2018 15:25:34 [52758] [WBXML] O        </POOMMAIL:From>
27/11/2018 15:25:34 [52758] [WBXML] O        <POOMMAIL:Subject>
27/11/2018 15:25:34 [52758] [WBXML] O        [Univention Help] [Apps & App Center] Mails in Outlook 2016 no longer consistent after upgrade to Kopano Core 8.6.8.2

Same email to Android-Device via ActiveSysnc:

27/11/2018 15:24:59 [52808] [DEBUG] LoopDetection->ProcessLoopDetectionTerminate()
27/11/2018 15:24:59 [52808] [ INFO] cmd='Sync' memory='1.85 MiB/4.00 MiB' time='0.25s' devType='SamsungDevice' devId='sec0760fe45db543' getUser='USER1' from='192.168.0.31' idle='0s' version='2.4.4+0-0' method='POST' httpcode='200'
27/11/2018 15:24:59 [52808] [DEBUG] -------- End
27/11/2018 15:24:59 [52755] [DEBUG] BodyPreference types: 2, 4
27/11/2018 15:24:59 [52755] [DEBUG] Remove mime body preference type because the device required no mime support. BodyPreference types: 2
27/11/2018 15:24:59 [52755] [DEBUG] GetBodyPreferenceBestMatch: 2
27/11/2018 15:24:59 [52755] [DEBUG] bpo: truncation size:'0', allornone:'0', preview:'0'
27/11/2018 15:24:59 [52755] [DEBUG] MAPIStreamWrapper::stream_open(): initialized mapistream: Resource id #122 - streamlength: 4550 - HTML-safe-truncate: true
27/11/2018 15:24:59 [52755] [WBXML] O     <Perform>
27/11/2018 15:24:59 [52755] [WBXML] O      <Add>
27/11/2018 15:24:59 [52755] [WBXML] O       <ServerEntryId>
27/11/2018 15:24:59 [52755] [WBXML] O       U8f1e2:0ee843f10bcd460cb98d440c5eed76bd86fa00000000
27/11/2018 15:24:59 [52755] [WBXML] O       </ServerEntryId>
27/11/2018 15:24:59 [52755] [WBXML] O       <Data>
27/11/2018 15:24:59 [52755] [WBXML] O        <POOMMAIL:To>
27/11/2018 15:24:59 [52755] [WBXML] O        user1@domain.de
27/11/2018 15:24:59 [52755] [WBXML] O        </POOMMAIL:To>
27/11/2018 15:24:59 [52755] [WBXML] O        <POOMMAIL:From>
27/11/2018 15:24:59 [52755] [WBXML] O        "fbartels" <noreply@help.univention.com>
27/11/2018 15:24:59 [52755] [WBXML] O        </POOMMAIL:From>
27/11/2018 15:24:59 [52755] [WBXML] O        <POOMMAIL:Subject>
27/11/2018 15:24:59 [52755] [WBXML] O        [Univention Help] [Apps & App Center] Mails in Outlook 2016 no longer consistent after upgrade to Kopano Core 8.6.8.2
27/11/2018 15:24:59 [52755] [WBXML] O        </POOMMAIL:Subject>

fbartels · November 28, 2018, 8:51am

ok, got it. for whatever reason not reproducible on our lxd test machines, but only in a more “real” system (virtualbox/kvm). Ticket https://jira.kopano.io/browse/KC-1351 was created to further investigate.

tpfann · November 28, 2018, 10:06am

I know myself that it is most of the time quite difficult to reproduce such an issue, but I’m glad to hear that you found something now.

Hopefully a hotfix for this will be available soon
Thank you for your efforts and your support!

fbartels · November 28, 2018, 11:57am

small update. Issue is identified and a fix has already been reviewed and merged. Currently running builds to make a new minor release for 8.6.

Keep an eye on https://documentation.kopano.io/kopano_changelog/kc.html#kopano-groupware-core-8-6 for the release.

I would have hoped that our support would have taken better care of your case, but thanks to your persistence and logging I was able to identify the issue nonetheless. I’ll send you a 30 day eval key via private message so that you can do an upgrade to this new release once its there.

tpfann · November 28, 2018, 12:32pm

Very,very good

Thanks alot for the eval-key, but do you have a rough idea already when the release will be available officially via the UCS App-Center?

fbartels · November 28, 2018, 12:51pm

I am not planning to push this as an update into the official app center. But for you this is not an issue, since you can retrieve it through the subscription key.

tpfann · November 28, 2018, 12:56pm

You are perfectly right …
I was asking for two reasons:

Avoid the need to change / change back my configuration
What about other potential affected users (without subscription)

fbartels · November 28, 2018, 1:07pm

no need to change your configuration. you could even leave the eval key in the system, as soon as there is a newer app release you will simply move back to the app release.

Those that have bought a subscription allow me (and the rest of our team) to spent time on such issues.

If anyone reads this and is too broke to afford the 15€ per user (and year) send a mail to feedback@kopano.io and you’ll receive a 30 day eval key as well.

Update: The holidays are coming up and the mentioned mailbox will not be checked as regularly anymore. Please instead request a trial key from https://kopano.com/kopano-trial-download/ (by just downloading any item offered)

tpfann · November 29, 2018, 7:36am

Good morning,

I noticed here that the new release is out: https://documentation.kopano.io/kopano_changelog/kc.html#kopano-groupware-core-8-6

As advised I entered my eval-key (thanks again for this) in the app settings and ticked the box to use the Kopano repository.

univention-upgrade still gives me:
Starting univention-upgrade. Current UCS version is 4.3-2 errata344

Checking for local repository: none
Checking for package updates: none
Checking for app updates: none
Checking for release updates: none

Did I missed something?

Thx and best regards
Thomas

Update: Found the solution myself here: Kopano. Key in App-Einstellungen aber trotzdem kommt kein Update

tpfann · November 29, 2018, 11:47am

Hi,

I was able now to install the fixed release and I can confirm that the issue with “empty mails” via ActiveSync in Outlook is solved.

Thanks and great job Kopano-Team!

Unfortunatley I’m facing some new (minor) issues now with Outlook:

GAB-Sync via KOE is no longer working
KOE is not showing any progress update during the complete resync of the mailbox
Notes are no longer syncronized

All of this was working before. I already did a complete resetup of Outlook and KOE (including a full resync).

z-push-admin -a list gives me:

DeviceId: d3bf82d3b92c47a6a142106dac58a452
Device type: WindowsOutlook
UserAgent: Outlook/16.0 (16.0.11001.20073; x86)
ActiveSync version: 14.0
First sync: 2018-11-29 11:36
Last sync: 2018-11-29 12:26
Sync Period: unlimited (0)
Total folders: 46
Short folder Ids: Yes
Synchronized folders: 42
Synchronized data: Emails(37) Contacts Calendars(2) Tasks GAB
Additional Folders: 1
Folder name Store Type Origin Synched
Kalender xxx SYSTEM Calendar Shared Active
Status: Not available
WipeRequest on: not set
WipeRequest by: not set
Wiped on: not set
Policy name: default
Kopano Outlook Extension:
Version: 2.0.314
Build: 87a3a67b120816301d3a001aa5fe842f85cbac98
Build Date: 2018-09-14 11:14
Capabilities: receiveflags,sendflags,bcc,oof,ooftime,sharedfolders,impersonate,webapp,freebusy,gab,notes,secondarycontacts,sendas,signatures,debugsupport,syncstate,deliveryreceipts
Last access: 2018-11-29
Attention needed: No errors known

As this is less critical I will search now the Kopano and UCS forums for solutions.
If you have a tip on what can I check this would be much appreciated.

Best regards
Thomas

Update: Found a solution for 3 - Solved

fbartels · November 29, 2018, 1:32pm

Works for me on a ucs test system

my test inbox is not really large, but you are just referring to the indicator of how far along he is in the sync, right? I could not see any issues with resyncs (i did quite some to get behind these empty items).

tpfann · November 29, 2018, 2:34pm

Hello fbartels,

thanks for giving it a try on your test system.

koe
Correct, this is what I was referring to, the blue bar and the field “Verbleibend” simply do not update during the resync (they remain as shown in the screenshot).

I found out that GAB sync is still working for another user on a different computer.
But on my local machine with my user it is not. Same with the progress inidicator while resyncing.

Very strange … already tried different versions of KOE and even Outlook was reinstalled.

Any ideas what else can I try or check?

fbartels · November 29, 2018, 3:09pm

Checking logs is always a good idea
For koe there are two logs to check;

one is the koe logging in %temp% on the client.
the other is the logging of z-push

tpfann · November 29, 2018, 3:45pm

Thanks for the hint, I created debug-logs for both and captured starting the Oulook-Client and hitting the KOE “Sync GAB” button. Can’t see anything special or critical in the logs …

I give up now

smudu · December 2, 2018, 11:29am

I am not planning to push this as an update into the official app center. But for you this is not an issue, since you can retrieve it through the subscription key.

After update yesterday, I’m affected too.
Outlook 2016/Active Sync: (HTML-) Mails not shown at all.
IOS Devices show messages but no text in body.

I have no subscription key.
It seemed there is no other workaround?
So, I should rely on webmail only for a couple of weeks/months?

tpfann · December 2, 2018, 3:53pm

Well … this is what you can do:

raceface2nd · December 7, 2018, 2:17pm

Just want to post that we encountered the same behaviour with Kopano Core 8.6.8.2 since we updated our servers a week ago.

We encountered this issue also by using kopano-migration-pst that nearly 50% of the emails showed up empty in Outlook.

Even disabling Kopano OLE deleting the account and reinstallung did not solve the issue nearly 50% of the emails stayed empty in Outlook.

Regards!

Andy

igpdietrich · December 9, 2018, 5:44am

Dear Kopano-Team,
we’re having the same issue here, using the community edition with z-push and iOS Clients.
As far as I understood the thread so far, the bugfix will not be published via the app center?!
Will it become part of one of the future updates?
Is there a chance to get the bugfix in any other way?

Many thanks in advance!
Ingo

fbartels · December 9, 2018, 7:42am

Yes, preparing an app update takes time and effort. Not only on our side, but also on the side of Univention. This time I currently have to spend on other things.

Yes, naturally. I cannot say when, though.

I have already listed the options above:

get a Kopano subscription, which starts at 75€ and includes five users and use the repo update functionality of the app. The other benefit of this is that you this way also support further development and allow me and my colleagues to spend time on community work.
if you cannot spare the 75€ write an email to the above email and get a free 30 days evaluation key.

igpdietrich · December 10, 2018, 4:19am

WOW, many thank for the quick reply, even on Sunday!
You guys are really doing a fantastic job here!