mongoshake读取到最新时间，向数据库记录checkPoint信息后deserializer parse data failed错误

[YanJun0821]

mongo版本：4.0 WiredTigerWT.40.3.23

mongoshake版本：2.8.4

hypervisor.output日志：

[09:49:08 UTC 2025/05/15] [CRIT] (github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).deserializer:491) Syncer[cmgo-233k7ohx_0] deserializer parse data failed[unknown event type[create] org_event[{"_id":{"_data":"826825B536000000172B02296E5A1004DDD5756552C64C35A77E1415B6FA482604"},"operationType":"create","ns":{"coll":"ckpt_default","db":"mongoshake"},"clusterTime":{"T":1747301686,"I":23}}]]
panic: Syncer[cmgo-233k7ohx_0] deserializer parse data failed[unknown event type[create] org_event[{"_id":{"_data":"826825B536000000172B02296E5A1004DDD5756552C64C35A77E1415B6FA482604"},"operationType":"create","ns":{"coll":"ckpt_default","db":"mongoshake"},"clusterTime":{"T":1747301686,"I":23}}]]

goroutine 632 [running]:
github.com/vinllen/log4go.Crashf(0xd99b56, 0x25, 0xc0004c9fa0, 0x2, 0x2)
/u02/shuntong.zhang/local_bin/go1_15_10/go_modcache/github.com/vinllen/log4go@v0.0.0-20180514124125-3848a366df9d/wrapper.go:46 +0xe5
github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).deserializer(0xc000572120, 0x5)
/u02/shuntong.zhang/db_src/MongoShake/collector/syncer.go:491 +0x21e
created by github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).startDeserializer
/u02/shuntong.zhang/db_src/MongoShake/collector/syncer.go:437 +0x11a

• child process[155] terminated .

• read zero from pipe of children.

• extra info: - normal termination, exit status = 2

• process: "./collector.linux" exit, restart it

collector.log:

• execute: "./collector.linux"
  [09:19:01 UTC 2025/05/15] [CRIT] (github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).deserializer:491) Syncer[cmgo-233k7ohx_0] deserializer parse data failed[unknown event type[create] org_event[{"_id":{"_data":"826825A3C5000000B82B02296E5A1004B42CFCB150CF4612B757D491989D92D704"},"operationType":"create","ns":{"coll":"ckpt_default","db":"mongoshake"},"clusterTime":{"T":1747297221,"I":184}}]]
  panic: Syncer[cmgo-233k7ohx_0] deserializer parse data failed[unknown event type[create] org_event[{"_id":{"_data":"826825A3C5000000B82B02296E5A1004B42CFCB150CF4612B757D491989D92D704"},"operationType":"create","ns":{"coll":"ckpt_default","db":"mongoshake"},"clusterTime":{"T":1747297221,"I":184}}]]

826825B536000000172B02296E5A1004DDD5756552C64C35A77E1415B6FA482604
goroutine 644 [running]:
github.com/vinllen/log4go.Crashf(0xd99b56, 0x25, 0xc0000f5fa0, 0x2, 0x2)
/u02/shuntong.zhang/local_bin/go1_15_10/go_modcache/github.com/vinllen/log4go@v0.0.0-20180514124125-3848a366df9d/wrapper.go:46 +0xe5
github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).deserializer(0xc000340360, 0x1)
/u02/shuntong.zhang/db_src/MongoShake/collector/syncer.go:491 +0x21e
created by github.com/alibaba/MongoShake/v2/collector.(*OplogSyncer).startDeserializer
/u02/shuntong.zhang/db_src/MongoShake/collector/syncer.go:437 +0x11a

• child process[23] terminated .
• child process killed in 1 seconds , may wrong ! exit !
• execute: "./collector.linux"

[zhongli-james]

1. 源端看起来是腾讯云，什么baseline版本呢，6.0+? 如果是社区版的话，需要提前开启{showExpandedEvents:true}才会输出create类型的change events。因此你们应该使用的是自研的patch，跟社区版的行为稍有差异。

cursor = db.getCollection("test").watch([],{maxAwaitTimeMS:60000,  fullDocument: 'required',fullDocumentBeforeChange: 'required', showExpandedEvents: true})

3. 问题原因：mongoshake在设计并支持changeStream模式时，当时MongoDB6.0还未GA，changeStream还不支持create/createIndexes/modify/shardCollection等DDL语句，因此代码中还未支持对应change events的switch-case。
4. 我近期会修复此问题，预计下个版本会发布。
5. 可能有效的临时workaround：重新跑一次mongoshake，因为mongoshake.ckpt_default只会在第一次创建时在源库上创建，后续会直接读取其中的内容。PS：如果源库在同步过程中还有可能存在其他表的create，则依然可能遇到此问题。

[zhongli-james]

v2.8.6包含此修复，支持了6.0+新增的change events。