Skip to content

After capturing DDL statements, DML statements cannot be captured #99

@liujiyu-fighting

Description

@liujiyu-fighting

After modifying the table structure of the source database, DDL statements are captured normally, but continue to test the DML statements and report an error if they are invalid

Is there any solution?

Can DDL capture be turned off?

thank

dml:
{"SCN":2951732,"SEG_OWNER":"WHTEST","TABLE_NAME":"T1","TIMESTAMP":1610443493000,"SQL_REDO":"update "WHTEST"."T1" set "NAME" = '123333 ' where "ID" = 1589033 and "NAME" = '123 ' and "CREATETIME" = TIMESTAMP ' 2020-12-24 16:18:48' and "COL4" = 123","OPERATION":"UPDATE","data":{"ID":1589033.0,"NAME":"123333","CREATETIME":1608797928000,"COL4":123.0},"before":{"ID":1589033.0,"NAME":"123","CREATETIME":1608797928000,"COL4":123.0},"DATABASE":"dhpoc"}

ddl:
{"SCN":2951746,"SEG_OWNER":"WHTEST","TABLE_NAME":"_GENERIC_DDL","TIMESTAMP":1610443520000,"SQL_REDO":"ALTER TABLE "WHTEST"."T1" ADD (col5 INTEGER)","OPERATION":"DDL","data":null,"before":null,"DATABASE":"dhpoc"}

error information:
ERROR Error during poll on topic cdczztar SQL :update "WHTEST"."T1" set "COL 2" = HEXTORAW('31202020202020202020') where "COL 1" = HEXTORAW('c4023b5b22') and "COL 2" = HEXTORAW('31323333333320202020') and "COL 3" = HEXTORAW('78780c18111331') and "COL 4" = HEXTORAW('c20218') and "COL 5" IS NULL (com.ecer.kafka.connect.oracle.OracleSourceTask:298)
java.lang.NullPointerException

this is my connect information:

curl -X POST -H "Content-Type: application/json" --data "{
"name":"C_DHWX_DHWSC_WHTEST",
"config":{
"topic":"cdczztar",
"connector.class":"com.ecer.kafka.connect.oracle.OracleSourceConnector",
"db.name":"dhpoc",
"db.hostname":"10.248.1.1",
"db.port":"1521",
"db.user":"kminer",
"db.user.password":"kminerpass",
"db.name.alias":"dhpoc",
"tasks.max":"6",
"db.fetch.size":"1",
"table.whitelist":"WHTEST.*",
"table.blacklist":"",
"parse.dml.data":"true",
"reset.offset":"false",
"transforms":"InsertSource",
"transforms.InsertSource.type":"org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.InsertSource.static.field":"DATABASE",
"transforms.InsertSource.static.value":"dhpoc",
"multitenant":"false"}
}" http://0.248.1.1:8083/connectors/

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions