rmoff's random ramblings

24 Mar 2018 · debezium

Streaming Data from MySQL into Kafka with Kafka Connect and Debezium

Debezium is a CDC tool that can stream changes from MySQL, MongoDB, and PostgreSQL into Kafka, using Kafka Connect. In this article we’ll see how to set it up and examine the format of the data. …

06 Mar 2018 KSQL: Topic … does not conform to the requirements
06 Mar 2018 Streaming data from Kafka into Elasticsearch
kafka connect
06 Mar 2018 Installing the Python Kafka library from Confluent - troubleshooting some silly errors…
Apache Kafka
06 Mar 2018 Why Do We Need Streaming ETL?
streaming
01 Feb 2018 HOWTO: Oracle GoldenGate + Apache Kafka + Schema Registry + Swingbench
apache kafka
03 Jan 2018 Kafka - AdminClient - Connection to node -1 could not be established. Broker may not be available
Apache Kafka
21 Nov 2017 Installing Oracle GoldenGate for Big Data 12.3.1 with Kafka Connect and Confluent Platform
goldengate
29 Sep 2017 Where will I be at OpenWorld / Oak Table World?
oracle
20 Sep 2017 Apache Kafka™ talks at Oracle OpenWorld, JavaOne, and Oak Table World 2017
Apache Kafka
12 Sep 2017 Oracle GoldenGate / Kafka Connect Handler troubleshooting
goldengate
12 Sep 2017 What is Markdown, and Why is it Awesome?
markdown
11 Sep 2017 Conferences & Meetups at which I’ll be speaking - 2017
conferences
06 Sep 2017 Kafka Connect - JsonDeserializer with schemas.enable requires “schema” and “payload” fields
kafka connect
08 Aug 2017 Simple export/import of Data Sources in Grafana
curl
21 Jun 2017 Linux - USB disk connection problems - uas: probe failed with error -12
lsblk
12 Jun 2017 Configuring Kafka Connect to log REST HTTP messages to a separate file
Apache Kafka
12 May 2017 kafka.common.KafkaException: No key found on line 1
Apache Kafka
11 Mar 2017 Keeping Up with the Deluge
reading
11 Mar 2017 Install qemu on AWS EC2 Amazon Linux
qemu
11 Mar 2017 Mount VMDK/OVF/OVA on Amazon Web Services (AWS) EC2
vmdk
11 Mar 2017 Little Technology Wins
headphones
10 Mar 2017 Time For a Change
career
10 Mar 2017 Property Graph in Oracle 12.2
Docker
25 Jan 2017 Rittman Mead at BIWA Summit 2017
Apache Kafka
20 Jan 2017 HBase crash after resuming suspended VM
hbase
18 Jan 2017 Kibana Timelion - Anomaly Detection
kibana
16 Jan 2017 Streaming / Unbounded Data - Resources
13 Jan 2017 Data Processing and Enrichment in Spark Streaming with Python and Kafka
Apache Kafka
12 Jan 2017 Getting Started with Spark Streaming, Python, and Kafka
Apache Kafka
20 Dec 2016 ETL Offload with Spark and Amazon EMR - Part 4 - Analysing the Data
Apache Spark
20 Dec 2016 ETL Offload with Spark and Amazon EMR - Part 5 - Summary
Apache Kafka
19 Dec 2016 ETL Offload with Spark and Amazon EMR - Part 3 - Running pySpark on EMR
Apache Spark
16 Dec 2016 ETL Offload with Spark and Amazon EMR - Part 2 - Code development with Notebooks and Docker
Apache Spark
15 Dec 2016 ETL Offload with Spark and Amazon EMR - Part 1 - Introduction
Apache Spark
14 Dec 2016 Source Control and Automated Code Deployment Options for OBIEE
OBIEE
12 Dec 2016 Enhanced Usage Tracking for OBIEE - Now Available as Open Source!
OBIEE
08 Dec 2016 The Rittman Mead Open Source Project
OBIEE
02 Dec 2016 kafka-avro-console-producer - Error registering Avro schema / io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException
Apache Kafka
29 Nov 2016 Oracle GoldenGate -> Kafka Connect - “Failed to serialize Avro data”
ogg
24 Nov 2016 Kafka Connect - java.lang.IncompatibleClassChangeError
Apache Kafka
01 Nov 2016 Connecting Oracle Data Visualization Desktop to Google Analytics and Google Drive
Data Visualisation
01 Nov 2016 Using SQL to Query JSON Files with Apache Drill
Apache Drill
19 Oct 2016 OBIEE, Big Data Discovery, and ODI security updates - October 2016
OBIEE
14 Oct 2016 boto / S3 errors
boto
12 Oct 2016 Streaming data from Oracle using Oracle GoldenGate and Kafka Connect
Kafka Connect
11 Oct 2016 OTN Appreciation Day : OBIEE’s BI Server
OBIEE
08 Oct 2016 POUG
OBIEE
03 Oct 2016 All You Ever Wanted to Know About OBIEE Performance…but were too afraid to ask
OBIEE
06 Sep 2016 Using logdump to Troubleshoot the Oracle GoldenGate for Big Data Kafka Handler
Kafka Connect