notes taken during the course
https://www.confluent.io/hub/debezium/debezium-connector-mysql
https://github.com/codeedu/fc2-kafka-connect
docker-compose ps
docker exec -it fc-kafka-connect_mysql_1 bash
mysql -uroot -p fullcycle
root
show tables;
CREATE TABLE categories (id INT AUTO_INCREMENT PRIMARY KEY, name VARCHAR(255));
show tables;
desc categories;
INSERT INTO categories (name) values('Eletronics');
SELECT * FROM categories;
Upload mysql.properties
connector file to Control Center (http://localhost:9021/) connectors section.
New topis:
- mysql-server
- mysql-server.fullcycle.categories
- mysql-history
INSERT INTO categories (name) values('Eletronics');
Check the messages of mysql-server.fullcycle.categories
topic
Upload mongodb.properties
connector file to Control Center connectors section.
Access Mongo Express (http://localhost:8085)
Kafka SMT (Single Message Transforms) https://docs.confluent.io/platform/current/connect/transforms/overview.html