Skip to content

(1spout+1bolt) Storm realtime processing system for recursive least squares estimation using MongoDB Java API

Notifications You must be signed in to change notification settings

davidpr/mongo-storm-fast

Repository files navigation

Fast Mongo Storm

This is a fast way to set a up a basic topology that consumes JSON tuples from a Java client.

  • The spout, imported from storm-amqp-spout, is able to cannect to a Rabbitmq queue.
  • The bolt, MongoInsertBolt, uses the Java API to store docuemnts into a MongoDB collection.

dependencies:


##Usage

  • Compile and launch the topology
mvn package  && zip -d ./target/mongo-storm-fast-0.0.1-SNAPSHOT.jar defaults.yaml
storm jar ./target/mongo-storm-fast-0.0.1-SNAPSHOT.jar org.mongodb.MongoTopology test
  • Launch the client
mvn package
java -cp ./target/storm-client-json-regression-1.0-SNAPSHOT.jar StormSenderJSON stormkey
  • Check out the results
tail -f worker6700.log

You also can check it out by accessing to your MongoDB collection or visualizing the rabbitmq queue

About

(1spout+1bolt) Storm realtime processing system for recursive least squares estimation using MongoDB Java API

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published