Learn to use Storm!
Table of Contents
Getting started
Prerequisites
First, you need java
and git
installed and in your user's PATH
. Also, two of the examples in storm-starter require Python and Ruby.
Next, make sure you have the storm-starter code available on your machine. Git/GitHub beginners may want to use the following command to download the latest storm-starter code and change to the new directory that contains the downloaded code.
$ git clone git://github.com/nathanmarz/storm-starter.git && cd storm-starter
storm-starter overview
storm-starter contains a variety of examples of using Storm. If this is your first time working with Storm, check out these topologies first:
- ExclamationTopology: Basic topology written in all Java
- WordCountTopology: Basic topology that makes use of multilang by implementing one bolt in Python
- ReachTopology: Example of complex DRPC on top of Storm
After you have familiarized yourself with these topologies, take a look at the other topopologies insrc/jvm/storm/starter/ such as RollingTopWords for more advanced implementations.
If you want to learn more about how Storm works, please head over to the Storm project page.
Using storm-starter with Leiningen
Install Leiningen
The storm-starter build uses Leiningen 2.0. Install Leiningen by following the leiningen installation instructions.
Running topologies with Leiningen
To run a Java topology
$ lein deps
$ lein compile
$ java -cp $(lein classpath) storm.starter.ExclamationTopology
To run a Clojure topology:
$ lein deps
$ lein compile
$ lein run -m storm.starter.clj.word-count
Using storm-starter with Maven
Install Maven
Maven is an alternative to Leiningen. Install Maven (preferably version 3.x) by following the Maven installation instructions.
Running topologies with Maven
storm-starter contains m2-pom.xml which can be used with Maven using the -f
option. For example, to compile and run WordCountTopology
in local mode, use the command:
$ mvn -f m2-pom.xml compile exec:java -Dexec.classpathScope=compile -Dexec.mainClass=storm.starter.WordCountTopology
Packaging storm-starter for use on a Storm cluster
You can package a jar suitable for submitting to a Storm cluster with the command:
$ mvn -f m2-pom.xml package
This will package your code and all the non-Storm dependencies into a single "uberjar" at the pathtarget/storm-starter-{version}-jar-with-dependencies.jar
.
Running unit tests
Use the following Maven command to run the unit tests that ship with storm-starter. Unfortunately lein test
does not yet run the included unit tests.
$ mvn -f m2-pom.xml test
come from storm's wiki
大家可以加我个人微信号:scccdgf
相关推荐
Storm is the most popular framework for real-time stream processing. Storm provides the fundamental... This book introduces you to Storm using real-world examples, beginning with simple Storm topologies.
Storm Applied is an example-driven guide to processing and analyzing real-time data streams. This immediately useful book starts by teaching you how to design Storm solutions the right way. Then, it ...
Storm Blueprints: Patterns for ...topologies. The examples increase in complexity, introducing advanced Storm concepts as well as more sophisticated approaches to deployment and operational concerns.
Learning Storm 英文版 Real-time data processing is no longer a ...and how to create transactional topologies. Finally, the last two chapters cover case studies for log processing and machine learning.
FPGA Interconnect Topologies Exploration
Springer Undergraduate Mathematics Series(SUMS)
在这个教程里面我们将学习如何创建Topologies,并且把topologies部署到storm的集群里面去。Java将是我们主要的示范语言, 个别例子会使用python以演示storm的多语言特性。这个教程使用storm-starter项目里面的例子。...
Advanced PON Topologies with Wireless Connectivity
artiÞcially generated topologies with real world topologies this letter gives hints how to use the wide-spread topology generators BRITE, TIERS and GT-ITM to create realistic topologies
Nathan Marz discusses Storm concepts –streams, spouts, bolts, topologies-, explaining how to use Storms’ Clojure DSL for real-time stream processing, distributed RPS and continuous computations....
D. S. Chan、K. S. Chua、 C. Leckie和A. Parhar 提出的ODL算法便是专门适用于幂 律( power-law) 网络的FDA算法
Fuel cell hybrid topologies selection and control
经典 拓扑优化理论分析,对拓扑优化初学者十分适用,推导详尽。
DRPC本身算不上Storm的特性,它是通过Storm的基本元素:streams,spouts,bolts,topologies而衍生的一个模式。DRPC可以单独作为一个独立于Storm的库发布,但由于其重要性还是和Storm捆绑在了一起。1.接收到一个RPC...
另外,不要更改代码就可在Heron中运行现有的Storm topologies,实现轻松地迁移。 Scalability and latency:Heron能够处理大规模的topologies,且满足高吞吐量和低延迟的要求。此外,该系统可以处理大量的...
A Beginner's Guide to Filter Topologies.zip
VIO3.1&NSX - Network Topologies Configuration Guide-v1.0(public).pdf VIO3.1&NSX - Network Topologies Configuration Guide-v1.0(public).pdf VIO3.1&NSX - Network Topologies Configuration Guide-v1.0...
英文版,超清晰,非扫描 Ad hoc Networks Fundamental Properties and Network Topologies
SUMS10 Topologies and Uniformities, Ioan Mackenzie James (1999) .zip
01 Review of Three-Phase PWM AC–AC Converter Topologies(完美翻译)