在spark001、spark002、spark003三台机器上。
版本：kafka_2.10-0.8.2.1.zip
启动命令：
nohup bin/kafka-server-start.sh start.sh config/server.properties > kafka.log 2>&1 &
在spark001上：
vim server.properties
```
broker.id=0
port=9092
#里面存放的其实就是kafka数据
log.dirs=/kafka-logs
num.partitions=1 #topic的partition数量
log.retention.hours=168 #7天
zookeeper.connect=spark001:2191,spark002:2181,spark003:2181
```
分发配置文件。
每台机器上启动Zookeeper:
./bin/zkServer.sh start
每台机器上启动kafka：
nohup bin/kafka-server-start.sh config/server.properties > kafka.log 2>&1 &
# jps
Jps
QuorumPeerMain
Kafka
./bin/kafka-topic.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --list
./bin/kafka-topic.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --describe
./bin/kafka-topic.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --create --topic 20170920 --partitions 3 --replication-factor 2
./bin/kafka-topic.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --describe --topic 20170920
./bin/kafka-topic.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --delete --topic 20170920
./bin/kafka-console-consumer.sh --zookeeper spark001:2181,spark002:2181,spark003:2181 --topic 20170920
./bin/kafka-console-producer.sh --broker-list spark001:9092,spark002:9092,spark003:9092 --topic 20170920
