Package org.apache.storm.hdfs.bolt
Class SequenceFileBolt
java.lang.Object
org.apache.storm.topology.base.BaseComponent
org.apache.storm.topology.base.BaseRichBolt
org.apache.storm.hdfs.bolt.AbstractHdfsBolt
org.apache.storm.hdfs.bolt.SequenceFileBolt
- All Implemented Interfaces:
Serializable,IBolt,IComponent,IRichBolt
- See Also:
-
Field Summary
Fields inherited from class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
collector, configKey, fileNameFormat, fileRetryCount, fs, fsUrl, hdfsConfig, maxOpenFiles, offset, partitioner, rotationActions, rotationCounterMap, rotationPolicy, rotationTimer, syncPolicy, tickTupleInterval, writeLock, writers -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionaddRotationAction(RotationAction action) voiddoPrepare(Map<String, Object> conf, TopologyContext topologyContext, OutputCollector collector) protected StringgetWriterKey(Tuple tuple) protected AbstractHDFSWritermakeNewWriter(org.apache.hadoop.fs.Path path, Tuple tuple) withCompressionCodec(String codec) withCompressionType(org.apache.hadoop.io.SequenceFile.CompressionType compressionType) withConfigKey(String configKey) withFileNameFormat(FileNameFormat fileNameFormat) withMaxOpenFiles(int maxOpenFiles) withPartitioner(Partitioner partitioner) withRetryCount(int fileRetryCount) withRotationPolicy(FileRotationPolicy rotationPolicy) withSequenceFormat(SequenceFormat format) withSyncPolicy(SyncPolicy syncPolicy) withTickTupleIntervalSeconds(int interval) Methods inherited from class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
cleanup, declareOutputFields, execute, getBasePathForNextFile, getComponentConfiguration, prepare, rotateOutputFile
-
Constructor Details
-
SequenceFileBolt
public SequenceFileBolt()
-
-
Method Details
-
withCompressionCodec
-
withFsUrl
-
withConfigKey
-
withFileNameFormat
-
withSequenceFormat
-
withSyncPolicy
-
withRotationPolicy
-
withCompressionType
public SequenceFileBolt withCompressionType(org.apache.hadoop.io.SequenceFile.CompressionType compressionType) -
withTickTupleIntervalSeconds
-
addRotationAction
-
withRetryCount
-
withPartitioner
-
withMaxOpenFiles
-
doPrepare
public void doPrepare(Map<String, Object> conf, TopologyContext topologyContext, OutputCollector collector) throws IOException- Specified by:
doPreparein classAbstractHdfsBolt- Throws:
IOException
-
getWriterKey
- Specified by:
getWriterKeyin classAbstractHdfsBolt
-
makeNewWriter
protected AbstractHDFSWriter makeNewWriter(org.apache.hadoop.fs.Path path, Tuple tuple) throws IOException - Specified by:
makeNewWriterin classAbstractHdfsBolt- Throws:
IOException
-