TuningConfig

tuningConfig用于设置Task的一些优化参数。

• TuningConfig：
  • luceneIndexTuningConfig
  • kafkaSupervisorTuningConfig

1. TuningConfig

1.1 luceneIndexTuningConfig

luceneIndexTuningConfig一般用于离线数据Task的优化配置

"tuningConfig":{
      "type":"lucene_index",
      "maxRowsPerSegment": Integer maxRowsPerSegment,
      "numShards": Integer numShards,
      "basePersistDirectory": String basePersistDirectory,
      "overwrite": Boolean overwrite,
      "reportParseExceptions": Boolean reportParseExceptions,
      "writeThreads": Integer writeThreads,
      "writeQueueThreshold": Integer writeQueueThreshold,
      "mergeThreads": Integer mergeThreads,
      "scanThreads": Integer scanThreads,
      "useDataSequenceMode": Boolean useDataSequenceMode,
      "maxSegmentIdleSeconds": Integer maxSegmentIdleSeconds
}

1.2 kafkaSupervisorTuningConfig

kafkaSupervisorTuningConfig一般用于实时数据kafkaSupervisor的优化配置

"tuningConfig":{
      "type":"kafka",
      "maxRowsInMemory": Integer maxRowsInMemory,
      "maxRowsPerSegment": Integer maxRowsPerSegment,
      "intermediatePersistPeriod": Period intermediatePersistPeriod,
      "basePersistDirectory": String basePersistDirectory,
      "basePersistDirectoryStr": String basePersistDirectoryStr,
      "maxPendingPersists": Integer maxPendingPersists,
      "indexSpec": IndexSpec indexSpec,
      "buildV9Directly": Boolean buildV9Directly,
      "reportParseExceptions": Boolean reportParseExceptions,
      "handoffConditionTimeout": Long handoffConditionTimeout,
      "workerThreads": Integer workerThreads,
      "chatThreads": Integer chatThreads,
      "chatRetries": Long chatRetries,
      "httpTimeout": Period httpTimeout,
      "shutdownTimeout": Period shutdownTimeout,
      "maxWarmCount": Integer maxWarmCount,
      "taskDealRowCount": Integer taskDealRowCount,
      "consumerThreadCount": Integer consumerThreadCount
}