Key Default Type Description
minicluster.number-of-taskmanagers
1 Integer The number of task managers of MiniCluster.
task.cancellation.interval
30000 Long Time interval between two successive task cancellation attempts in milliseconds.
task.cancellation.timeout
180000 Long Timeout in milliseconds after which a task cancellation times out and leads to a fatal TaskManager error. A value of 0 deactivates the watch dog. Notice that a task cancellation is different from both a task failure and a clean shutdown. Task cancellation timeout only applies to task cancellation and does not apply to task closing/clean-up caused by a task failure or a clean shutdown.
task.cancellation.timers.timeout
7500 Long Time we wait for the timers in milliseconds to finish all pending timer threads when the stream task is cancelled.
taskmanager.bind-host
(none) String The local address of the network interface that the task manager binds to. If not configured, '0.0.0.0' will be used.
taskmanager.collect-sink.port
0 Integer The port used for the client to retrieve query results from the TaskManager. The default value is 0, which corresponds to a random port assignment.
taskmanager.debug.memory.log
false Boolean Flag indicating whether to start a thread, which repeatedly logs the memory usage of the JVM.
taskmanager.debug.memory.log-interval
5000 Long The interval (in ms) for the log thread to log the current memory usage.
taskmanager.host
(none) String The external address of the network interface where the TaskManager is exposed. Because different TaskManagers need different values for this option, usually it is specified in an additional non-shared TaskManager-specific config file.
taskmanager.jvm-exit-on-oom
false Boolean Whether to kill the TaskManager when the task thread throws an OutOfMemoryError.
taskmanager.load-balance.mode
NONE

Enum

Mode for the load-balance allocation strategy across all available TaskManagers.
  • The SLOTS mode tries to spread out the slots evenly across all available TaskManagers.
  • The NONE mode is the default mode without any specified strategy.


Possible values:
  • "NONE"
  • "SLOTS"
taskmanager.log.path
System.getProperty("log.file") String The path to the log file of the task manager.
taskmanager.network.bind-policy
"ip" String The automatic address binding policy used by the TaskManager if "taskmanager.host" is not set. The value should be one of the following:
  • "name" - uses hostname as binding address
  • "ip" - uses host's ip address as binding address
taskmanager.network.memory.buffer-debloat.enabled
false Boolean The switch of the automatic buffered debloating feature. If enabled the amount of in-flight data will be adjusted automatically accordingly to the measured throughput.
taskmanager.network.memory.buffer-debloat.period
200 ms Duration The minimum period of time after which the buffer size will be debloated if required. The low value provides a fast reaction to the load fluctuation but can influence the performance.
taskmanager.network.memory.buffer-debloat.samples
20 Integer The number of the last buffer size values that will be taken for the correct calculation of the new one.
taskmanager.network.memory.buffer-debloat.target
1 s Duration The target total time after which buffered in-flight data should be fully consumed. This configuration option will be used, in combination with the measured throughput, to adjust the amount of in-flight data.
taskmanager.network.memory.buffer-debloat.threshold-percentages
25 Integer The minimum difference in percentage between the newly calculated buffer size and the old one to announce the new value. Can be used to avoid constant back and forth small adjustments.
taskmanager.numberOfTaskSlots
1 Integer The number of parallel operator or user function instances that a single TaskManager can run. If this value is larger than 1, a single TaskManager takes multiple instances of a function or operator. That way, the TaskManager can utilize multiple CPU cores, but at the same time, the available memory is divided between the different operator or function instances. This value is typically proportional to the number of physical CPU cores that the TaskManager's machine has (e.g., equal to the number of cores, or half the number of cores).
taskmanager.registration.timeout
5 min Duration Defines the timeout for the TaskManager registration. If the duration is exceeded without a successful registration, then the TaskManager terminates.
taskmanager.resource-id
(none) String The TaskManager's ResourceID. If not configured, the ResourceID will be generated with the "RpcAddress:RpcPort" and a 6-character random string. Notice that this option is not valid in Yarn and Native Kubernetes mode.
taskmanager.rpc.bind-port
(none) Integer The local RPC port that the TaskManager binds to. If not configured, the external port (configured by 'taskmanager.rpc.port') will be used.
taskmanager.rpc.port
"0" String The external RPC port where the TaskManager is exposed. Accepts a list of ports (“50100,50101”), ranges (“50100-50200”) or a combination of both. It is recommended to set a range of ports to avoid collisions when multiple TaskManagers are running on the same machine.
taskmanager.runtime.fs-timeout
0 ms Duration The timeout for filesystem stream opening. A value of 0 indicates infinite waiting.
taskmanager.slot.timeout
10 s Duration Timeout used for identifying inactive slots. The TaskManager will free the slot if it does not become active within the given amount of time. Inactive slots can be caused by an out-dated slot request. If no value is configured, then it will fall back to pekko.ask.timeout.
taskmanager.system-out.log.cache-upper-size
100 kb MemorySize The cache upper size when Flink caches current line context of System.out or System.err when taskmanager.system-out.mode is LOG.
taskmanager.system-out.log.thread-name.enabled
false Boolean Whether to log the thread name when taskmanager.system-out.mode is LOG.
taskmanager.system-out.mode
DEFAULT

Enum

Redirection mode of System.out and System.err for all TaskManagers.
  • DEFAULT: TaskManagers don't redirect the System.out and System.err, it's the default value.
  • LOG: TaskManagers redirect System.out and System.err to LOG.info and LOG.error.
  • IGNORE: TaskManagers ignore System.out and System.err directly.


Possible values:
  • "DEFAULT"
  • "LOG"
  • "IGNORE"