Spark Worker

Introduction

Here we'll go over the Spark Worker Configuration. 

Requirements

 

Spark Worker Data Sources
 
Open up the configuration modal for Spark, and click on the Configure Data Sources tab.  In the Add a data source drop down menu [1], select Spark Woker.  Click on Edit [2] to the right to expose the fields that need to be configured [3]:

SparkWorkerConfig.png

 
The plugin requires the following information:
 
Field Name Default Value Description
Host  _HOST:8081_   
 Port  8081  
 UrlPath  /metrics/json  
 Run as Unix User  nobody  

  

Spark Worker Metrics 

 

Metric Name Units Metric Description
worker.cores.free.count Count Number of cores free on the worker
worker.cores.used.count Count Number of cores used by the worker
worker.executors.count Count Number of executors currently running on this worker
worker.memory.free Megabytes Memory free on the worker in megabytes
worker.memory.used Megabytes Memory used on the worker in megabytes
Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.