4.1.1 Prod Spark Cluster

  • URL: spark://prod-master-0:7077
  • REST URL: spark://prod-master-0:6066 (cluster mode)
  • Workers: 3 Alive, 0 Dead, 0 Decommissioned, 0 Unknown
  • Cores in use: 12 Total, 3 Used
  • Memory in use: 20.3 GiB Total, 3.0 GiB Used
  • Resources in use:
  • Applications: 1 Running, 0 Completed
  • Drivers: 0 Running (0 Waiting), 0 Completed (0 Killed, 0 Failed, 0 Error, 0 Relaunching)
  • Status: ALIVE (Environment, Log)

Workers (3)

Worker IdAddressStateCoresMemory
worker-20260318182029-192.168.139.190-42537 192.168.139.190:42537 ALIVE 4 (1 Used) 6.8 GiB (1024.0 MiB Used)
worker-20260318182304-192.168.78.196-37681 192.168.78.196:37681 ALIVE 4 (1 Used) 6.8 GiB (1024.0 MiB Used)
worker-20260318182948-192.168.139.155-32939 192.168.139.155:32939 ALIVE 4 (1 Used) 6.8 GiB (1024.0 MiB Used)

Running Applications (1)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20260318190844-0000
(kill)
org.apache.spark.sql.connect.service.SparkConnectServer 3 1024.0 MiB 2026/03/18 19:08:44 spark RUNNING 3.6 h

Completed Applications (0)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration