W
W
web_dev2018-08-11 15:37:38
Apache Spark
web_dev, 2018-08-11 15:37:38

Sprak UI History server on Kubernetes?

Hello.
I'm running a spark-job on a Kubernetes cluster. Everything is ok, but I would like to see the history of all launches and other things in the Spark UI interface.
I can forward the port on which the spark-driver was launched and see the execution results there, and so on.
But I don’t want to go and look at the pod for each job, but what if several drivers start at the same time?
I would like to see everything in one interface. That's what the Spark UI History Server is for. I can't google at all, almost nothing. How to set it all up.
Who can prompt, help, who has relevant experience?
I would be grateful for any hints!

Answer the question

In order to leave comments, you need to log in

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question