How to monitor spark?

N

nano_e_t_42017-07-16 18:07:39

Apache Spark

nano_e_t_4, 2017-07-16 18:07:39

Tell everyone tell me
who knows how to monitor the spark, without using third-party packages / engines

Reply

Answer the question

In order to leave comments, you need to log in

1 answer(s)

M

magazovski, 2017-07-16
@magazovski

What do you mean by "monitor"?
Logs can be viewed in the Spark History Server
There is also basic information on timings
While the application is running, it raises SparkUI, you can also watch something there

Similar questions

D

denislysenko2021-12-14 14:47:05

How to set up pycharm to work with spark? 1Reply

D

denislysenko2021-12-15 21:50:09

How to remove this error? 0Reply

M

Mamol272020-09-10 16:35:28

Why can't intellij IDEA see libraries connected with maven? 0Reply

D

denislysenko2022-01-03 00:07:47

When is it better to use SparkCore (i.e. sparkContext entry point), and when is it better to use Spark dataframe or sparkSql? 0Reply

D

denislysenko2022-02-10 17:26:50

How can I parse nested JSON using Spark.sql, Spark.Dataframe or azure data factory so that I have a relational table? 0Reply

Didn't find what you were looking for?

Ask your question