Cov txheej txheem:

Kuv tuaj yeem nrhiav tau lub tshuab hluav taws xob nyob qhov twg?
Kuv tuaj yeem nrhiav tau lub tshuab hluav taws xob nyob qhov twg?

Video: Kuv tuaj yeem nrhiav tau lub tshuab hluav taws xob nyob qhov twg?

Video: Kuv tuaj yeem nrhiav tau lub tshuab hluav taws xob nyob qhov twg?
Video: Hluav taws xob tseem ceeb: Xaiv qhov nqi phiaj xwm rau koj 2024, Kaum ib hlis
Anonim

Log cov npe

Lub neej ntawd SPARK_WORKER_LOG_DIR qhov chaw yog /var/ log / spark / tus neeg ua haujlwm. Lub neej ntawd log directory rau pib lub Teeb SQL Thrift server yog $HOME/ spark -thrift-server. Teeb Plhaub thiab daim ntawv thov cov ntaub ntawv yog tso zis rau lub console. Log configuration ntaub ntawv nyob rau hauv tib directory li spark -env.sh.

Hais txog qhov no, kuv yuav ua li cas thiaj tau txais cov cav ntoo?

Teeb txoj haujlwm lossis daim ntawv thov los ntawm nplooj ntawv Tshawb Fawb, koj tuaj yeem nkag mus rau cov ntaub ntawv ntawm Application UI thiab Teeb Daim ntawv thov UI. nplooj ntawv, koj tuaj yeem nkag mus rau lub cov ntaub ntawv via cov Teeb Daim ntawv thov UI. Koj tseem tuaj yeem ntxiv cov ntaub ntawv txhawm rau txheeb xyuas qhov yuam kev thiab kev zam hauv Teeb txoj haujlwm lossis daim ntawv thov ua tsis tiav.

Ib yam li ntawd, koj yuav ua li cas kuaj cov xov paj? Saib a log file Cov cov ntaub ntawv ntawm tus tswv daim ntawv thov kuj tuaj yeem pom hauv qhov browser hauv qhov chaw tswj hwm UI ntawm xov paj .resourcemanager.webapp.address}/cluster (https://localhost:8088 ntawm ib leeg "cluster").

Ib yam li ib tug yuav nug, Kuv yuav ua li cas thiaj li tau txais executor cav ntawm Spark?

Teb

  1. Cov lus qhia kom tau txais Spark executor cav:
  2. Rau Amabari - 1) Mus rau Spark Service thiab Configs tab: 2) Nrhiav "Advanced spark-log4j-properties" nkag.
  3. Rau Cloudera -- Teem: spark.executor.extraJavaOptions=-Dlog4j.configuration=file:/etc/spark/conf.cloudera.spark_on_yarn/log4j.properties.

Kuv yuav ua li cas thiaj nrhiav tau kuv lub txim keeb kwm server URL?

Ej., for the keeb kwm server , lawv feem ntau yuav nkag tau ntawm server - url >:18080/api/v1, thiab rau daim ntawv thov khiav, ntawm https://localhost:4040/api/v1. Hauv API, ib daim ntawv thov raug xa mus los ntawm nws daim ntawv thov ID, [app-id].

Pom zoo: