Cov txheej txheem:

Kuv yuav ua li cas thiaj paub yog tias spark yog ntsia Linux?
Kuv yuav ua li cas thiaj paub yog tias spark yog ntsia Linux?

Video: Kuv yuav ua li cas thiaj paub yog tias spark yog ntsia Linux?

Video: Kuv yuav ua li cas thiaj paub yog tias spark yog ntsia Linux?
Video: Parent Aware Individualized Learning 2024, Hlis ntuj nqeg
Anonim

2 Teb

  1. Qhib Teeb plhaub Terminal thiab nkag mus hais kom ua.
  2. sc.version Lub spark -submit --version.
  3. Txoj kev yooj yim tshaj yog cia li tso tawm " spark -shell" hauv kab lus hais. Nws yuav tso saib cov.
  4. tam sim no active version ntawm Teeb .

Kuj kom paub yog, kuv yuav ua li cas thiaj paub yog tias lub txim raug ntsia Ubuntu?

Txhim kho Spark ntawm Ubuntu

  1. Download tau qhov kev tso tawm tshiab ntawm Spark ntawm no.
  2. Unpack lub archive.
  3. Txav mus rau cov ntawv tais ceev tseg thiab tsim cov cim txuas kom koj tuaj yeem muaj ntau yam ntawm Spark ntsia.
  4. Ntsuam xyuas lub Spark plhaub.
  5. Tej zaum Scala tsis yog koj khob tshuaj yej thiab koj xav siv Python.

Qhov thib ob, qhov hluav taws xob ntsia ntawm EMR nyob qhov twg? Raws li ntawm ua emr -4.0. 0, txhua daim ntawv thov rau EMR yog in /usr/lib. Teeb yog hauv /usr/lib/ spark.

Yog li ntawd, koj yuav teeb lub txim li cas?

Cov kauj ruam rau nruab Spark

  1. Kauj ruam 1: Xyuas kom meej tias Java yog ntsia.
  2. Kauj ruam 2: Xyuas kom meej tias Scala yog ntsia.
  3. Kauj ruam 3: Download Scala.
  4. Kauj ruam 4: Nruab Scala.
  5. Kauj ruam 5: Downloading Apache Spark.
  6. Kauj ruam 6: Txhim kho Spark.
  7. Kauj ruam 7: Txheeb xyuas qhov teeb tsa ntawm Spark daim ntawv thov ntawm koj lub cev.

Kuv puas yuav tsum tau nruab Scala rau txim?

Koj yuav xav tau siv tau tshaj Scala version (2.10. x). Java yog ib qho yuav tsum tau ua Teeb + ntau lwm yam kev hloov pauv hloov pauv ( scala compiler tsuas yog lub tsev qiv ntawv rau JVM). PySpark tsuas yog txuas mus rau thaj chaw deb (los ntawm qhov (socket)) rau JVM siv Py4J (Python-Java kev cuam tshuam).

Pom zoo: