Dab tsi version ntawm Python siv hluav taws xob?
Dab tsi version ntawm Python siv hluav taws xob?

Video: Dab tsi version ntawm Python siv hluav taws xob?

Video: Dab tsi version ntawm Python siv hluav taws xob?
Video: Data Science with Python! Joining Tables Without a Common Column 2024, Hlis ntuj nqeg
Anonim

Teeb khiav ntawm Java 8+, Python 2.7+/3.4+ thiab R 3.1+. Rau Scala API, Teeb 2.3. 0 siv Scala 2.11. Koj yuav tau siv Scala sib xws version (2.11.

Raws li kev sib raug zoo, puas ua haujlwm nrog Python 3?

Apache Teeb yog ib lub hauv paus kev xam phaj, tam sim no yog ib qho tseem ceeb tshaj plaws tsim nyob rau hauv qhib-qhov chaw loj Cov ntaub ntawv arena. Txij li qhov tseeb version 1.4 (Lub Rau Hli 2015), Teeb txhawb R thiab Python 3 (kom ntxiv cov kev txhawb nqa yav dhau los rau Java, Scala thiab Python 2).

Ib sab saum toj no, kuv yuav hloov pauv lub txim taws ntawm Python li cas? Thaum koj tsuas xav tau hloov tus python version rau txoj haujlwm tam sim no, koj tuaj yeem siv pyspark pib cov lus txib nram qab no: PYSPARK_DRIVER_PYTHON=/home/user1/anaconda2/bin/ python PYSPARK_PYTHON=/usr/local/anaconda2/bin/ python pyspark --master..

Tsis tas li ntawd, dab tsi yog qhov tseeb spark version?

Apache Spark

Original author(s) Matei Zaharia
Kev tso tawm thawj zaug Lub Tsib Hlis 26, 2014
Kev tso tawm ruaj khov 2.4.5 / Lub Ob Hlis 8, 2020
Chaw khaws cia Spark Repository
Sau rau hauv Scala

Dab tsi yog spark Python?

Taming Cov Ntaub Ntawv Loj nrog Apache Teeb thiab Python Py4J yog lub tsev qiv ntawv nrov tshaj plaws ua ke hauv PySpark tias cia python interface dynamically nrog JVM cov khoom (RDD's). Apache Teeb los nrog kev sib tham sib plhaub rau python raws li nws ua rau Scala. Lub plhaub rau python yog lub npe hu ua PySpark ”.

Pom zoo: