Dab tsi tshiab hauv Spark?
Dab tsi tshiab hauv Spark?

Video: Dab tsi tshiab hauv Spark?

Video: Dab tsi tshiab hauv Spark?
Video: dag kuv dab tsi By zoo xyooj 2024, Tej zaum
Anonim

Lwm yam tshaj li kho kab, muaj 2 tshiab nta hauv Teeb 2.4: SPARK -22239 Tus neeg siv txhais lub qhov rais ua haujlwm nrog Pandas UDF. SPARK -22274 Tus neeg siv-txhais kev sib sau ua haujlwm nrog pandas udf. Peb ntseeg tej no tshiab nta yuav txhim kho kev saws me nyuam ntawm Pandas UDF, thiab peb yuav txhim kho Pandas UDF hauv kev tshaj tawm tom ntej.

Ib yam li ntawd, dab tsi yog qhov tseeb version ntawm Spark?

Keeb kwm

Version Thawj hnub tso tawm Tseeb version
2.2 2017-07-11 2.2.3
2.3 2018-02-28 2.3.3
2.4 2018-11-02 2.4.4
Lus dab neeg: Qub version Qub version, tseem khaws cia Tseeb version Tseeb saib ua ntej version

Ib sab saum toj no, puas yog SQL ANSI ua raws? Raws li ntawm Teeb 2.0, Teeb yog ANSI SQL :2003 ua raws , uas txhais tau tias Spark SQL txhawb nqa SQL ntawv cov haujlwm uas tsis muaj nyob rau hauv lwm yam lus.

Ntawm no, puas muaj kev txhawb nqa Java 11?

Scala thiab Java cov neeg siv tuaj yeem suav nrog Teeb nyob rau hauv lawv tej yaam num siv nws Maven coordinates thiab Python cov neeg siv tau nruab Teeb los ntawm PyPI. Teeb khiav rau Java 8/ 11 , Scala 2.12, Python 2.7+/3.4+ thiab R 3.1+.

Puas yog SQL txhawb nqa hloov tshiab?

2 Teb. Spark SQL tsis yog txhawb UPDATE nqe lus tseem. Hive tau pib txhawb UPDATE txij li Hive version 0.14. Tab sis txawm nrog Hive, nws txhawb kev hloov tshiab / deletes tsuas yog ntawm cov rooj uas kev txhawb nqa kev hloov pauv, nws tau hais hauv cov ntaub ntawv Hive.

Pom zoo: