Puas yog sigmoid zoo dua ReLU?
Puas yog sigmoid zoo dua ReLU?

Video: Puas yog sigmoid zoo dua ReLU?

Video: Puas yog sigmoid zoo dua ReLU?
Video: Mang Vang New Song 2020 - puas yog vim kuv [Official Video] 2024, Kaum ib hlis
Anonim

Relu : Ua kom muaj txiaj ntsig zoo rau kev suav tshaj Sigmoid zoo li functions txij li thaum Relu tsuas yog xav tau cov npe max(0, x) thiab tsis ua haujlwm kim exponential asin Sigmoids. Relu : Hauv kev xyaum, kev sib txuas nrog Relu nyiam qhia zoo dua convergence kev ua tau zoo duasigmoid.

Ib yam li ib tug yuav nug, vim li cas ReLU yog qhov ua kom zoo tshaj plaws?

Lub tswv yim tseem ceeb yog cia qhov gradient tsis yog xoom thiab rov qab los thaum kev cob qhia nws thiaj li. ReLu yog lowcomputationally kim tshaj tanh thiab sigmoid vim nws koom nrog kev ua lej yooj yim dua. Ntawd yog ib zoo taw tes los xav txog thaum peb tab tom tsim cov neuralnets sib sib zog nqus.

Ib tug kuj yuav nug, dab tsi yog sigmoid ua kom muaj nuj nqi? Cov sigmoid muaj nuj nqi yog a ua kom muaj nuj nqi nyob rau hauv cov nqe lus ntawm lub hauv paus rooj vag tsim nyob rau hauv kev sib raug zoo nrog Neurons firing, nyob rau hauv Neural Networks. Lub derivative, kuj ua tobe a ua kom muaj nuj nqi nyob rau hauv cov nqe lus ntawm tuav Neuron ua kom ntawm NN's. Qhov sib txawv ntawm ob yog ua kom degree thiab interplay.

Ib yam li ntawd, vim li cas peb thiaj siv ReLU hauv CNN?

Convolutional Neural Networks ( CNN ): Kauj Ruam 1(b) - ReLU Txheej. Rectified Linear Unit, los yog ReLU , yog tsis yog ib feem ntawm lub convolutional neuralnetworks cov txheej txheem. Lub hom phiaj ntawm kev siv lub rectifier muaj nuj nqi yog kom nce qhov tsis-linearity hauv peb cov duab.

Kev siv ReLU yog dab tsi?

ReLU (Rectified Linear Unit) ActivationFunction Lub ReLU yog feem ntau siv activationfunction nyob rau hauv lub ntiaj teb no tam sim no. Vim li cas, nws yog siv nyob rau hauv yuav luag tag nrho cov convolutional neural tes hauj lwm los yog deeplearning.

Pom zoo: