A cikin labarin " Big Data Fasahar Gudanarwa: Hadoop da Spark ," za mu bincika dalla-dalla dalla-dalla fasahohi biyu masu shahara da ƙarfi don sarrafawa big data: Hadoop da Spark.
Anan akwai cikakkun bayanai na kowace fasaha tare da misalai don kwatanta yadda suke aiki.
Hadoop
Hadoop an gina shi akan tsarin sarrafa bayanai da aka rarraba mai suna MapReduce. Yana rarraba ayyukan sarrafawa zuwa ƙananan sassa kuma yana rarraba su a kan nodes da yawa a cikin hanyar sadarwa. Kowane kumburi yana aiwatar da ɓangaren bayanan sa'an nan kuma ya aika da sakamakon baya zuwa babban kumburin don haɗawa ta ƙarshe. Wannan yana inganta saurin sarrafa bayanai da scalability na tsarin.
Misali: Bari mu yi la'akari da babban bayanan da ke ɗauke da bayanan mu'amalar kuɗi. Yin amfani da Hadoop, za mu iya raba ma'aunin bayanan cikin ƙananan guntu kuma mu rarraba su zuwa nodes ɗin sarrafawa. Kowane kumburin sarrafawa yana ƙididdige adadin kuɗin da ke cikin ɓangaren bayanansa. Sakamako daga kowane kumburi ana mayar da su zuwa babban kumburi, inda aka haɗa su don samar da jimillar adadin ƙarshe daga duk bayanan.
Spark
Spark yana ba da yanayi mai mu'amala da kuma ainihin-lokacin sarrafa bayanai tare da saurin sarrafa bayanai. Yana amfani da ra'ayi na Resilient Distributed Datasets(RDDs), waɗanda ba su iya canzawa da kuma rarraba tarin abubuwa, don sarrafa bayanai a kan nodes da yawa a cikin hanyar sadarwa. RDDs suna ba da damar sarrafa bayanai daidai gwargwado da dawo da kai idan aka sami gazawa.
Misali: Bari mu yi la'akari da yanayi inda muke buƙatar nazarin bayanai daga na'urori masu auna firikwensin IoT don hasashen yanayin yanayi. Yin amfani da Spark, za mu iya ƙirƙirar RDDs daga bayanan firikwensin kuma amfani da canje-canje da ayyuka akan RDDs don ƙididdige alamun yanayi kamar zazzabi, zafi, da matsa lamba. Ana yin waɗannan ƙididdiga a layi ɗaya akan nodes ɗin sarrafawa daban-daban, saurin ƙididdigewa da ba da damar sarrafa bayanai na lokaci-lokaci.
Dukansu Hadoop da Spark suna ba da ingantacciyar hanyar sarrafawa big data. Zaɓin tsakanin fasahohin biyu ya dogara da takamaiman buƙatun aikin da nau'in ayyukan sarrafa bayanai da ke tattare da su.