Technical Case Study: Klout implementation of Analysis Services over Hive (Big Data)


Klout (www.klout.com) measures influence across the social web by analyzing social network user data. Klout uses the impact of opinions, links, and recommendations to identify influential individuals. Every day Klout scans 15 social networks, scores hundreds of millions of profiles, and processes over 12 billion data points.

The Klout data warehouse, which relies on Apache Hadoop-based technology, exceeds 800 terabytes of data. But Klout doesn’t just crunch large data volumes; Klout takes advantage of Microsoft SQL Server 2012 Analysis Services to deliver reliable scores and actionable insights at the speed of thought.

Microsoft and Klout collaborated to build this Big Data Analytics solution. The goal for this solution was to find a cost-effective way to combine the power of Hadoop with the power of Analysis Services. The result is a solution that connects Analysis Services to Hadoop/Hive via the relational SQL Server engine, enabling Klout to reduce data latencies, eliminate maintenance overhead and costs, move aggregation processing to Hadoop, and shorten development cycles dramatically. Organizations in any industry and business sector can adopt the solution presented in this technical case study to exploit the benefits of Hadoop while preserving existing investments in SQL Server technology. This case study discusses the necessary integration techniques and lessons learned.

To review the document, please download the SQL Server Analysis Services to Hive Word document.

Comments (6)

  1. hassan sayed issa20014 says:

    thank you

  2. Anonymous says:

    Good Article.

  3. rehan singh says:

    Great post! Apache Hive supports analysis of large datasets stored in Hadoop’s HDFS and compatible file systems such as Amazon S3 filesystem. It provides an SQL-like language called HiveQL with schema on read and transparently converts queries to map/reduce,
    Apache Tez and Spark jobs. All three execution engines can run in Hadoop YARN. To accelerate queries, it provides indexes, including bitmap indexes. More at http://www.youtube.com/watch?v=1jMR4cHBwZE

  4. WQ says:

    http://www.fashionclothing.mex.com/ Sure,
    http://www.louisvuitton.so/ the process
    http://www.burberryonlineshop.de/ of flinging
    http://www.nikefree-run.org.uk/ a spinnerbait
    http://www.harrods-london.co.uk/ may
    http://www.airmax-90.org/ catch
    http://www.pradashoes.com.co/ a http://www.lululemoncanada.ca/ rogue fish off
    http://www.nike-air-max.com.de/ of
    http://www.yoga-pants.ca/ nothing http://www.rayban.com.de/ here and
    http://www.longchampoutlet.com.co/ there,
    http://www.babyliss.us.org/ but
    http://www.nike-air-max.ca/ I’ve found that
    http://www.nike-roshe-run.de/ during the
    http://www.nike-air-max.com.au/ course
    http://www.the-north-face.ca/ of the http://www.longchamp.us.org/ average true
    http://www.ghdhairstraightener.com.co/ cover-seeking day, your
    http://www.newbalance.com.es/ only looking
    http://www.nike-rosherun.nl/ for a
    http://www.burberry-outlet.me.uk/ few extra bites
    http://www.abercrombie-hollister.nl/ from “between”
    http://www.rolex-watches-canada.ca/ bass.
    http://www.christianlouboutin.org.uk/ I’d
    http://www.swarovski-australia.com.au/ rather
    http://www.hollister-abercrombie.com.se/ be
    http://www.converse.com.de/ locked http://www.tiffany-und-co.de/ and
    http://www.truereligionjeans.net.co/ loaded for
    http://www.bcbgdresses.in.net/ the
    http://www.ralphlaurenoutletonline.in.net/ gentle
    http://www.the-northface.com.co/ pitch, then
    http://www.coachoutlet-online.com.co/ carelessly
    http://www.louis-vuittonoutletcanada.ca/ unleashing
    http://www.longchamp.com.de/ the http://www.mmoncler-outlet.com/ firing
    http://www.montblanc–pens.in.net/ squad.
    http://www.ralphlaurenoutletonline.us.org/ What
    http://www.guccioutlet.us.org/ I
    http://www.uggs.co.nl/ mean
    http://www.cheapoakleysunglasses.ar.com/ is that
    http://www.pandorajewellery.com.au/ in most cases
    http://www.nikeshoesoutlet.org.uk/ I’d
    http://www.handbagsoutlet.com.co/ rather
    http://www.uggbootsclearance.com.co/ be putting along “between”
    http://www.horloges-rolex.nl/ at http://www.toryburchsale.com.co/ a
    http://www.michaelkorsoutlet.ar.com/ moderate pace
    http://www.celinebags.org/ with
    http://www.bcbg-max-azria.ca/ the
    http://www.louisvuitton-outlet.com.co/ same
    http://www.designerhandbagsoutlet.com.co/ jig
    http://www.michaelkors.co.nl/ in my
    http://www.michaeljordan.com.de/ hand that I
    http://www.nike-air-max.com.se/ had
    http://www.thenorthfacejackets.in.net/ success with on
    http://www.burberry–outlet.com.co/ the http://www.prada.com.de/ docks
    http://www.cheapjerseys.us.org/ all
    http://www.maccosmetics.gr.com/ day, and
    http://www.michael-kors.com.co/ looking
    http://www.louboutin.jp.net/ for
    http://www.swarovski-online-shop.de/ that
    http://www.vans-schuhe.com.de/ unique
    http://www.michaelkorsoutletonline-sale.us.com/ cast/pitch
    http://www.cheap-uggboots.in.net/ to
    http://www.mcmhandbags.com.co/ something

  5. aw says:

    I think your article is very useful, it might be in more detail further suggest the method clearer method, can be of several categories that you created or any of several methods that should be done in the process of it, thank you very much
    http://www.lokerjobindo.com lokerius
    http://www.kerjabumn.com somone
    http://www.lokerjobindo.com/2015/10/lowongan-bumn-brantas-abipraya-persero.html I need
    http://www.kerjabumn.com/2015/10/lowongan-bumn-brantas-abipraya-persero.html beberapa
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-terbaru.html langka sebenaernua
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bumn-pt-nindya-karya.html ada rasa
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bank-cimb-niaga.html sama kita
    http://www.lokerjobindo.com/2015/11/info-kerja-bumn-pt-sarana-multi.html tapi sebenarnya
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-terbaru-pt-citilink.html tahukan anda
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-d3-s1-pt-hk-realtindo.html sebutan dari
    http://www.lokerjobindo.com/2015/11/info-kerja-bank-bri-frontliner.html kita adalah
    http://www.lokerjobindo.com/2015/11/info-lowongan-kerja-staf-hubungan.html anugrah yang

    http://www.lokerjobindo.com/2015/11/lowongan-kerja-pt-pertamina-retail.html dapat kita
    http://www.lokerjobindo.com/2015/11/info-kerja-professional-insurance.html capai

    http://www.lokerjobindo.com/2015/11/lowongan-kerja-it-programmer.html sebenarnya
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bank-bca-syariah.html rahasia itu
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bank-danamon.html hanya ada
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-d3.html dalam sebuah cerita
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-pt-bni-life-insurance.html tentang kita
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-pt-axa-mandiri.html yah begitulah hidup
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bank-sinamrmas.html hidup itu cuma sekali
    http://www.lokerjobindo.com/2015/11/lowongan-kerja-bank-mandiri-syariah.html tidak ada keduakalinya
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-bank-btn.html maksudnya cuma hidup di dunia
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-pt-astra-international.html rahasia semua kediupan
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-adira-finance.html semuanya akan

    http://www.lokerjobindo.com/2015/10/lowongan-kerja-pertamina-geothermal.html ada saatnya di mana
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-bank-bca.html semua akan melakkan
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-bank-jatim.html langkah satu persatu
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-terbaru-icon-pln.html demi mengjar suksesnya
    http://www.lokerjobindo.com/2015/10/lowongan-kerja-terbaru-s1-kalbe.html rahasia hidup

  6. dongdong says:

    20151225dongdong
    http://www.coach-factoryoutlet.com.co

    http://www.get-coachoutletonline.org

    http://www.hermesbelt.in.net
    http://www.vipmichaelkors-outletonline.com

    http://northface.outletmalls.us.com

    http://www.gucci-outlet.org
    http://www.airmax95.org.uk
    http://coach.outletmalls.us.com
    http://www.ghdhairstraighteners.com.co

    http://www.michaelkors-handbag.me.uk

    http://www.sunglass-outlet.us
    http://www.snapbacks-wholesale.us

    http://www.adidassuperstar.co.uk
    http://www.canada-goosejackets.biz

    http://www.michael–korsoutlet.us.com

    http://www.michaelkors-mkoutlet.in.net

    http://www.louisvuittonoutlets.name

    http://www.katespadeuk.me.uk
    http://christianlouboutin.outletmalls.us.com

    http://www.sac-longchamppliage.fr

    http://www.cheapwholesaleuggboots.com

    http://www.poloralphlauren.net.co

    http://www.ugg-boots-australia.com

    http://www.jordan3.net
    http://www.michaelkors-outletonlines.in.net

    http://www.saclongchamp–pascher.fr

    http://www.ugg-sale.in.net
    http://www.jordan4.net
    http://www.michaelkorsukbag.co.uk

    http://www.chaussure-louboutin.fr

    http://www.cheap-uggsonsale.in.net

    http://nike.outletmalls.us.com
    http://www.truereligion-outlet.net.co

    http://www.cheapjordansshoes.in.net

    http://tiffany.outletmalls.us.com

    http://www.new-balanceoutlet.us
    http://www.cheap-tomsoutlet.us
    http://www.louis-vuitton-outlet.us.com

    http://www.coach-factoryoutlet.eu.com

    http://www.guccioutlet.com.so
    http://www.jordan8.net
    http://www.soccer-jerseys.us.com
    http://www.mcmhandbags.name
    http://www.longchampoutlet.net.co

    http://www.michaelkors-outletsale.com

    http://www.jordan6.net
    http://www.jordan13.org
    http://www.raybansunglassesdeals.com.co

    http://www.nike-tn-pascher.fr