big data in healthcare Yagnik Khanna - Critical pipe fittings: What every data pipeline requires

Most organizations leveraging data do so on technologies such as Hadoop, Spark or Vertica. All these allow organizations to process data but nearly always these organizations maintain code base / frameworks etc which the builders use to clean, process and query this data. While building Starscream (Shopify’s dimensional modelling framework on top Spark), we learnt various lessons about numerous building blocks that don’t come as part of these technologies yet are critical for smooth functioning and transparency of our data pipeline. The talk aims to provide the audience with these building blocks such as metadata, incremental builds etc, their use case and how they helped Shopify ship faster.

big data in healthcare Yagnik Khanna - Critical pipe fittings: What every data pipeline requires
4 Likes	4 Dislikes
361 views views	12.3K followers
Science & Technology Creative Commons Attribution licence (reuse allowed)	Upload TimePublished on 16 Jul 2015

Related keywords

events in atlanta,shopify dropshipping,big data examples,big data technologies,big data companies,data analytics with python,conference florentia hotel,events tonight,big data interview questions,conference call borderlands 2,data science unisinos,indian visa application form,indian movie,data analytics jobs,machine learning tutorial,data science para negócios pdf,conference alert 2019,big data hadoop,events,data science do zero,indian song,eventbrite,machine learning basics,machine learning projects,conference proceedings of science and technology,event insurance,india cricket,data analytics toronto,shopify คือ,conference hall plan,india vs west indies,shopify plus,big data conference,ইন্ডিয়া এলার্ট,machine learning projects ideas,machine learning python,machine learning wiki,shopify กับ wordpress,big data analysis,data analytics certification,shopify logo,data science for business,data analytics manager,eventide,data science salario,data science para leigos,data science academy vale a pena,data science course,machine learning course,events in los angeles,big data university,conference maker,machine learning ppt,data science from scratch,events near me this weekend,event planner,shopify thailand,big data definition,indian map,machine learning algorithms,india vs west indies live,data analytics brainstation,indian news,shopify ดีไหม,data analytics masters,events near me today,shopify theme,data science porto alegre,india bet,indian,shopify ราคา,data analytics courses,data science academy python,conference interpreting,data analytics uoft,shopify pos,shopify partner,data science academy é bom,conference premier,shopify shop,events near me tonight,indiabix,conference proceedings citation index,events in houston,shopify ภาษาไทย,big data engineer salary,indian rupee,data science brasil,machine learning jobs,data science para negócios,shopify login,conference hall,india map,events and adventures,data analytics online courses,data analytics strategy,shopify thailand คือ,events this weekend,machine learning using python,shopify app,conference paper,data analytics courses toronto,events near me,big data dangerous,conference series,data analytics companies toronto,conference proceedings citation index nedir,machine learning meaning,shopify plan,big data band,conference monkey,data analytics skills,indian bangla newspaper,machine learning jobs in chennai,conference hall dwg,indian railway,shopify pantip,data science uniritter,big data tools,data science curso,conferences 2019,events in chicago,big data architecture,data analytics salary,machine learning pdf,machine learning applications,eventbrite login,data science do zero pdf,big data engineer,indian web series,indian visa bd,machine learning courses in chennai,big data certification,data analytics jobs toronto,machine learning interview questions,big data analytics,data science academy power bi,shopify dropship,data science brazil,machine learning certification,events happening near me,data analytics tools,data analytics university of toronto,shopify payment,events today,data analytics software,indian visa,indiamart,conference proceedings,conference ne demek,machine learning examples,conference program,event horizon,data analytics definition,data science pucrs,big data dangerous lyrics,conference call,big data jobs,machine learning vs deep learning,