Ingest and Stream Processing - What will you choose? Ingest and Stream Processing - What will you choose? - Download as a PDF or view online for free

Slides from my #HS16Dublin session with @TedMalaska, 'Ingest and Stream Processing - What will you choose?’ www.slideshare.net/metadaddy/ingest-and-str...

Ingest & Stream Processing - What will you choose? | Software Development Conference QCon New York A lot has changed and a lot has stayed the same with Ingest and Stream Processing over the years. But today there are many options than even for Ingest and Stream Processing that one may wonder why one solution versus the other. The problem is that in this space, one size does not fit all, and that makes it all the more confusing. This talk aims at giving the audience a direction to choose when it comes to Ingest and Stream Processing. We aim to help the audience understand the solutions available to them, and to make the best choice based on their use-case. In this talk, we will be go over current and emerging technologies in the marketplace. We will evaluate each and understand how they are useful in solving problems related to large scale data processing, joining and combining streams. We will also look at the various ways of achieving "at least once" and "exactly once" processing. We will discuss how each of these can be scaled and how we can make sure that data is processed in a timely fashion.

Ingest & Stream Processing - What Will You Choose? qconnewyork.com/ny2016/presentation/inge... @TedMalaska and I will be reprising our #HS16Dublin session!

Cloudera Blog

Nice round up of #HS16Dublin by @MarkRHerring hortonworks.com/blog/hadoop-summit-dubli... Click through to ‘Ingest & Stream Processing’ while you’re there!

#HS16Dublin recording of me & @TedMalaska: "Ingest & Stream Processing: What WIll You Choose" http://youtu.be/LTONR-L40Xg #StreamSets #Cloudera

API Integration Platform | Software AG Unlock innovation within your organization with seamless connections made possible by Software AG's API integration platform and microservices.

Ingesting JSON Data Into #ApacheKudu with #StreamSets Data Collector streamsets.com/blog/ingesting-json-data... Putting a bow on the #HS16Dublin session

#HS16Dublin recording of me & @TedMalaska: "Ingest & Stream Processing: What WIll You Choose" https://www.youtube.com/watch?v=wdX_uvfVP0g #StreamSets #Cloudera

Code for the Minecraft / #ApacheKafka Plugin I showed at #HS16Dublin - make your own maps! https://github.com/metadaddy/KafkaPlugin

Pat is drinking a Dublin Porter by Guinness I keep seeing elephants! #HS16Dublin

I keep seeing elephants! #HS16Dublin - Drinking a Dublin Porter at @guinnessireland - http://untp.beer/s/c299202858 #photo

Pat is drinking a Guinness Original (Europe) by Guinness At the source! #HS16Dublin

At the source! #HS16Dublin - Drinking a Guinness Original (Europe) at @guinnessireland - http://untp.beer/s/c299196551 #photo

Demo of StreamSets Data Collector with Apache Kafka, Kudu & Minecraft, as seen at #HS16Dublin https://youtu.be/Gnvl30OJNao

Full house for my #HS16Dublin ingest session w @TedMalaska! #Cloudera #StreamSets

Learning all about the Apache Hadoop YARN roadmap from @tshooter at #HS16Dublin

Kafka, and StreamSets and Kudu, oh my! @TedMalaska and I talk about ingest & stream processing, today at 2:10pm, Liffey Hall 2 #HS16Dublin

Let's do this! #HS16Dublin

Going to #HadoopSummit #HS16Dublin? See @TedMalaska & me: 'Ingest & Stream Processing, What Will You Choose?', Liffey Hall 2, 2:10pm Wed

Sneak preview of session I'll present with @TedMalaska next week #HadoopSummit #HS16Dublin #ApacheKudu #StreamSets