Working with Apache Spark: Highlights from projects built in three weeks(insightdataengineering.com)

24 pointsby ddrum001قبل 11 سنة6 comments

Working with Apache Spark: Highlights from projects built in three weeks

http://www.insightdataengineering.com/blog/Working-With-Apache-Spark.html

6 comments

sampathwebقبل 11 سنة

Really Nice set of projects. Would have also like to see a starter application with a mini tutorial on how someone can experiment with some of these technologies.

Github references on these projects would also have been useful. Thanks for sharing.

phaefeleقبل 11 سنة

Did you consider Summingbird? Seems like a lot of what you are doing might have been simplified by using Summingbird rather than building separate speed and batch layers in Hadoop / Spark.

ddrum001قبل 11 سنة

That's a great point for our next session - Summingbird would be perfect for everyone trying to implement Lambda Architecture without having to produce separate code for streaming and batch.

PedroSenaقبل 11 سنة

Is the code available somewhere ? I'd love to see the one related to fantasy sports

xbetaقبل 11 سنة

Would love to try this! Thanks for sharing !

shaminoقبل 11 سنة

Thanks for sharing! This is awesome!!