I'm curious to know how Pinterest or Instagram decide about what goes inside each shard? Do they shard by user ids or something else? Secondly, would like to know if a shard gets more data than other shard, how do they load balance?
Easiest way for me to learn Elasticsearch was through queries generated by Kibana [1] and playing with them inside Sense [2]. Kibana relies on Facets, version elasticsearch 1.0 introduces Aggregations, I would suggest using aggregations for your projects.
Is it possible to extract repeating patterns? example would be extracting repo name, number of stars, language and project description from GitHub Archive daily digests.
Sorry for the fb link, could not find it in YouTube