I might be overlooking something obvious but I don't see an address in your profile (and I'd prefer not to guess). You can reach me at gmail (same user).
Gracenote: Emeryville, CA (SF Bay Area) - Full time, No remote - on-site only, relocation possible, no visa sponsorship possible.
Interested in working on crawlers and distributed systems? Interested in functional languages like Clojure and Scala? Gracenote is hiring a senior software engineer.
Gracenote is the top provider of entertainment information, creating industry-leading databases of TV, movie, and music metadata for entertainment guides and applications. Our technology serves billions of requests daily to hundreds of millions of devices around the world.
You’ll be working a set of crawlers responsible for discovering, acquiring and storing data and applications that make use of that data.
If interested email me at this username at gracenote. No 3rd parties, no recruiters please.
Responsibilities: - Write well-designed, well-tested code that performs well
- Design, implement, and own new systems – from design to operations
- Occasional on-call operations / support - Reduce technical debt in existing systems (refactoring, testing…etc)
- Proactively look for ways to make our software more scalable, reliable and fun
- Help change the way we think about solving problems
Requirements: - Strong background in Java, Ruby, Python or another OO language (our current stack)
- Solid understanding of the full web technology stack
- Familiarity with a variety of (relational and non-relational) databases/data stores
- Experience with AWS (or another infrastructure platform)
Pluses: - Experience with web crawling, scraping
- Experience with Clojure, Scala, Hive, or Go
- Experience with functional programming, functional architectures
- Experience with data processing architectures with Kafka, Storm, or Spark.
Gracenote: Emeryville, CA (SF Bay Area) - Full time, No remote, relocation possible, no visa sponsorship possible.
Interested in working on crawlers and distributed systems? Interested in functional languages like Clojure and Scala? Gracenote is hiring a senior software engineer.
Gracenote is the top provider of entertainment information, creating industry-leading databases of TV, movie, and music metadata for entertainment guides and applications. Our technology serves billions of requests daily to hundreds of millions of devices around the world.
You’ll be working a set of crawlers responsible for discovering, acquiring and storing data and applications that make use of that data.
If interested email me at this username at gracenote. No 3rd parties, no recruiters please.
Responsibilities:
- Write well-designed, well-tested code that performs well
- Design, implement, and own new systems – from design to operations
- Occasional on-call operations / support
- Reduce technical debt in existing systems (refactoring, testing…etc)
- Proactively look for ways to make our software more scalable, reliable and fun
- Help change the way we think about solving problems
Requirements:
- Strong background in Java, Ruby, Python or another OO language (our current stack)
- Solid understanding of the full web technology stack
- Familiarity with a variety of (relational and non-relational) databases/data stores
- Experience with AWS (or another infrastructure platform)
Pluses:
- Experience with web crawling, scraping
- Experience with Clojure, Scala, Hive, or Go
- Experience with functional programming, functional architectures
- Experience with data processing architectures with Kafka, Storm, or Spark.
1. Use Godeps to vendor your deps
2. Use Logrus for logging
3. Figure out a deployment script early one. I have a Rake script that uses chef-api to lookup current production nodes, cross compiles locally and scp's the resulting binary out and restarts the process
Gracenote: Emeryville, CA (SF Bay Area) - Full time, No remote, relocation possible, NO visa sponsorship possible.
Gracenote is the top provider of entertainment information, creating industry-leading databases of TV, movie, and music metadata for entertainment guides and applications. Our technology serves billions of requests daily to hundreds of millions of devices around the world.
Interested in working on crawlers and distributed systems? Interested in functional languages like Clojure and Scala? Gracenote is hiring for several positions (junior and senior).
You’ll be working a set of crawlers responsible for discovering, acquiring and storing data and applications that make use of that data.
If interested email me at this username at company. No 3rd parties, no recruiters please.
Responsibilities:
- Write well-designed, well-tested code that performs well
- Design, implement, and own new systems – from design to operations
- Occasional on-call operations / support
- Reduce technical debt in existing systems (refactoring, testing…etc)
- Proactively look for ways to make our software more scalable, reliable and fun
- Help change the way we think about solving problems
Requirements:
- Strong background in Java, Ruby, Python or another OO language
- Solid understanding of the full web technology stack
- Familiarity with a variety of (relational and non-relational) databases/data stores
- Experience with AWS (or another infrastructure platform)
Pluses:
- Experience with web crawling, scraping
- Experience with Clojure, Scala, Hive, or Go
- Experience with functional programming, functional
architectures
- Experience with data processing architectures with Kafka, Storm, or Spark.
Gracenote: Emeryville, CA (SF Bay Area) - Full time, No remote, relocation possible, visa sponsorship possible.
Interested in working on crawlers and distributed systems? Interested in functional languages like Clojure and Scala? Gracenote is hiring for several positions (junior and senior).
Gracenote is the top provider of entertainment information, creating industry-leading databases of TV, movie, and music metadata for entertainment guides and applications. Our technology serves billions of requests daily to hundreds of millions of devices around the world.
You’ll be working a set of crawlers responsible for discovering, acquiring and storing data and applications that make use of that data.
If interested email me at this username at gmail. No 3rd parties, no recruiters please.
Responsibilities:
- Write well-designed, well-tested code that performs well
- Design, implement, and own new systems – from design to operations
- Occasional on-call operations / support
- Reduce technical debt in existing systems (refactoring, testing…etc)
- Proactively look for ways to make our software more scalable, reliable and fun
- Help change the way we think about solving problems
Requirements:
- Strong background in Java, Ruby, Python or another OO language
- Solid understanding of the full web technology stack
- Familiarity with a variety of (relational and non-relational) databases/data stores
- Experience with AWS (or another infrastructure platform)
Pluses:
- Experience with web crawling, scraping
- Experience with Clojure, Scala, Hive, or Go
- Experience with functional programming, functional architectures
- Experience with data processing architectures with Kafka, Storm, or Spark.
Disclosure: I'm the founder of snitch.io - a fully automated ssl monitoring service that launched last month.
This is interesting. I suspect it will appeal to a certain type of person / use-case - similar to LogStash vs Paper trail / Logggly. (I use Paper Trail and love it - check it out.)
However, I'm not really worried about it since many people want automated monitoring, auditing, and alerting that "just works" without having to roll their own client - and then monitor that client.
Doing this at scale is hard. Doing it with frequency/interval guarantees is even harder. I've put considerable effort into a scalable architecture and self-monitoring.
I wish Ivan the best of luck. On a related note if you want to learn about SSL/TLS I highly recommend Ivan's book "Bulletproof SSL and TLS". It is great.
Snitch is already doing a few things SSL Labs isn't doing (supporting custom ports, and IMAPS) and over time the differences in our services will become more and more apparent. I'm very excited about my product roadmap :-)
This is still a pain point for many people and there are many unsolved problems that I'm having a lot of fun working on.
Happy to answer any questions - shoot me an email. This username at currylabs.com
That article cites Adam Langley - a respected engineer at Google who has worked on Chrome and parts of Go. Chrome is wildly lax with certificate revocation. Don't believe me? Browse to https://revoked.grc.com from Chrome. It is true that if someone can MITM they can block CRL/OCSP requests...but browsers (including Chrome) made the choice of 'soft-failing' and thus making it an attack vector. OCSP stapling and the proposed "OCSP Must-Staple" (https://tools.ietf.org/html/draft-hallambaker-muststaple-00) solve this problem. With all due respect to Adam, it seems a little peculiar to say revocation checks don't work when they're broken by design in the browser he worked/works on.
Chrome is the only browser that skips revocation checks for DV certificates but it still does OCSP for EV certs. Chrome has the concept of CRLsets - but these have been shown to only capture a very small portion (<1%) of revoked certificates.
Firefox has the option to hard-fail if the OCSP request isn't verified. This should be the default behavior, but the fear is that too few people understand this and would migrate to another browser if SSL secured sites randomly failed to load sometimes. Note: this is vastly preferable, in my opinion, to loading a site with a certificate of unknown status.
Browsers verify SSL certificates for revocation (OCSP). This is an ongoing service that has a direct impact on latency - so SSL is an ongoing service very much like DNS. However, most people don't realize this.
Also you send in a CSR - certificate signing request - not CRT (which is usually short-hand for certificate).
This is why I built https://snitch.io - security and SSL secured sites in particular are moving targets and not "fire and forget". You really need an external process monitoring and auditing your secured site.
There are some interesting new alternatives such as etcd / serf/consul - but at the time ZooKeeper had the best track record (under Jepsen analysis). Things might have changed since then.