Introducing Hoya – HBase on YARN by Steve Loughran, Devaraj Das & Eric Baldeschwieler.
From the post:
In the last few weeks, we have been getting together a prototype, Hoya, running HBase On YARN. This is driven by a few top level use cases that we have been trying to address. Some of them are:
- Be able to create on-demand HBase clusters easily -by and or in apps
- With different versions of HBase potentially (for testing etc.)
- Be able to configure different Hbase instances differently
- For example, different configs for read/write workload instances
- Better isolation
- Run arbitrary co-processors in user’s private cluster
- User will own the data that the hbase daemons create
- MR jobs should find it simple to create (transient) HBase clusters
- For Map-side joins where table data is all in HBase, for example
- Elasticity of clusters for analytic / batch workload processing
- Stop / Suspend / Resume clusters as needed
- Expand / shrink clusters as needed
- Be able to utilize cluster resources better
- Run MR jobs while maintaining HBase’s low latency SLAs
If you are interested in getting in on the ground floor on a promising project, here’s your chance!
True, it is a HBase cluster management project but cluster management abounds in as many subjects as any other IT management area.
Not to mention that few of us ever do just “one job,” at most places. Having multiple skills makes you more marketable.