New charm: apache-flume-twitter
Bug #1478772 reported by
Kevin W Monroe
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Juju Charms Collection |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
This charm provides a Flume agent designed to process tweets from the Twitter Streaming API and send them to the apache-flume-hdfs agent for storage in the shared filesystem (HDFS) of a connected Hadoop cluster. This leverages the TwitterSource jar packaged with Flume.
Big Data charmers need to review the current state of this charm and verify its readiness for the charm store.
Charm store link: https:/
Related branches
Changed in charms: | |
assignee: | nobody → Juju Big Data Development (bigdata-dev) |
Changed in charms: | |
status: | New → Fix Released |
To post a comment you must log in.
Twitter link in README should point to https:/ /apps.twitter. com/ because it was not clear how to get from https:/ /dev.twitter. com/user/ login to there to create the tokens.
Twitter source generates Avro events, which are then wrapped in another layer of Avro when being sent to HDFS. Ideally, we could find a way to send them directly w/o re-wrapping them.