본문 바로가기

오픈소스/mongodb

Mongo-Hadoop Integration

http://www.slideshare.net/mixmax99/mongodb-hadoop-integration

http://www.slideshare.net/mongodb/hadoop-webinar

https://github.com/mongodb/mongo-hadoop/wiki/Configuration-Reference


Mongo hadoop input format

mongo.job.input.format=com.mongodb.hadoop.MongoInputFormat mongo.input.uri=mongodb://my-db:27017/enron.messages Read from MongoDB Read from BSON mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat mapred.input.dir=file:///tmp/messages.bson hdfs:///tmp/messages.bson s3:///tmp/messages.bson 


Mongo hadoop output format

mongo.job.output.format=com.mongodb.hadoop.MongoOutputFormat mongo.output.uri=mongodb://my-db:27017/enron.results_out Write output to MongoDB Write output to BSON mongo.job.output.format=com.mongodb.hadoop.BSONFileOutputFormat mapred.output.dir=file:///tmp/results.bson hdfs:///tmp/results.bson s3:///tmp/results.bson