)]}'
{"specs/juno/kafka-publisher.rst":[{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"f9c53eb2f5cb58ae7104f0825a7e49be017a7909","unresolved":false,"context_lines":[{"line_number":19,"context_line":""},{"line_number":20,"context_line":"Ceilometer has to deal with a massive data with a high data rate."},{"line_number":21,"context_line":"Kafka is able to deal with this problem, however Ceilometer"},{"line_number":22,"context_line":"does not have a support for kafka pubslisher. This means that to"},{"line_number":23,"context_line":"use Kafka service with Ceilometer, developers have to implement"},{"line_number":24,"context_line":"a Kafka publisher client by themselves."},{"line_number":25,"context_line":""}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_25e67d44","line":22,"updated":"2014-10-08 19:29:43.000000000","message":"s/pubslisher/publisher/","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"bd2a7397c2b4634d66648ab2f18adb3234e1c4ef","unresolved":false,"context_lines":[{"line_number":19,"context_line":""},{"line_number":20,"context_line":"Ceilometer has to deal with a massive data with a high data rate."},{"line_number":21,"context_line":"Kafka is able to deal with this problem, however Ceilometer"},{"line_number":22,"context_line":"does not have a support for kafka pubslisher. This means that to"},{"line_number":23,"context_line":"use Kafka service with Ceilometer, developers have to implement"},{"line_number":24,"context_line":"a Kafka publisher client by themselves."},{"line_number":25,"context_line":""}],"source_content_type":"text/x-rst","patch_set":2,"id":"9aa7fdbe_6eaaf31a","line":22,"in_reply_to":"baa201ad_25e67d44","updated":"2014-10-20 17:34:36.000000000","message":"Thank you!, and I\u0027m so sorry to reply comment. I did not really know about how to reply comment when I pushed this spec first time (I have to click review button after make these draft comment...)","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"f9c53eb2f5cb58ae7104f0825a7e49be017a7909","unresolved":false,"context_lines":[{"line_number":29,"context_line":"To reduce the cost of implementing Kafka publisher independently,"},{"line_number":30,"context_line":"Ceilometer has to provide the kafka publisher as a plugin."},{"line_number":31,"context_line":"This automates publishing metering data, and developers only have to"},{"line_number":32,"context_line":"configure the kafka publisher plugin in pipeline.yaml file."},{"line_number":33,"context_line":""},{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_051ed90b","line":32,"updated":"2014-10-08 19:29:43.000000000","message":"just wondering how this works... is the idea to add a publisher say: kafka:// and send ceilometer samples to kafka broker? who is the intended consumer after that?","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":8514,"name":"Yathiraj Udupi","email":"yudupi@cisco.com","username":"yudupi"},"change_message_id":"709c333483e0d00235d07f5480739ae692f62c2b","unresolved":false,"context_lines":[{"line_number":29,"context_line":"To reduce the cost of implementing Kafka publisher independently,"},{"line_number":30,"context_line":"Ceilometer has to provide the kafka publisher as a plugin."},{"line_number":31,"context_line":"This automates publishing metering data, and developers only have to"},{"line_number":32,"context_line":"configure the kafka publisher plugin in pipeline.yaml file."},{"line_number":33,"context_line":""},{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_da23c702","line":32,"in_reply_to":"baa201ad_051ed90b","updated":"2014-10-08 23:30:11.000000000","message":"Gordon, \nYes you are right.  That is the idea to include it as a publisher in ceilometer in the pipeline file, and also provide the Kafka broker connection details there in the configuration.   This way any application that is trying to consume streaming ceilometer metrics via Kafka, can directly consume the ceilometer samples.  For example see projects like monasca - https://github.com/stackforge/monasca-thresh can consume the ceilomter metrics that are publised by the Ceilomter Kafka publisher. \n\nKomei, \nCan you please include an example here in the spec of how one can configure and use the proposed Kafka publisher.","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"bd2a7397c2b4634d66648ab2f18adb3234e1c4ef","unresolved":false,"context_lines":[{"line_number":29,"context_line":"To reduce the cost of implementing Kafka publisher independently,"},{"line_number":30,"context_line":"Ceilometer has to provide the kafka publisher as a plugin."},{"line_number":31,"context_line":"This automates publishing metering data, and developers only have to"},{"line_number":32,"context_line":"configure the kafka publisher plugin in pipeline.yaml file."},{"line_number":33,"context_line":""},{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_a600b466","line":32,"in_reply_to":"baa201ad_051ed90b","updated":"2014-10-20 17:34:36.000000000","message":"yes, your saying is right.\n\nTo specify Kafka broker using following schema for example:\npublisher:\n kafka://\u003cbroker_ip\u003e?topic\u003d\u003ctopic_name\u003e\n\nand send Ceilometer samples to a kafka broker. \nIntended consumer is a lot of OSS projects for analysis, for example,  mahout, jubatus, elastic search, storm, ..etc.\n\nKafka is good at handling a huge size and multi-source real-time data, whose features allow to gather more than one ceilometer\u0027s publishing data to a one consumer with real-time (This is one example to usage..)","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"f9c53eb2f5cb58ae7104f0825a7e49be017a7909","unresolved":false,"context_lines":[{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"},{"line_number":36,"context_line":""},{"line_number":37,"context_line":"None"},{"line_number":38,"context_line":""},{"line_number":39,"context_line":"Data model impact"},{"line_number":40,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_85ef291d","line":37,"updated":"2014-10-08 19:29:43.000000000","message":"i\u0027m just going to ask... why can\u0027t this be done in oslo.messaging?","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":8514,"name":"Yathiraj Udupi","email":"yudupi@cisco.com","username":"yudupi"},"change_message_id":"709c333483e0d00235d07f5480739ae692f62c2b","unresolved":false,"context_lines":[{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"},{"line_number":36,"context_line":""},{"line_number":37,"context_line":"None"},{"line_number":38,"context_line":""},{"line_number":39,"context_line":"Data model impact"},{"line_number":40,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_9a85bfd0","line":37,"in_reply_to":"baa201ad_85ef291d","updated":"2014-10-08 23:30:11.000000000","message":"Again, this will simplify all kafka consumers and applications directly consume Ceilometer data, hence proposing as a Ceilometer publisher.","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"bd2a7397c2b4634d66648ab2f18adb3234e1c4ef","unresolved":false,"context_lines":[{"line_number":34,"context_line":"Alternatives"},{"line_number":35,"context_line":"------------"},{"line_number":36,"context_line":""},{"line_number":37,"context_line":"None"},{"line_number":38,"context_line":""},{"line_number":39,"context_line":"Data model impact"},{"line_number":40,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"9aa7fdbe_d1c1c0e5","line":37,"in_reply_to":"baa201ad_85ef291d","updated":"2014-10-20 17:34:36.000000000","message":"Sorry for not explaining enough. I have to modify these explanations and push the changes. Kafka deals with every messaging data identified by \u0027topic\u0027, but this is not related to oslo\u0027s topic. And a lot of OSS external to OpenStack project dose not support for oslo.messaging, so oslo,messaging is not enough to cooperate with these OSS.","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"f9c53eb2f5cb58ae7104f0825a7e49be017a7909","unresolved":false,"context_lines":[{"line_number":64,"context_line":"Performance/Scalability Impacts"},{"line_number":65,"context_line":"-------------------------------"},{"line_number":66,"context_line":""},{"line_number":67,"context_line":"None"},{"line_number":68,"context_line":""},{"line_number":69,"context_line":"Other deployer impact"},{"line_number":70,"context_line":"---------------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_a5b34d08","line":67,"updated":"2014-10-08 19:29:43.000000000","message":"i assume kafka has an intended load use case? ie. only meant for \u003e100,000 message/s systems?","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"bd2a7397c2b4634d66648ab2f18adb3234e1c4ef","unresolved":false,"context_lines":[{"line_number":64,"context_line":"Performance/Scalability Impacts"},{"line_number":65,"context_line":"-------------------------------"},{"line_number":66,"context_line":""},{"line_number":67,"context_line":"None"},{"line_number":68,"context_line":""},{"line_number":69,"context_line":"Other deployer impact"},{"line_number":70,"context_line":"---------------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"9aa7fdbe_df30e758","line":67,"in_reply_to":"baa201ad_a5b34d08","updated":"2014-10-20 17:34:36.000000000","message":"Thank you for suggestions! The message/s is effected by message size and batch size (Kafka producer can send multiple messages together). Frankly speaking, when message is send one by one, and one message size is 200 byte,  producer can publish 50,000 messages/s according to http://research.microsoft.com/en-us/um/people/srikanth/netdb11/netdb11papers/netdb11-final12.pdf\n\nI\u0027ll mention about these results and write next patch of this blueprints.\n\nThank you comments!","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":8514,"name":"Yathiraj Udupi","email":"yudupi@cisco.com","username":"yudupi"},"change_message_id":"709c333483e0d00235d07f5480739ae692f62c2b","unresolved":false,"context_lines":[{"line_number":64,"context_line":"Performance/Scalability Impacts"},{"line_number":65,"context_line":"-------------------------------"},{"line_number":66,"context_line":""},{"line_number":67,"context_line":"None"},{"line_number":68,"context_line":""},{"line_number":69,"context_line":"Other deployer impact"},{"line_number":70,"context_line":"---------------------"}],"source_content_type":"text/x-rst","patch_set":2,"id":"baa201ad_fa75ebf9","line":67,"in_reply_to":"baa201ad_a5b34d08","updated":"2014-10-08 23:30:11.000000000","message":"Yes, Good to add that - Kafka publishers are suitable for high load scenarios.","commit_id":"ce00079c558334f8106cabb6005c67033a44c7e3"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"d98766f4fab69b0dd1d7336a8cc896de7024c706","unresolved":false,"context_lines":[{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."},{"line_number":55,"context_line":""},{"line_number":56,"context_line":"Data model impact"},{"line_number":57,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5a890539_4826becf","line":54,"updated":"2014-11-13 09:30:49.000000000","message":"can we add details regarding discussion at summit. specificially sileht (oslo.messaging owner agreeing it should be in messaging and we can raise notimplemented on rpc parts of oslo.messaging)","commit_id":"91ec48725fa48ca1fd6b903ea7643598a61c95c9"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"1bb5d45c13d5852b5ec07483f34cb68913d5fdb7","unresolved":false,"context_lines":[{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."},{"line_number":55,"context_line":""},{"line_number":56,"context_line":"Data model impact"},{"line_number":57,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5a890539_c9be1465","line":54,"in_reply_to":"5a890539_4826becf","updated":"2014-11-13 22:38:35.000000000","message":"Sorry, I did not attend summit, so I can\u0027t add the details about. I\u0027m mentioning about oslo.messaging in this chapter, so would you let me know  if I need more extra description. \nThanks!","commit_id":"91ec48725fa48ca1fd6b903ea7643598a61c95c9"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"1fd8b678b33ff1bd06df4ce6707e59af9021d314","unresolved":false,"context_lines":[{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."},{"line_number":55,"context_line":""},{"line_number":56,"context_line":"Data model impact"},{"line_number":57,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5a890539_a37633d5","line":54,"in_reply_to":"5a890539_c9be1465","updated":"2014-11-14 13:06:46.000000000","message":"basically, i think the conclusion from summit was sileht (oslo.messaging owner) is ok with adding kafka to the lib... we can just skip the parts (see rpc) that don\u0027t relate to kafka.... kafka is still a broker based mq so i think there\u0027s quite a bit of overlap.\n\nthat said. not to name names, but there is one person who is against adding kafka :)","commit_id":"91ec48725fa48ca1fd6b903ea7643598a61c95c9"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"d98766f4fab69b0dd1d7336a8cc896de7024c706","unresolved":false,"context_lines":[{"line_number":99,"context_line":""},{"line_number":100,"context_line":"KAFKA 0.8 PRODUCER PERFORMANCE"},{"line_number":101,"context_line":""},{"line_number":102,"context_line":"* http://blog.liveramp.com/2013/04/08/kafka-0-8-producer-performance-2/"},{"line_number":103,"context_line":""},{"line_number":104,"context_line":""},{"line_number":105,"context_line":"Other deployer impact"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5a890539_4b3b18d1","line":102,"updated":"2014-11-13 09:30:49.000000000","message":"i\u0027m all for using kafka... my problem is that the rest of openstack is constrained to rabbit/qpid. so regardless if ceilometer/kafka can push out at 50k to 100k messages per second, it will never reach potential as it\u0027s bottlenecked by rabbit/qpid and will only ever get 10k message/s.","commit_id":"91ec48725fa48ca1fd6b903ea7643598a61c95c9"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"e4938408bed8a7ebbe886e5ab1368a08c9b70b64","unresolved":false,"context_lines":[{"line_number":99,"context_line":""},{"line_number":100,"context_line":"KAFKA 0.8 PRODUCER PERFORMANCE"},{"line_number":101,"context_line":""},{"line_number":102,"context_line":"* http://blog.liveramp.com/2013/04/08/kafka-0-8-producer-performance-2/"},{"line_number":103,"context_line":""},{"line_number":104,"context_line":""},{"line_number":105,"context_line":"Other deployer impact"}],"source_content_type":"text/x-rst","patch_set":5,"id":"5a890539_31faa875","line":102,"in_reply_to":"5a890539_4b3b18d1","updated":"2014-11-13 20:08:05.000000000","message":"Thank you for comment.\nLike you said, the number of messages Kafka publishes per seccond can be more than RabbitMQ. It means the bottleneck of throughput dose not come from this publisher. I\u0027ll mention about that on tihs chapter. Thank you again!","commit_id":"91ec48725fa48ca1fd6b903ea7643598a61c95c9"}],"specs/kilo/kafka-publisher.rst":[{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":10,"context_line":""},{"line_number":11,"context_line":"https://blueprints.launchpad.net/ceilometer/+spec/kafka-publisher"},{"line_number":12,"context_line":""},{"line_number":13,"context_line":"Apache kafka is messaging broker which enables to publish real-time metering"},{"line_number":14,"context_line":"data to applications outside of OpenStack Projects with low-latency and"},{"line_number":15,"context_line":"high-throughput."},{"line_number":16,"context_line":""}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_633e42dc","line":13,"updated":"2014-12-01 20:39:13.000000000","message":"s/enables to publish/enables the ability to publish/","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":31,"context_line":"Proposed change"},{"line_number":32,"context_line":"\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d\u003d"},{"line_number":33,"context_line":""},{"line_number":34,"context_line":"To reduce the cost of implementing Kafka publisher independently,"},{"line_number":35,"context_line":"Ceilometer has to provide the kafka publisher as a publisher plugin."},{"line_number":36,"context_line":"This automates publishing metering data, and developers only have to"},{"line_number":37,"context_line":"configure the kafka publisher plugin in pipeline.yaml file like::"}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_830b2e2a","line":34,"updated":"2014-12-01 20:39:13.000000000","message":"s/implementing kafka/implementing a Kafka/","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":42,"context_line":"This way any application that is trying to consume streaming ceilometer"},{"line_number":43,"context_line":"metrics via Kafka, can directly consume the ceilometer samples. For example"},{"line_number":44,"context_line":"projects like monasca - https://github.com/stackforge/monasca-thresh can consume"},{"line_number":45,"context_line":"the ceilomter metrics that are publised by the Ceilomter Kafka publisher."},{"line_number":46,"context_line":""},{"line_number":47,"context_line":"Alternatives"},{"line_number":48,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_c357f624","line":45,"updated":"2014-12-01 20:39:13.000000000","message":"s/ceilomter/ceilometer/ \n\ns/publised/pusblished/\n\ns/Ceilomter/Ceilometer/","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":48,"context_line":"------------"},{"line_number":49,"context_line":""},{"line_number":50,"context_line":"Inside of the Openstack, to communicate with each modules is achieved by"},{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_5e0cbd3b","line":51,"updated":"2014-12-01 20:39:13.000000000","message":"\"is specific to Openstack communication\" - i\u0027m not sure that\u0027s completely accurate","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"091ea56ebbfaf433982225c8809ce1dcc80fd176","unresolved":false,"context_lines":[{"line_number":48,"context_line":"------------"},{"line_number":49,"context_line":""},{"line_number":50,"context_line":"Inside of the Openstack, to communicate with each modules is achieved by"},{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."}],"source_content_type":"text/x-rst","patch_set":6,"id":"3a961159_d51c6e6d","line":51,"in_reply_to":"5a890539_5e0cbd3b","updated":"2014-12-07 02:04:35.000000000","message":"thank you for suggestion. I think oslo libraries are basically for OpenStack projects. Of course they have a potential to deal with more widely problems.","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":51,"context_line":"oslo.messaging, however oslo.messaging is specific to Openstack communication"},{"line_number":52,"context_line":"and Kafka is supporting for more general usages. Also, today there are no"},{"line_number":53,"context_line":"implementation to support for exact Kafka publishing, this blueprint proposal"},{"line_number":54,"context_line":"can achieve to enable to reduce developer\u0027s wasting time."},{"line_number":55,"context_line":""},{"line_number":56,"context_line":"Data model impact"},{"line_number":57,"context_line":"-----------------"}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_9e3465e0","line":54,"updated":"2014-12-01 20:39:13.000000000","message":"\"Also, today there are no implementation to support for exact Kafka publishing, this blueprint proposal can achieve to enable to reduce developer\u0027s wasting time\"\n\nremove this","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":66,"context_line":"Security impact"},{"line_number":67,"context_line":"---------------"},{"line_number":68,"context_line":""},{"line_number":69,"context_line":"None"},{"line_number":70,"context_line":""},{"line_number":71,"context_line":"Pipeline impact"},{"line_number":72,"context_line":"---------------"}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_fe4c8978","line":69,"updated":"2014-12-01 20:39:13.000000000","message":"there\u0027s no security in kafka?","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"091ea56ebbfaf433982225c8809ce1dcc80fd176","unresolved":false,"context_lines":[{"line_number":66,"context_line":"Security impact"},{"line_number":67,"context_line":"---------------"},{"line_number":68,"context_line":""},{"line_number":69,"context_line":"None"},{"line_number":70,"context_line":""},{"line_number":71,"context_line":"Pipeline impact"},{"line_number":72,"context_line":"---------------"}],"source_content_type":"text/x-rst","patch_set":6,"id":"3a961159_15827652","line":69,"in_reply_to":"5a890539_fe4c8978","updated":"2014-12-07 02:04:35.000000000","message":"current status of kafka security (ex, authentication, secure path) is under the implementing. kafka community says they plan to implement. I think making publisher client of kafka dose not impact inside ceilometer security, current codes, and other implemantation of ceilometer.","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"baa99a3baece7fe24727190685b48601b549e4e9","unresolved":false,"context_lines":[{"line_number":105,"context_line":""},{"line_number":106,"context_line":"RabbitMQ Performance Benchmarks"},{"line_number":107,"context_line":""},{"line_number":108,"context_line":"* http://blogs.vmware.com/vfabric/2013/04/how-fast-is-a-rabbit-basic-rabbitmq-performance-benchmarks.html"},{"line_number":109,"context_line":""},{"line_number":110,"context_line":"Other deployer impact"},{"line_number":111,"context_line":"---------------------"}],"source_content_type":"text/x-rst","patch_set":6,"id":"5a890539_5ea83ddb","line":108,"updated":"2014-12-01 20:39:13.000000000","message":"remove these links since they\u0027re in reference section","commit_id":"ea13159e2e802df6b294ec89793dcc5a7c6e8877"},{"author":{"_account_id":6537,"name":"gordon chung","email":"gord@live.ca","username":"chungg"},"change_message_id":"31418ac1741fe87f87c78a07505b7a02ff88a67b","unresolved":false,"context_lines":[{"line_number":42,"context_line":"This way any application that is trying to consume streaming ceilometer"},{"line_number":43,"context_line":"metrics via Kafka, can directly consume the ceilometer samples. For example"},{"line_number":44,"context_line":"projects like monasca - https://github.com/stackforge/monasca-thresh can consume"},{"line_number":45,"context_line":"the ceilometer metrics that are published by the Ceilometer Kafka publisher."},{"line_number":46,"context_line":""},{"line_number":47,"context_line":"Alternatives"},{"line_number":48,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":7,"id":"3a961159_472c4d4b","line":45,"updated":"2014-12-08 00:06:53.000000000","message":"how is the payload going to be serialised? using msgpacks?","commit_id":"b387f26ba1336c3c4089daf35b300d7724be40bf"},{"author":{"_account_id":12850,"name":"Komei Shimamura","email":"komei.t.f@gmail.com","username":"kshimamu"},"change_message_id":"2577cdb801e973c30bf278548fcbb616d480dd61","unresolved":false,"context_lines":[{"line_number":42,"context_line":"This way any application that is trying to consume streaming ceilometer"},{"line_number":43,"context_line":"metrics via Kafka, can directly consume the ceilometer samples. For example"},{"line_number":44,"context_line":"projects like monasca - https://github.com/stackforge/monasca-thresh can consume"},{"line_number":45,"context_line":"the ceilometer metrics that are published by the Ceilometer Kafka publisher."},{"line_number":46,"context_line":""},{"line_number":47,"context_line":"Alternatives"},{"line_number":48,"context_line":"------------"}],"source_content_type":"text/x-rst","patch_set":7,"id":"3a961159_bd1fc008","line":45,"in_reply_to":"3a961159_472c4d4b","updated":"2014-12-08 03:09:07.000000000","message":"For now our publisher dose not plan to support for serialization. Send messages as string or json to kafk broker, and then consumer can subscribe these data. But during implementation, it is possible to serialize( I mean under the consideration.) Thank you for suggestion and introducing nice library:)","commit_id":"b387f26ba1336c3c4089daf35b300d7724be40bf"},{"author":{"_account_id":7052,"name":"Fabio Giannetti","email":"fgiannet@cisco.com","username":"fabgia"},"change_message_id":"e095bb422006ec6d09ff7afc3e3dd511c5d53dfd","unresolved":false,"context_lines":[{"line_number":86,"context_line":"size, the number of replication, batch size (kafka can send multiple messages"},{"line_number":87,"context_line":"together), and environments. Roughly, RabbitMQ can publish about 10,000"},{"line_number":88,"context_line":"messages/sec, it means this kafka publihser might not be the bottleneck of"},{"line_number":89,"context_line":"performance."},{"line_number":90,"context_line":""},{"line_number":91,"context_line":"Other deployer impact"},{"line_number":92,"context_line":"---------------------"}],"source_content_type":"text/x-rst","patch_set":7,"id":"3a961159_53795a2e","line":89,"updated":"2014-12-08 16:16:25.000000000","message":"You also want to mention that Kafka is truly HA whereas Rabbit is not.","commit_id":"b387f26ba1336c3c4089daf35b300d7724be40bf"}]}