Quantcast
Channel: Best practices for changing partition numbers
Browsing all 6 articles
Browse latest View live

Best practices for changing partition numbers

Hello, We have found that, for our application, having a number of total partitions as a multiple of the number of consumer hosts is beneficial. Because of this, whenever we add or remove consumer...

View Article



Best practices for changing partition numbers

If you don't have a lot of topics, one thing you can do is to over-partition a topic. Also, in 0.7, # of partitions grows with brokers. This is going to change in 0.8, in which # of partitions is...

View Article

Best practices for changing partition numbers

Yeah that makes sense, but what if we do need to change the number of partitions? What if we need to reduce it? -- David Ross

View Article

Best practices for changing partition numbers

David Sounds like there is an admin ddl you have to run on your existing topic to change the # after creation. Sent from my iPhone -- Corbin Hoenes

View Article

Best practices for changing partition numbers

I know how to change. I'm wondering what the ramifications are (losing data, etc.). -- David Ross

View Article


Best practices for changing partition numbers

Reducing # partitions is going to be tricky. The data for those dropped partitions will just be lost. Thanks, Jun -- Jun Rao

View Article
Browsing all 6 articles
Browse latest View live




Latest Images