what is the difference between log.cleaner.delete.retention.ms and log.retention.ms in Kafka











up vote
0
down vote

favorite












In the document



log.cleaner.delete.retention.ms: How long are delete records retained?

log.retention.ms: The number of milliseconds to keep a log file before deleting it


I cannot tell the difference between them.










share|improve this question









New contributor




xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
























    up vote
    0
    down vote

    favorite












    In the document



    log.cleaner.delete.retention.ms: How long are delete records retained?

    log.retention.ms: The number of milliseconds to keep a log file before deleting it


    I cannot tell the difference between them.










    share|improve this question









    New contributor




    xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.






















      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      In the document



      log.cleaner.delete.retention.ms: How long are delete records retained?

      log.retention.ms: The number of milliseconds to keep a log file before deleting it


      I cannot tell the difference between them.










      share|improve this question









      New contributor




      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      In the document



      log.cleaner.delete.retention.ms: How long are delete records retained?

      log.retention.ms: The number of milliseconds to keep a log file before deleting it


      I cannot tell the difference between them.







      apache-kafka






      share|improve this question









      New contributor




      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question









      New contributor




      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question








      edited Nov 21 at 12:37









      Nishu Tayal

      11.1k73381




      11.1k73381






      New contributor




      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked Nov 21 at 12:23









      xdk

      32




      32




      New contributor




      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      xdk is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.
























          1 Answer
          1






          active

          oldest

          votes

















          up vote
          0
          down vote



          accepted










          log.cleaner.delete.retention.ms appplies to the topics with cleanup policy "compact". It is the amount of time to retain delete tombstone markers for log compacted topics.

          A message will a key and null payload is called Tombstone message. Those messages are removed during log compaction.



          log.retention.ms applies to the topics with cleanup policy "delete". It controls the time to keep the log file before deleting it.



          You can find more details here : http://kafka.apache.org/documentation/#configuration






          share|improve this answer





















            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });






            xdk is a new contributor. Be nice, and check out our Code of Conduct.










             

            draft saved


            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53411956%2fwhat-is-the-difference-between-log-cleaner-delete-retention-ms-and-log-retention%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes








            up vote
            0
            down vote



            accepted










            log.cleaner.delete.retention.ms appplies to the topics with cleanup policy "compact". It is the amount of time to retain delete tombstone markers for log compacted topics.

            A message will a key and null payload is called Tombstone message. Those messages are removed during log compaction.



            log.retention.ms applies to the topics with cleanup policy "delete". It controls the time to keep the log file before deleting it.



            You can find more details here : http://kafka.apache.org/documentation/#configuration






            share|improve this answer

























              up vote
              0
              down vote



              accepted










              log.cleaner.delete.retention.ms appplies to the topics with cleanup policy "compact". It is the amount of time to retain delete tombstone markers for log compacted topics.

              A message will a key and null payload is called Tombstone message. Those messages are removed during log compaction.



              log.retention.ms applies to the topics with cleanup policy "delete". It controls the time to keep the log file before deleting it.



              You can find more details here : http://kafka.apache.org/documentation/#configuration






              share|improve this answer























                up vote
                0
                down vote



                accepted







                up vote
                0
                down vote



                accepted






                log.cleaner.delete.retention.ms appplies to the topics with cleanup policy "compact". It is the amount of time to retain delete tombstone markers for log compacted topics.

                A message will a key and null payload is called Tombstone message. Those messages are removed during log compaction.



                log.retention.ms applies to the topics with cleanup policy "delete". It controls the time to keep the log file before deleting it.



                You can find more details here : http://kafka.apache.org/documentation/#configuration






                share|improve this answer












                log.cleaner.delete.retention.ms appplies to the topics with cleanup policy "compact". It is the amount of time to retain delete tombstone markers for log compacted topics.

                A message will a key and null payload is called Tombstone message. Those messages are removed during log compaction.



                log.retention.ms applies to the topics with cleanup policy "delete". It controls the time to keep the log file before deleting it.



                You can find more details here : http://kafka.apache.org/documentation/#configuration







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 21 at 12:53









                Nishu Tayal

                11.1k73381




                11.1k73381






















                    xdk is a new contributor. Be nice, and check out our Code of Conduct.










                     

                    draft saved


                    draft discarded


















                    xdk is a new contributor. Be nice, and check out our Code of Conduct.













                    xdk is a new contributor. Be nice, and check out our Code of Conduct.












                    xdk is a new contributor. Be nice, and check out our Code of Conduct.















                     


                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53411956%2fwhat-is-the-difference-between-log-cleaner-delete-retention-ms-and-log-retention%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Contact image not getting when fetch all contact list from iPhone by CNContact

                    count number of partitions of a set with n elements into k subsets

                    A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks