Differences between Change Capture stage and Difference stage in DataStage












0















I'm trying to implement SCD Type1 loading using Change Capture and Difference stages in DataStage. Both these jobs are working fine without any errors, but i would like to know what was differences between these two stages and which one will deliver a better performance?



I had tried several test cases to find the differences few that i had found were




  • In Change capture stage we need to have both the inputs with same number of columns and same column names with similar datatypes but that was not the case in Difference stage.


Could someone help me to figure out what the actual important analogy between these 2 stages. (Any related web links are welcome)



Thank you.










share|improve this question



























    0















    I'm trying to implement SCD Type1 loading using Change Capture and Difference stages in DataStage. Both these jobs are working fine without any errors, but i would like to know what was differences between these two stages and which one will deliver a better performance?



    I had tried several test cases to find the differences few that i had found were




    • In Change capture stage we need to have both the inputs with same number of columns and same column names with similar datatypes but that was not the case in Difference stage.


    Could someone help me to figure out what the actual important analogy between these 2 stages. (Any related web links are welcome)



    Thank you.










    share|improve this question

























      0












      0








      0








      I'm trying to implement SCD Type1 loading using Change Capture and Difference stages in DataStage. Both these jobs are working fine without any errors, but i would like to know what was differences between these two stages and which one will deliver a better performance?



      I had tried several test cases to find the differences few that i had found were




      • In Change capture stage we need to have both the inputs with same number of columns and same column names with similar datatypes but that was not the case in Difference stage.


      Could someone help me to figure out what the actual important analogy between these 2 stages. (Any related web links are welcome)



      Thank you.










      share|improve this question














      I'm trying to implement SCD Type1 loading using Change Capture and Difference stages in DataStage. Both these jobs are working fine without any errors, but i would like to know what was differences between these two stages and which one will deliver a better performance?



      I had tried several test cases to find the differences few that i had found were




      • In Change capture stage we need to have both the inputs with same number of columns and same column names with similar datatypes but that was not the case in Difference stage.


      Could someone help me to figure out what the actual important analogy between these 2 stages. (Any related web links are welcome)



      Thank you.







      datastage






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 28 '18 at 14:18









      Adithya AlapatiAdithya Alapati

      617




      617
























          1 Answer
          1






          active

          oldest

          votes


















          0














          Performance is not the point - they should be compareable - more important is the functionality point of view.




          • The DIFFERENCE stage returns the "before" columns and after columns only in some situations (if they are not part of the key or value columns and are named differently)


          • The CHANGE CAPTURE stage returns the "after" columns. BEfore columns are only available for Deletes







          share|improve this answer
























          • Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

            – Adithya Alapati
            Nov 29 '18 at 4:33











          • Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

            – MichaelTiefenbacher
            Nov 29 '18 at 6:10











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53521514%2fdifferences-between-change-capture-stage-and-difference-stage-in-datastage%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          0














          Performance is not the point - they should be compareable - more important is the functionality point of view.




          • The DIFFERENCE stage returns the "before" columns and after columns only in some situations (if they are not part of the key or value columns and are named differently)


          • The CHANGE CAPTURE stage returns the "after" columns. BEfore columns are only available for Deletes







          share|improve this answer
























          • Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

            – Adithya Alapati
            Nov 29 '18 at 4:33











          • Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

            – MichaelTiefenbacher
            Nov 29 '18 at 6:10
















          0














          Performance is not the point - they should be compareable - more important is the functionality point of view.




          • The DIFFERENCE stage returns the "before" columns and after columns only in some situations (if they are not part of the key or value columns and are named differently)


          • The CHANGE CAPTURE stage returns the "after" columns. BEfore columns are only available for Deletes







          share|improve this answer
























          • Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

            – Adithya Alapati
            Nov 29 '18 at 4:33











          • Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

            – MichaelTiefenbacher
            Nov 29 '18 at 6:10














          0












          0








          0







          Performance is not the point - they should be compareable - more important is the functionality point of view.




          • The DIFFERENCE stage returns the "before" columns and after columns only in some situations (if they are not part of the key or value columns and are named differently)


          • The CHANGE CAPTURE stage returns the "after" columns. BEfore columns are only available for Deletes







          share|improve this answer













          Performance is not the point - they should be compareable - more important is the functionality point of view.




          • The DIFFERENCE stage returns the "before" columns and after columns only in some situations (if they are not part of the key or value columns and are named differently)


          • The CHANGE CAPTURE stage returns the "after" columns. BEfore columns are only available for Deletes








          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Nov 28 '18 at 19:21









          MichaelTiefenbacherMichaelTiefenbacher

          2,3072715




          2,3072715













          • Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

            – Adithya Alapati
            Nov 29 '18 at 4:33











          • Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

            – MichaelTiefenbacher
            Nov 29 '18 at 6:10



















          • Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

            – Adithya Alapati
            Nov 29 '18 at 4:33











          • Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

            – MichaelTiefenbacher
            Nov 29 '18 at 6:10

















          Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

          – Adithya Alapati
          Nov 29 '18 at 4:33





          Thanks MichaelTiefenbacher for answering, but is it all about what the output columns that we are getting from the stage or any other differences?

          – Adithya Alapati
          Nov 29 '18 at 4:33













          Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

          – MichaelTiefenbacher
          Nov 29 '18 at 6:10





          Well there are more differences - like options to configure the stage or the returned codes are slightly different (per default). With Change Capture you have the "All Keys, Explicit Values" etc. options to configure its behaviour. Personally I user the Change Capture more frequently in scenarions where I need to determine deltas.

          – MichaelTiefenbacher
          Nov 29 '18 at 6:10




















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53521514%2fdifferences-between-change-capture-stage-and-difference-stage-in-datastage%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks

          Calculate evaluation metrics using cross_val_predict sklearn

          Insert data from modal to MySQL (multiple modal on website)