A/B testing for microservices architecture and complex business processes











up vote
0
down vote

favorite












I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:




  • Cloud – Azure, AKS

  • Microservices - Java 9 + Spring Boot 2.0 + Docker

  • Frontend – React

  • Marketing – Hotjar, Google Analytics


I can share some ideas and wishes from our customer side architects:




  • They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process

  • There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users


I also would like you to know that:




  • All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)

  • Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)


After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:




  • Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi

  • Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f

  • Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/

  • Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty


If you have any experience of using A and B testing for described cases, I will appreciate your help.










share|improve this question


















  • 1




    Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
    – xmojmr
    2 days ago






  • 1




    @xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
    – gnat
    2 days ago















up vote
0
down vote

favorite












I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:




  • Cloud – Azure, AKS

  • Microservices - Java 9 + Spring Boot 2.0 + Docker

  • Frontend – React

  • Marketing – Hotjar, Google Analytics


I can share some ideas and wishes from our customer side architects:




  • They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process

  • There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users


I also would like you to know that:




  • All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)

  • Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)


After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:




  • Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi

  • Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f

  • Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/

  • Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty


If you have any experience of using A and B testing for described cases, I will appreciate your help.










share|improve this question


















  • 1




    Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
    – xmojmr
    2 days ago






  • 1




    @xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
    – gnat
    2 days ago













up vote
0
down vote

favorite









up vote
0
down vote

favorite











I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:




  • Cloud – Azure, AKS

  • Microservices - Java 9 + Spring Boot 2.0 + Docker

  • Frontend – React

  • Marketing – Hotjar, Google Analytics


I can share some ideas and wishes from our customer side architects:




  • They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process

  • There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users


I also would like you to know that:




  • All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)

  • Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)


After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:




  • Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi

  • Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f

  • Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/

  • Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty


If you have any experience of using A and B testing for described cases, I will appreciate your help.










share|improve this question













I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:




  • Cloud – Azure, AKS

  • Microservices - Java 9 + Spring Boot 2.0 + Docker

  • Frontend – React

  • Marketing – Hotjar, Google Analytics


I can share some ideas and wishes from our customer side architects:




  • They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process

  • There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users


I also would like you to know that:




  • All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)

  • Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)


After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:




  • Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi

  • Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f

  • Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/

  • Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty


If you have any experience of using A and B testing for described cases, I will appreciate your help.







azure architecture microservices bpmn ab-testing






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked 2 days ago









Anuar Nurmakanov

578




578








  • 1




    Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
    – xmojmr
    2 days ago






  • 1




    @xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
    – gnat
    2 days ago














  • 1




    Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
    – xmojmr
    2 days ago






  • 1




    @xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
    – gnat
    2 days ago








1




1




Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
2 days ago




Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
2 days ago




1




1




@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
2 days ago




@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
2 days ago

















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














 

draft saved


draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409872%2fa-b-testing-for-microservices-architecture-and-complex-business-processes%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown






























active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes
















 

draft saved


draft discarded



















































 


draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409872%2fa-b-testing-for-microservices-architecture-and-complex-business-processes%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

A CLEAN and SIMPLE way to add appendices to Table of Contents and bookmarks

Calculate evaluation metrics using cross_val_predict sklearn

Insert data from modal to MySQL (multiple modal on website)