What are the steps to identify connection leak when using DBCP, JDBCTemplate and ScheduledExecutor?

up vote
0
down vote

favorite

We are creating a Spring boot web app.

DB : JDBC Template and DBCP connection pool.

Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();

Time interval: 2 min

The code in runnable hits DB using JDBCTemplate.query().

Issue: The heap usage increases to several GBs in few min.

Any Pointers would be helpful to identify the memory leak.

Note: If we comment the JDBCTemplate.query() , memory usage is constant.

Settings of DBCP:

 <bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">

            <property name="driverClassName" value="oracle.jdbc.OracleDriver" />

            <property name="url" value="${batch.jdbc.url}" />

            <property name="username" value="******" />

            <property name="password" value="******" />

            <property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />

            <property name="minIdle" value="10" />

             <property name="maxIdle" value="12" />

            <property name="maxActive" value="100" />

            <property name="accessToUnderlyingConnectionAllowed" value="true" />

            <property name="initialSize" value="${batch.jdbc.pool.size}"/>



            <property name="validationQuery" value="select 1 from dual" />

            <property name="validationQueryTimeout" value="5" />

            <property name="timeBetweenEvictionRunsMillis" value="120000" />

            <property name="minEvictableIdleTimeMillis" value="60000" />             

            <property name="testOnBorrow" value="true" /> 

        </bean>

Suspect from Eclipse MAT report

One instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8" occupies 1,421,543,264 (94.69%) bytes. The memory is accumulated in one instance of "org.apache.commons.pool.impl.GenericObjectPool" loaded by "org.springframework.boot.loader.LaunchedURLClassLoader @ 0x7fc1d90124c8".

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

1

And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52

1

Also what's your configuration?
– user7294900
Nov 22 at 11:53

Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07

Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18

add a comment |

up vote
0
down vote

favorite

We are creating a Spring boot web app.

DB : JDBC Template and DBCP connection pool.

Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();

Time interval: 2 min

The code in runnable hits DB using JDBCTemplate.query().

Issue: The heap usage increases to several GBs in few min.

Any Pointers would be helpful to identify the memory leak.

Note: If we comment the JDBCTemplate.query() , memory usage is constant.

Settings of DBCP:

 <bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">

            <property name="driverClassName" value="oracle.jdbc.OracleDriver" />

            <property name="url" value="${batch.jdbc.url}" />

            <property name="username" value="******" />

            <property name="password" value="******" />

            <property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />

            <property name="minIdle" value="10" />

             <property name="maxIdle" value="12" />

            <property name="maxActive" value="100" />

            <property name="accessToUnderlyingConnectionAllowed" value="true" />

            <property name="initialSize" value="${batch.jdbc.pool.size}"/>



            <property name="validationQuery" value="select 1 from dual" />

            <property name="validationQueryTimeout" value="5" />

            <property name="timeBetweenEvictionRunsMillis" value="120000" />

            <property name="minEvictableIdleTimeMillis" value="60000" />             

            <property name="testOnBorrow" value="true" /> 

        </bean>

Suspect from Eclipse MAT report

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

1

And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52

1

Also what's your configuration?
– user7294900
Nov 22 at 11:53

Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07

Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18

add a comment |

up vote
0
down vote

favorite

We are creating a Spring boot web app.

DB : JDBC Template and DBCP connection pool.

Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();

Time interval: 2 min

The code in runnable hits DB using JDBCTemplate.query().

Issue: The heap usage increases to several GBs in few min.

Any Pointers would be helpful to identify the memory leak.

Note: If we comment the JDBCTemplate.query() , memory usage is constant.

Settings of DBCP:

 <bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">

            <property name="driverClassName" value="oracle.jdbc.OracleDriver" />

            <property name="url" value="${batch.jdbc.url}" />

            <property name="username" value="******" />

            <property name="password" value="******" />

            <property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />

            <property name="minIdle" value="10" />

             <property name="maxIdle" value="12" />

            <property name="maxActive" value="100" />

            <property name="accessToUnderlyingConnectionAllowed" value="true" />

            <property name="initialSize" value="${batch.jdbc.pool.size}"/>



            <property name="validationQuery" value="select 1 from dual" />

            <property name="validationQueryTimeout" value="5" />

            <property name="timeBetweenEvictionRunsMillis" value="120000" />

            <property name="minEvictableIdleTimeMillis" value="60000" />             

            <property name="testOnBorrow" value="true" /> 

        </bean>

Suspect from Eclipse MAT report

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

We are creating a Spring boot web app.

DB : JDBC Template and DBCP connection pool.

Java code: A runnable is called in Executors.newSingleThreadScheduledExecutor();

Time interval: 2 min

The code in runnable hits DB using JDBCTemplate.query().

Issue: The heap usage increases to several GBs in few min.

Any Pointers would be helpful to identify the memory leak.

Note: If we comment the JDBCTemplate.query() , memory usage is constant.

Settings of DBCP:

 <bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">

            <property name="driverClassName" value="oracle.jdbc.OracleDriver" />

            <property name="url" value="${batch.jdbc.url}" />

            <property name="username" value="******" />

            <property name="password" value="******" />

            <property name="connectionProperties" value="defaultRowPrefetch=10000;defaultBatchValue=200;" />

            <property name="minIdle" value="10" />

             <property name="maxIdle" value="12" />

            <property name="maxActive" value="100" />

            <property name="accessToUnderlyingConnectionAllowed" value="true" />

            <property name="initialSize" value="${batch.jdbc.pool.size}"/>



            <property name="validationQuery" value="select 1 from dual" />

            <property name="validationQueryTimeout" value="5" />

            <property name="timeBetweenEvictionRunsMillis" value="120000" />

            <property name="minEvictableIdleTimeMillis" value="60000" />             

            <property name="testOnBorrow" value="true" /> 

        </bean>

Suspect from Eclipse MAT report

java spring spring-boot apache-commons-dbcp dbcp

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

edited Nov 26 at 6:14

Michael Petch

24.8k55699

edited Nov 26 at 6:14

Michael Petch

24.8k55699

edited Nov 26 at 6:14

Michael Petch

24.8k55699

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

asked Nov 22 at 11:38

Vijay Kumar Chauhan

6218

1

And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52

1

Also what's your configuration?
– user7294900
Nov 22 at 11:53

Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07

Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18

add a comment |

1

And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52

1

Also what's your configuration?
– user7294900
Nov 22 at 11:53

Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07

Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18

And how many data is retrieved from DB? How is that stored in your classes? Without seeing code we cannot help you.
– M. Deinum
Nov 22 at 11:52

Also what's your configuration?
– user7294900
Nov 22 at 11:53

Try taking a heap dump to see what is increasing you heap. Different Ways to Capture Java Heap Dumps
– Gal S
Nov 22 at 14:07

Thanks.Question updated with settings of DBCP and primary suspect of leak report
– Vijay Kumar Chauhan
Nov 26 at 6:18

add a comment |

active

oldest

votes

Your Answer

StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});

}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53430156%2fwhat-are-the-steps-to-identify-connection-leak-when-using-dbcp-jdbctemplate-and%23new-answer', 'question_page');
}
);

Post as a guest

Name

Required, but never shown

active

oldest

votes

draft saved

draft discarded

Thanks for contributing an answer to Stack Overflow!

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

Some of your past answers have not been well-received, and you're in danger of being blocked from answering.

Please pay close attention to the following guidance:

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Name

Required, but never shown

Name

Required, but never shown

This page is only for reference, If you need detailed information, please check here

搜尋此網誌

Btukfyl