Why no variance term in Bayesian logistic regression?Bayesian logit model - intuitive explanation?Are logistic regression coefficient estimates biased when the predictor has large variance?logistic regression with slackClosed form for the variance of a sum of two estimates in logistic regression?Evaluate posterior predictive distribution in Bayesian linear regressionClassical vs Bayesian logistic regression assumptionsCase Control Sampling in Logistic RegressionFit logistic regression with linear constraints on coefficients in RIs Bayesian Ridge Regression another name of Bayesian Linear Regression?Bayesian Inference for More Than Linear RegressionEconometrics: What are the assumptions of logistic regression for causal inference?
Is there an expression that means doing something right before you will need it rather than doing it in case you might need it?
Is "remove commented out code" correct English?
Assassin's bullet with mercury
Can compressed videos be decoded back to their uncompresed original format?
Unable to supress ligatures in headings which are set in Caps
How badly should I try to prevent a user from XSSing themselves?
Extract rows of a table, that include less than x NULLs
Why didn't Miles's spider sense work before?
Valid term from quadratic sequence?
Plagiarism or not?
Running Low on Limestone
What does the expression "A Mann!" means
How can I deal with my CEO asking me to hire someone with a higher salary than me, a co-founder?
Mathematica command that allows it to read my intentions
What is the idiomatic way to say "clothing fits"?
CAST throwing error when run in stored procedure but not when run as raw query
Is it acceptable for a professor to tell male students to not think that they are smarter than female students?
Calculating entropy change: reversible vs irreversible process
When (not how or why) to calculate Big O of an algorithm
Why didn't Boeing produce its own regional jet?
What type of content (depth/breadth) is expected for a short presentation for Asst Professor interview in the UK?
What exploit Are these user agents trying to use?
Why was the shrinking from 8″ made only to 5.25″ and not smaller (4″ or less)?
Alternative to sending password over mail?
Why no variance term in Bayesian logistic regression?
Bayesian logit model - intuitive explanation?Are logistic regression coefficient estimates biased when the predictor has large variance?logistic regression with slackClosed form for the variance of a sum of two estimates in logistic regression?Evaluate posterior predictive distribution in Bayesian linear regressionClassical vs Bayesian logistic regression assumptionsCase Control Sampling in Logistic RegressionFit logistic regression with linear constraints on coefficients in RIs Bayesian Ridge Regression another name of Bayesian Linear Regression?Bayesian Inference for More Than Linear RegressionEconometrics: What are the assumptions of logistic regression for causal inference?
$begingroup$
I've read here that
... (Bayesian linear regression) is most similar to Bayesian inference
in logistic regression, but in some ways logistic regression is even
simpler, because there is no variance term to estimate, only the
regression parameters.
Why is it the case, why no variance term in Bayesian logistic regression?
logistic bayesian variance
$endgroup$
add a comment |
$begingroup$
I've read here that
... (Bayesian linear regression) is most similar to Bayesian inference
in logistic regression, but in some ways logistic regression is even
simpler, because there is no variance term to estimate, only the
regression parameters.
Why is it the case, why no variance term in Bayesian logistic regression?
logistic bayesian variance
$endgroup$
add a comment |
$begingroup$
I've read here that
... (Bayesian linear regression) is most similar to Bayesian inference
in logistic regression, but in some ways logistic regression is even
simpler, because there is no variance term to estimate, only the
regression parameters.
Why is it the case, why no variance term in Bayesian logistic regression?
logistic bayesian variance
$endgroup$
I've read here that
... (Bayesian linear regression) is most similar to Bayesian inference
in logistic regression, but in some ways logistic regression is even
simpler, because there is no variance term to estimate, only the
regression parameters.
Why is it the case, why no variance term in Bayesian logistic regression?
logistic bayesian variance
logistic bayesian variance
asked 1 hour ago
PatrickPatrick
1396
1396
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Logistic regression, Bayesian or not, is a model defined in terms of Bernoulli distribution. The distribution is parametrized by "probability of success" $p$ with mean $p$ and variance $p(1-p)$, i.e. the variance directly follows from the mean. So there is no "separate" variance term, this is what the quote seems to say.
$endgroup$
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "65"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f401045%2fwhy-no-variance-term-in-bayesian-logistic-regression%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Logistic regression, Bayesian or not, is a model defined in terms of Bernoulli distribution. The distribution is parametrized by "probability of success" $p$ with mean $p$ and variance $p(1-p)$, i.e. the variance directly follows from the mean. So there is no "separate" variance term, this is what the quote seems to say.
$endgroup$
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
add a comment |
$begingroup$
Logistic regression, Bayesian or not, is a model defined in terms of Bernoulli distribution. The distribution is parametrized by "probability of success" $p$ with mean $p$ and variance $p(1-p)$, i.e. the variance directly follows from the mean. So there is no "separate" variance term, this is what the quote seems to say.
$endgroup$
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
add a comment |
$begingroup$
Logistic regression, Bayesian or not, is a model defined in terms of Bernoulli distribution. The distribution is parametrized by "probability of success" $p$ with mean $p$ and variance $p(1-p)$, i.e. the variance directly follows from the mean. So there is no "separate" variance term, this is what the quote seems to say.
$endgroup$
Logistic regression, Bayesian or not, is a model defined in terms of Bernoulli distribution. The distribution is parametrized by "probability of success" $p$ with mean $p$ and variance $p(1-p)$, i.e. the variance directly follows from the mean. So there is no "separate" variance term, this is what the quote seems to say.
answered 1 hour ago
Tim♦Tim
59.6k9131224
59.6k9131224
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
add a comment |
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@patrick for linear regression $y = mx + c + epsilon$, whereas logistic regression p(y=1|x) = logistic(mx +c).
$endgroup$
– seanv507
1 hour ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
$begingroup$
@seanv507 and would it make sense to have $p(y=1|x)=logistic(mx+c+epsilon)$ or not? If not, is it because $p()$ is a probability and already includes some uncertainty?
$endgroup$
– Patrick
28 mins ago
1
1
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
$begingroup$
@Patrick what would this formulation exactly mean? Could you give an example where would you imagine it to be used?
$endgroup$
– Tim♦
26 mins ago
add a comment |
Thanks for contributing an answer to Cross Validated!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f401045%2fwhy-no-variance-term-in-bayesian-logistic-regression%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown