How to infer difference of population proportion between two groups when proportion is small? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)Comparing relative frequencies between two groupsTwo Sample Proportion Test - Finite PopulationHow can I test the difference between a population proportion and sample proportion?Comparing proportions between two mega-groupsWhat should the estimated proportion be for the population when the sample proportion is 1?Difference between Fisher exact and Wilson score when calculating proportion CIHow to find Population proportion confidence interval when n*p is less than 5?Two Sample Test for Difference of Proportion, when the probabilities are very close to zeroTest difference of population proportion and weighted sample proportionDifference between groups

3D Masyu - A Die

By what mechanism was the 2017 UK General Election called?

Vertical ranges of Column Plots in 12

Table formatting with tabularx?

Is a copyright notice with a non-existent name be invalid?

Is it OK to use the testing sample to compare algorithms?

The Nth Gryphon Number

As a dual citizen, my US passport will expire one day after traveling to the US. Will this work?

Fit odd number of triplets in a measure?

Marquee sign letters

How to infer difference of population proportion between two groups when proportion is small?

NIntegrate on a solution of a matrix ODE

What is the proper term for etching or digging of wall to hide conduit of cables

How does the body cool itself in a stillsuit?

Found this skink in my tomato plant bucket. Is he trapped? Or could he leave if he wanted?

Did John Wesley plagiarize Matthew Henry...?

Sally's older brother

Is there a spell that can create a permanent fire?

Why did Bronn offer to be Tyrion Lannister's champion in trial by combat?

Was the pager message from Nick Fury to Captain Marvel unnecessary?

Did any compiler fully use 80-bit floating point?

Why complex landing gears are used instead of simple, reliable and light weight muscle wire or shape memory alloys?

Why is there so little support for joining EFTA in the British parliament?

How do Java 8 default methods hеlp with lambdas?



How to infer difference of population proportion between two groups when proportion is small?



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)Comparing relative frequencies between two groupsTwo Sample Proportion Test - Finite PopulationHow can I test the difference between a population proportion and sample proportion?Comparing proportions between two mega-groupsWhat should the estimated proportion be for the population when the sample proportion is 1?Difference between Fisher exact and Wilson score when calculating proportion CIHow to find Population proportion confidence interval when n*p is less than 5?Two Sample Test for Difference of Proportion, when the probabilities are very close to zeroTest difference of population proportion and weighted sample proportionDifference between groups



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








1












$begingroup$


I have a dataset where the issue is of this form.



There are two groups, Group A (N=5000) and Group B (N=1000). Let's say 5 people in Group A develop a certain disease, and only 2 in group B do.



Then the proportion for A is 5/5000 -> 0.001 and for B it is 2/1000 -> 0.002.



How can I test if the proportion between these two groups is statistically significant?



The tests I found online rely on the Central Limit Theorem, such that np>=10 and n(1-p) >= 10, which does not hold for my dataset. Are there any other approaches?










share|cite|improve this question







New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    Use Fisher Exact Test per discussion in Answer.
    $endgroup$
    – BruceET
    41 mins ago

















1












$begingroup$


I have a dataset where the issue is of this form.



There are two groups, Group A (N=5000) and Group B (N=1000). Let's say 5 people in Group A develop a certain disease, and only 2 in group B do.



Then the proportion for A is 5/5000 -> 0.001 and for B it is 2/1000 -> 0.002.



How can I test if the proportion between these two groups is statistically significant?



The tests I found online rely on the Central Limit Theorem, such that np>=10 and n(1-p) >= 10, which does not hold for my dataset. Are there any other approaches?










share|cite|improve this question







New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    Use Fisher Exact Test per discussion in Answer.
    $endgroup$
    – BruceET
    41 mins ago













1












1








1





$begingroup$


I have a dataset where the issue is of this form.



There are two groups, Group A (N=5000) and Group B (N=1000). Let's say 5 people in Group A develop a certain disease, and only 2 in group B do.



Then the proportion for A is 5/5000 -> 0.001 and for B it is 2/1000 -> 0.002.



How can I test if the proportion between these two groups is statistically significant?



The tests I found online rely on the Central Limit Theorem, such that np>=10 and n(1-p) >= 10, which does not hold for my dataset. Are there any other approaches?










share|cite|improve this question







New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$




I have a dataset where the issue is of this form.



There are two groups, Group A (N=5000) and Group B (N=1000). Let's say 5 people in Group A develop a certain disease, and only 2 in group B do.



Then the proportion for A is 5/5000 -> 0.001 and for B it is 2/1000 -> 0.002.



How can I test if the proportion between these two groups is statistically significant?



The tests I found online rely on the Central Limit Theorem, such that np>=10 and n(1-p) >= 10, which does not hold for my dataset. Are there any other approaches?







inference proportion






share|cite|improve this question







New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|cite|improve this question







New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|cite|improve this question




share|cite|improve this question






New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 4 hours ago









maxmax

1083




1083




New contributor




max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






max is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • $begingroup$
    Use Fisher Exact Test per discussion in Answer.
    $endgroup$
    – BruceET
    41 mins ago
















  • $begingroup$
    Use Fisher Exact Test per discussion in Answer.
    $endgroup$
    – BruceET
    41 mins ago















$begingroup$
Use Fisher Exact Test per discussion in Answer.
$endgroup$
– BruceET
41 mins ago




$begingroup$
Use Fisher Exact Test per discussion in Answer.
$endgroup$
– BruceET
41 mins ago










1 Answer
1






active

oldest

votes


















2












$begingroup$

The traditional approach would be to do a 2-sample test for a difference in proportions: In Minitab, results of this test are as shown below. The warning about the first P-value from a normal approximation causes doubt,
roughly for the reasons you mention.



However, the result from Fisher's exact test uses an exact hypergeometric
probability. It also shows no significant difference.



Test and CI for Two Proportions 

Sample X N Sample p
1 5 5000 0.001000
2 2 1000 0.002000

Difference = p (1) - p (2)
Estimate for difference: -0.001
95% upper bound for difference: 0.00143738
Test for difference = 0 (vs < 0):
Z = -0.67 P-Value = 0.250

* NOTE * The normal approximation may be
inaccurate for small samples.

Fisher’s exact test: P-Value = 0.330


A direct hypergeometric computation in R can be argued
as follows. Suppose an urn contains $5000$ tokens marked A and $1000$ marked B. Seven tokens are taken
at random without replacement, corresponding to disease.
What is the probability five or fewer of those are marked A?



The answer is



$$sum_k=0^5frac5000 choose k1000 choose 7-k6000 choose 7 = 0.3302,$$



which agrees with the P-value from Fisher's exact test.



In R, the computation can be done in terms of a hypergeometric CDF:



phyper(5, 5000, 1000, 7)
[1] 0.330204


Here is a plot of this hypergeometric distribution. The P-value is the sum of the heights of the bars to the left of the vertical dotted line.



enter image description here






share|cite|improve this answer









$endgroup$













    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "65"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );






    max is a new contributor. Be nice, and check out our Code of Conduct.









    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f404331%2fhow-to-infer-difference-of-population-proportion-between-two-groups-when-proport%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    2












    $begingroup$

    The traditional approach would be to do a 2-sample test for a difference in proportions: In Minitab, results of this test are as shown below. The warning about the first P-value from a normal approximation causes doubt,
    roughly for the reasons you mention.



    However, the result from Fisher's exact test uses an exact hypergeometric
    probability. It also shows no significant difference.



    Test and CI for Two Proportions 

    Sample X N Sample p
    1 5 5000 0.001000
    2 2 1000 0.002000

    Difference = p (1) - p (2)
    Estimate for difference: -0.001
    95% upper bound for difference: 0.00143738
    Test for difference = 0 (vs < 0):
    Z = -0.67 P-Value = 0.250

    * NOTE * The normal approximation may be
    inaccurate for small samples.

    Fisher’s exact test: P-Value = 0.330


    A direct hypergeometric computation in R can be argued
    as follows. Suppose an urn contains $5000$ tokens marked A and $1000$ marked B. Seven tokens are taken
    at random without replacement, corresponding to disease.
    What is the probability five or fewer of those are marked A?



    The answer is



    $$sum_k=0^5frac5000 choose k1000 choose 7-k6000 choose 7 = 0.3302,$$



    which agrees with the P-value from Fisher's exact test.



    In R, the computation can be done in terms of a hypergeometric CDF:



    phyper(5, 5000, 1000, 7)
    [1] 0.330204


    Here is a plot of this hypergeometric distribution. The P-value is the sum of the heights of the bars to the left of the vertical dotted line.



    enter image description here






    share|cite|improve this answer









    $endgroup$

















      2












      $begingroup$

      The traditional approach would be to do a 2-sample test for a difference in proportions: In Minitab, results of this test are as shown below. The warning about the first P-value from a normal approximation causes doubt,
      roughly for the reasons you mention.



      However, the result from Fisher's exact test uses an exact hypergeometric
      probability. It also shows no significant difference.



      Test and CI for Two Proportions 

      Sample X N Sample p
      1 5 5000 0.001000
      2 2 1000 0.002000

      Difference = p (1) - p (2)
      Estimate for difference: -0.001
      95% upper bound for difference: 0.00143738
      Test for difference = 0 (vs < 0):
      Z = -0.67 P-Value = 0.250

      * NOTE * The normal approximation may be
      inaccurate for small samples.

      Fisher’s exact test: P-Value = 0.330


      A direct hypergeometric computation in R can be argued
      as follows. Suppose an urn contains $5000$ tokens marked A and $1000$ marked B. Seven tokens are taken
      at random without replacement, corresponding to disease.
      What is the probability five or fewer of those are marked A?



      The answer is



      $$sum_k=0^5frac5000 choose k1000 choose 7-k6000 choose 7 = 0.3302,$$



      which agrees with the P-value from Fisher's exact test.



      In R, the computation can be done in terms of a hypergeometric CDF:



      phyper(5, 5000, 1000, 7)
      [1] 0.330204


      Here is a plot of this hypergeometric distribution. The P-value is the sum of the heights of the bars to the left of the vertical dotted line.



      enter image description here






      share|cite|improve this answer









      $endgroup$















        2












        2








        2





        $begingroup$

        The traditional approach would be to do a 2-sample test for a difference in proportions: In Minitab, results of this test are as shown below. The warning about the first P-value from a normal approximation causes doubt,
        roughly for the reasons you mention.



        However, the result from Fisher's exact test uses an exact hypergeometric
        probability. It also shows no significant difference.



        Test and CI for Two Proportions 

        Sample X N Sample p
        1 5 5000 0.001000
        2 2 1000 0.002000

        Difference = p (1) - p (2)
        Estimate for difference: -0.001
        95% upper bound for difference: 0.00143738
        Test for difference = 0 (vs < 0):
        Z = -0.67 P-Value = 0.250

        * NOTE * The normal approximation may be
        inaccurate for small samples.

        Fisher’s exact test: P-Value = 0.330


        A direct hypergeometric computation in R can be argued
        as follows. Suppose an urn contains $5000$ tokens marked A and $1000$ marked B. Seven tokens are taken
        at random without replacement, corresponding to disease.
        What is the probability five or fewer of those are marked A?



        The answer is



        $$sum_k=0^5frac5000 choose k1000 choose 7-k6000 choose 7 = 0.3302,$$



        which agrees with the P-value from Fisher's exact test.



        In R, the computation can be done in terms of a hypergeometric CDF:



        phyper(5, 5000, 1000, 7)
        [1] 0.330204


        Here is a plot of this hypergeometric distribution. The P-value is the sum of the heights of the bars to the left of the vertical dotted line.



        enter image description here






        share|cite|improve this answer









        $endgroup$



        The traditional approach would be to do a 2-sample test for a difference in proportions: In Minitab, results of this test are as shown below. The warning about the first P-value from a normal approximation causes doubt,
        roughly for the reasons you mention.



        However, the result from Fisher's exact test uses an exact hypergeometric
        probability. It also shows no significant difference.



        Test and CI for Two Proportions 

        Sample X N Sample p
        1 5 5000 0.001000
        2 2 1000 0.002000

        Difference = p (1) - p (2)
        Estimate for difference: -0.001
        95% upper bound for difference: 0.00143738
        Test for difference = 0 (vs < 0):
        Z = -0.67 P-Value = 0.250

        * NOTE * The normal approximation may be
        inaccurate for small samples.

        Fisher’s exact test: P-Value = 0.330


        A direct hypergeometric computation in R can be argued
        as follows. Suppose an urn contains $5000$ tokens marked A and $1000$ marked B. Seven tokens are taken
        at random without replacement, corresponding to disease.
        What is the probability five or fewer of those are marked A?



        The answer is



        $$sum_k=0^5frac5000 choose k1000 choose 7-k6000 choose 7 = 0.3302,$$



        which agrees with the P-value from Fisher's exact test.



        In R, the computation can be done in terms of a hypergeometric CDF:



        phyper(5, 5000, 1000, 7)
        [1] 0.330204


        Here is a plot of this hypergeometric distribution. The P-value is the sum of the heights of the bars to the left of the vertical dotted line.



        enter image description here







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered 1 hour ago









        BruceETBruceET

        7,0461721




        7,0461721




















            max is a new contributor. Be nice, and check out our Code of Conduct.









            draft saved

            draft discarded


















            max is a new contributor. Be nice, and check out our Code of Conduct.












            max is a new contributor. Be nice, and check out our Code of Conduct.











            max is a new contributor. Be nice, and check out our Code of Conduct.














            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f404331%2fhow-to-infer-difference-of-population-proportion-between-two-groups-when-proport%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Are there any AGPL-style licences that require source code modifications to be public? Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?Force derivative works to be publicAre there any GPL like licenses for Apple App Store?Do you violate the GPL if you provide source code that cannot be compiled?GPL - is it distribution to use libraries in an appliance loaned to customers?Distributing App for free which uses GPL'ed codeModifications of server software under GPL, with web/CLI interfaceDoes using an AGPLv3-licensed library prevent me from dual-licensing my own source code?Can I publish only select code under GPLv3 from a private project?Is there published precedent regarding the scope of covered work that uses AGPL software?If MIT licensed code links to GPL licensed code what should be the license of the resulting binary program?If I use a public API endpoint that has its source code licensed under AGPL in my app, do I need to disclose my source?

            2013 GY136 Descoberta | Órbita | Referências Menu de navegação«List Of Centaurs and Scattered-Disk Objects»«List of Known Trans-Neptunian Objects»

            Mortes em março de 2019 Referências Menu de navegação«Zhores Alferov, Nobel de Física bielorrusso, morre aos 88 anos - Ciência»«Fallece Rafael Torija, o bispo emérito de Ciudad Real»«Peter Hurford dies at 88»«Keith Flint, vocalista do The Prodigy, morre aos 49 anos»«Luke Perry, ator de 'Barrados no baile' e 'Riverdale', morre aos 52 anos»«Former Rangers and Scotland captain Eric Caldow dies, aged 84»«Morreu, aos 61 anos, a antiga lenda do wrestling King Kong Bundy»«Fallece el actor y director teatral Abraham Stavans»«In Memoriam Guillaume Faye»«Sidney Sheinberg, a Force Behind Universal and Spielberg, Is Dead at 84»«Carmine Persico, Colombo Crime Family Boss, Is Dead at 85»«Dirigent Michael Gielen gestorben»«Ciclista tricampeã mundial e prata na Rio 2016 é encontrada morta em casa aos 23 anos»«Pagan Community Notes: Raven Grimassi dies, Indianapolis pop-up event cancelled, Circle Sanctuary announces new podcast, and more!»«Hal Blaine, Wrecking Crew Drummer, Dies at 90»«Morre Coutinho, que editou dupla lendária com Pelé no Santos»«Cantor Demétrius, ídolo da Jovem Guarda, morre em SP»«Ex-presidente do Vasco, Eurico Miranda morre no Rio de Janeiro»«Bronze no Mundial de basquete de 1971, Laís Elena morre aos 76 anos»«Diretor de Corridas da F1, Charlie Whiting morre aos 66 anos às vésperas do GP da Austrália»«Morreu o cardeal Danneels, da Bélgica»«Morreu o cartoonista Augusto Cid»«Morreu a atriz Maria Isabel de Lizandra, de "Vale Tudo" e novelas da Tupi»«WS Merwin, prize-winning poet of nature, dies at 91»«Atriz Márcia Real morre em São Paulo aos 88 anos»«Mauritanie: décès de l'ancien président Mohamed Mahmoud ould Louly»«Morreu Dick Dale, o rei da surf guitar e de "Pulp Fiction"»«Falleció Víctor Genes»«João Carlos Marinho, autor de 'O Gênio do Crime', morre em SP»«Legendary Horror Director and SFX Artist John Carl Buechler Dies at 66»«Morre em Salvador a religiosa Makota Valdina»«مرگ بازیکن‌ سابق نساجی بر اثر سقوط سنگ در مازندران»«Domingos Oliveira morre no Rio»«Morre Airton Ravagniani, ex-São Paulo, Fla, Vasco, Grêmio e Sport - Notícias»«Morre o escritor Flavio Moreira da Costa»«Larry Cohen, Writer-Director of 'It's Alive' and 'Hell Up in Harlem,' Dies at 77»«Scott Walker, experimental singer-songwriter, dead at 76»«Joseph Pilato, Day of the Dead Star and Horror Favorite, Dies at 70»«Sheffield United set to pay tribute to legendary goalkeeper Ted Burgin who has died at 91»«Morre Rafael Henzel, sobrevivente de acidente aéreo da Chapecoense»«Morre Valery Bykovsky, um dos primeiros cosmonautas da União Soviética»«Agnès Varda, cineasta da Nouvelle Vague, morre aos 90 anos»«Agnès Varda, cineasta francesa, morre aos 90 anos»«Tania Mallet, James Bond Actress and Helen Mirren's Cousin, Dies at 77»e