<?xml version="1.0" encoding="utf-8"?><!DOCTYPE article  PUBLIC '-//OASIS//DTD DocBook XML V4.4//EN'  'http://www.docbook.org/xml/4.4/docbookx.dtd'><article><articleinfo><title>FAQ/equival</title><revhistory><revision><revnumber>37</revnumber><date>2014-11-18 09:24:18</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>36</revnumber><date>2014-11-18 09:23:38</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>35</revnumber><date>2014-09-25 11:58:56</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>34</revnumber><date>2014-09-25 11:58:26</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>33</revnumber><date>2014-07-28 13:03:25</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>32</revnumber><date>2014-07-28 12:37:54</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>31</revnumber><date>2014-07-28 11:24:27</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>30</revnumber><date>2014-07-28 11:21:01</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>29</revnumber><date>2014-07-28 11:20:35</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>28</revnumber><date>2014-07-22 09:14:58</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>27</revnumber><date>2014-07-22 09:13:24</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>26</revnumber><date>2014-07-16 10:20:41</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>25</revnumber><date>2014-07-16 10:17:00</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>24</revnumber><date>2014-07-16 09:29:37</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>23</revnumber><date>2014-07-16 08:45:05</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>22</revnumber><date>2013-03-08 10:17:30</date><authorinitials>localhost</authorinitials><revremark>converted to 1.6 markup</revremark></revision><revision><revnumber>21</revnumber><date>2007-10-30 15:10:53</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>20</revnumber><date>2007-10-30 15:10:27</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>19</revnumber><date>2007-10-30 14:49:53</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>18</revnumber><date>2007-10-25 15:00:10</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>17</revnumber><date>2007-10-25 14:59:11</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>16</revnumber><date>2007-10-25 14:29:49</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>15</revnumber><date>2007-10-25 14:27:14</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>14</revnumber><date>2007-10-22 15:02:30</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>13</revnumber><date>2007-10-19 10:03:52</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>12</revnumber><date>2007-10-19 10:03:20</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>11</revnumber><date>2007-10-19 09:32:47</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>10</revnumber><date>2007-10-18 15:00:12</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>9</revnumber><date>2007-10-18 14:59:24</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>8</revnumber><date>2007-10-18 14:11:04</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>7</revnumber><date>2007-10-18 14:10:36</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>6</revnumber><date>2007-10-18 14:10:06</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>5</revnumber><date>2007-10-18 14:09:32</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>4</revnumber><date>2007-10-18 14:09:05</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>3</revnumber><date>2007-10-18 14:08:48</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>2</revnumber><date>2007-10-18 14:04:57</date><authorinitials>PeterWatson</authorinitials></revision><revision><revnumber>1</revnumber><date>2007-10-18 13:58:55</date><authorinitials>PeterWatson</authorinitials></revision></revhistory></articleinfo><section><title>Statistical tests of equivalence</title><para>Wellek (2003) illustrates the application of a series of familiar statistical tests corresponding to null and alternative statistical hypotheses of general form </para><para>H0: $$\theta \leq $$-t or $$\theta \geq$$ t and  HA : -t $$ \leq \theta \leq$$ t </para><para>where $$\theta$$ is a function of parameters of interest (e.g. a difference between two group means) and t is the effect size of minimal interest (e.g. minimum difference in a pair of group means which is of clinical interest).  Equivalence testing can also, more simply, be thought of as seeing if an apriori specified clinically meaningful difference is contained in the confidence interval for the effect size obtained from the observed data. An illustration of using a confidence interval for the effect size, Cohen's d, to perform an equivalence test for two groups is <ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/equiveg#">is given here.</ulink>  </para><para>Equivalence tests are also known as reverse tests because they switch around the 'usual' hypotheses of form </para><para>H0: $$\theta$$ = t and HA: $$\theta \ne$$ t </para><para>and so the emphasis is on verifying rather than rejecting hypotheses such as equality of group means or zero correlations. Failing to reject a null hypothesis is not the same as showing it to be valid. If H0 takes just one-sided e.g. $$\theta \leq $$-t these tests are known as either inferiority or superiority tests as one is wishing to see if the confidence interval contains a signed difference showing a particular treatment is better (superior) or worse (inferior) to the other treatment. A web calculator using results from Julious (2004), Pocock (1983) and Blackwelder (1982) for equivalence, inferiority and superiority sample size calculation may be used <ulink url="https://www.sealedenvelope.com/power/binary-superiority/">here.</ulink> These results together with those from Thabane can also be obtained using this <ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/equival?action=AttachFile&amp;do=get&amp;target=julious.xls">spreadsheet.</ulink> </para><para>SAS and FORTRAN programs with help guides are available <ulink url="http://zima04.zi-mannheim.de/wktsheq/">for free download</ulink> which run equivalence analyses for other statistical tests using methodology described in Wellek (2003). It is easier to run the SAS programs. After downloading change the file name from *.sas to *.sss before clicking on the icon. <emphasis role="strong">CBSUERS: If SAS is not on your PC it can be added on by one of our CBSU IT people.</emphasis> There is also a suite of <ulink url="http://cran.r-project.org/web/packages/equivalence/equivalence.pdf">equivalence programs</ulink> for use with R. </para><itemizedlist><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/mageq#">Suggested effect sizes, t</ulink> </para></listitem><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/tequi#">R code for equivalence test for (un)paired t-tests</ulink> </para></listitem><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/zequiv#">R code for equivalence test for one sample z-test</ulink> </para></listitem><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/bin2#">R code for equivalence test for two unrelated proportions</ulink> </para></listitem><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/mcnequiv#">R code for equivalence test using McNemar's test</ulink> </para></listitem><listitem><para><ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/oneweq#">R code for equivalence test for one-way ANOVA</ulink> </para></listitem></itemizedlist><para>This <ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/equival?action=AttachFile&amp;do=get&amp;target=samplesizes.pdf">pdf file</ulink> comprising of class notes by Lehana Thabane of <ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/McMaster#">McMaster</ulink> University gives simple formulae for working out samples sizes for equivalence of form difference in means, regardless of direction, being at least delta and one-sided versions - differences in mean 1 - mean 2 &lt;= delta (Superiority) and mean 1 - mean 2 &gt;= delta (Inferiority). The Thabane formulae correspond to the non-inferiority examples in Julious's website mentioned above. </para><para><emphasis role="underline">References</emphasis> </para><para>Blackwelder WC (1982) Proving the Null Hypothesis&quot; in Clinical Trials. <emphasis>Control. Clin. Trials</emphasis> <emphasis role="strong">3</emphasis> , 345-353. </para><para>Donner A (1984) <ulink url="https://lsr-wiki-02.mrc-cbu.cam.ac.uk/statswiki/FAQ/equival/statswiki/FAQ/equival?action=AttachFile&amp;do=get&amp;target=donner1984.pdf">Approaches to sample size estimation in the design of clinical trials - a review.</ulink> <emphasis>Statistics in Medicine</emphasis> <emphasis role="strong">3</emphasis> 199-214. Looks at formulae for equivalence and sample size formulae for power analyses. </para><para>Julious SA (2004) Sample sizes for clinical trials with Normal data. <emphasis>Statistics in Medicine</emphasis> <emphasis role="strong">23</emphasis>, 1921-1986. </para><para>Lew MJ (2006) Principles: When there should be no difference - how to fail to reject the null hypothesis. <emphasis>Trends in Pharmacological Sciences</emphasis> <emphasis role="strong">27(5)</emphasis> 274-278. <ulink url="http://www.sciencedirect.com/science">Available to CBSU users on ScienceDirect.</ulink> </para><para>Pocock SJ (1983) Clinical Trials: A Practical Approach. Wiley. </para><para>Wellek S (2003) Testing of statistical hypotheses of equivalence. Chapman and Hall/CRC Press. </para></section></article>