How to run all junit tests with Ant and get the correct exit code at the same time?

Question

Apache Ant

[junit haltonfailure = false] - in the end Ant writes like "BUILD SUCCESSFUL" - it's lying, in fact.

[junit haltonfailure = true] - no longer says “successful”, but the process stops at the first failed test.

How to get the correct status and run all the tests?

// Ant 1.8

Answer 1

well, in general, you can get the result from the junit task in the attribute: [junit… failureproperty=testsfailed]
and then [fail message="Tests failed." unless="testsfailed"/]
although it's strange that it has to be so hard to do =(

Answer 2

<target name="run-test" depends="init-test, compile-test" unless="option.skiptest">
    <mkdir dir="${test.xml}" />

    <junit 
      haltonfailure="off"
      haltonerror="off"
      errorproperty="test.failed"
      failureproperty="test.failed"
      showoutput="no"
      printsummary="yes"
      includeantruntime="yes"
      dir="${test.build}"
      fork="true">
      <classpath>
        <path refid="test.classpath" />
      </classpath>
      <formatter type="xml"/>
      <batchtest todir="${test.xml}">
        <fileset refid="test.fileset" />
      </batchtest>
    </junit>
  </target>

  <target name="test" depends="run-test" unless="option.skiptest" description="Run unit tests">
    <fail if="test.failed"
      message="At least one test has failed. See logs (in ${test.xml}) for details (use the target test-report to run the test with a report)" />
  </target>

  <target name="test-report" depends="run-test" unless="option.skiptest" description="Run the test with report">
    <junitreport todir="${test.xml}">
      <fileset dir="${test.xml}">
        <include name="TEST-*.xml"/>
      </fileset>
      <report format="noframes" todir="${reports}">
      </report>
    </junitreport>
    <fail if="test.failed"
      message="At least one test has failed. See logs (in ${test.xml}) or report (in ${reports})" />
  </target>