My settings for the apiviz javadoc ant task in a gist. If you are not on windows than you know what to change already and you have to obviously change the link to the packagelist in the link offline to point to your sdk.dir/docs/reference.
As you can the linkoffline will give the correct linking as you are using the 2nd parameter to supply the package-list file which i sin your installed sdk not via the developer reference link. Hack if you will to make it work.