The Jack toolchain
Jack is a new Android toolchain that compiles Javasource into Android dex bytecode. It replaces the previous Android toolchain,which consists of multiple tools, such as javac, ProGuard, jarjar, and dx.
The Jack toolchain provides the following advantages:
- Completely open source
Available in AOSP; partners are welcome to contribute. - Speeds compilation time
Jack has specific supports to reduce compilation time: pre-dexing, incrementalcompilation and a Jack compilation server. - Handles shrinking, obfuscation, repackaging and multidex
Using a separate package such as ProGuard is no longer necessary.
Figure 1. Jack overview
The .jack library format
Jack has its own .jack file format, which contains the pre-compiled dex codefor the library, allowing for faster compilation (pre-dex).
Figure 2. Jack library file contents
Jill
The Jill tool translates the existing .jar libraries into the new libraryformat, as shown below.
Figure 3. Workflow to import an existing .jar library
Using Jack in your Android build
You don’t have to do anything differently to use Jack — just use your standardmakefile commands to compile the tree or your project. Jack is the defaultAndroid build toolchain for M.
The first time Jack is used, it launches a local Jack compilation server onyour computer:
- This server brings an intrinsic speedup, because it avoids launching a new hostJRE JVM, loading Jack code, initializing Jack and warming up the JIT at eachcompilation. It also provides very good compilation times during smallcompilations (e.g. in incremental mode).
- The server is also a short-term solution to control the number of parallel Jackcompilations, and so to avoid overloading your computer (memory or disk issue),because it limits the number of parallel compilations.
The Jack server shuts itself down after an idle time without any compilation.It uses two TCP ports on the localhost interface, and so is not availableexternally. All these parameters (number of parallel compilations, timeout,ports number, etc) can be modified
by editing the $HOME/.jack
file.
$HOME/.jack file
The $HOME/.jack
file contains settings for Jack server variables, in a full bash syntax.
Here are the available settings, with their definitions and default values:
-
SERVER=true
Enable the server feature of Jack. -
SERVER_PORT_SERVICE=8072
Set the TCP port number of the server for compilation purposes. -
SERVER_PORT_ADMIN=8073
Set the TCP port number of the server for admin purposes. -
SERVER_COUNT=1
Unused at present. -
SERVER_NB_COMPILE=4
Maximum number of parallel compilations allowed. -
SERVER_TIMEOUT=60
Number of idle seconds the server has to wait without any compilation beforeshutting itself down. -
SERVER_LOG=${SERVER_LOG:=$SERVER_DIR/jack-$SERVER_PORT_SERVICE.log}
File where server logs are written. By default, this variable can beoverloaded by an environment variable. -
JACK_VM_COMMAND=${JACK_VM_COMMAND:=java}
The default command used to launch a JVM on the host. By default, thisvariable can be overloaded by environment variable.
Jack troubleshooting
If your computer becomes unresponsive during compilation or if you experienceJack compilations failing on “Out of memory error”
You can improve the situation by reducing the number of Jack simultaneouscompilations by editing your $HOME/.jack
and changing SERVER_NB_COMPILE
to a lower value.
If your compilations are failing on “Cannot launch background server”
The most likely cause is TCP ports are already used on your computer. Try tochange it by editing your
$HOME/.jack
(SERVER_PORT_SERVICE
and SERVER_PORT_ADMIN
variables).
If it doesn’t solve the problem, please report and attach your compilation logand the Jack server log (see ‘Finding the Jack log’ below to know where to findthe server log file). To unblock the situation, disable jack compilation serverby editing your
$HOME/.jack
and changing SERVER
to false. Unfortunately this will significantly slow down your compilation andmay force you to launch
make -j
with load control (option "-l
" of make
).
If your compilation gets stuck without any progress
Please report this and give us the following additional information (wherepossible):
- The command line at which you are stuck.
- The output of this command line.
- The result of executing
jack-admin server-stat
. - The
$HOME/.jack
file. - The content of the server log with the server state dumped. To get this —
- Find the Jack background server process by running
jack-admin list-server
. - Send a
kill -3
command to this server to dump its state into the log file. - To locate the server log file, see ‘Finding the Jack log’ below.
- The result of executing
ls -lR $TMPDIR/jack-$USER.
- The result of running
ps j -U $USER.
You should be able to unblock yourself by killing the Jack background server(use
jack-admin kill-server
), and then by removing its temporary directories contained in
jack-$USER
of your temporary directory (/tmp
or $TMPDIR
).
If you have any other issues
To report bugs or request features, please use our public issue tracker,available at http://b.android.com, with the Jack tool bug report or Jack tool feature request templates. Please attach the Jack log to the bug report.
Finding the Jack log
|
In case of reproducible Jack failures, you can get a more detailed log bysetting one variable, as follows:
$ export ANDROID_JACK_EXTRA_ARGS="--verbose debug --sanity-checks on -D
sched.runner=single-threaded"
Then use your standard makefile commands to compile the tree or your projectand attach its standard output and error.
To remove detailed build logs use:
$ unset ANDROID_JACK_EXTRA_ARGS
Jack limitations
- The Jack server is mono-user by default, so can be only used by one user on acomputer. If it is not the case, please, choose different port numbers for eachuser and adjust SERVER_NB_COMPILE accordingly. You can also disable the Jackserver by setting SERVER=false in your $HOME/.jack.
- CTS compilation is slow due to current vm-tests-tf integration.
- Bytecode manipulation tools, like JaCoCo, are not supported.
Using Jack features
Jack supports Java programming language 1.7 and integrates additional featuresdescribed below.
Predexing
When generating a Jack library file, the .dex of the library is generated andstored inside the .jack library file as a pre-dex. When compiling, Jack reusesthe pre-dex from each library.
All libraries are pre-dexed.
Figure 4. Jack libraries with pre-dex
Limitations
Currently, Jack does not reuse the library pre-dex ifshrinking/obfuscation/repackaging is used in the compilation.
Incremental compilation
Incremental compilation means that only components that were touched since thelast compilation, and their dependencies, are recompiled. Incrementalcompilation can be significantly faster than a full compilation when changesare limited to only a limited set of components.
Limitations
Incremental compilation is deactivated when shrinking, obfuscation, repackagingor multi-dex legacy is enabled.
Enabling incremental builds
Currently incremental compilation is not enabled by default. To enableincremental builds, add the following line to the Android.mk file of theproject that you want to build incrementally:
LOCAL_JACK_ENABLED := incremental
Note: The first time that you build your project with Jack if some dependenciesare not built, use
mma
to build them, and after that you can use the standard build command.
Shrinking and Obfuscation
Jack has shrinking and obfuscation support and uses proguard configurationfiles to enable shrinking and obfuscation features. Here are the supported andignored options:
Supported common options
Common options include the following:
-
@
-
-include
-
-basedirectory
-
-injars
-
-outjars // only 1 output jar supported
-
-libraryjars
-
-keep
-
-keepclassmembers
-
-keepclasseswithmembers
-
-keepnames
-
-keepclassmembernames
-
-keepclasseswithmembernames
-
-printseeds
Supported shrinking options
Shrinking options include the following:
-
-dontshrink
Supported obfuscation options
Obfuscation options include the following:
-
-dontobfuscate
-
-printmapping
-
-applymapping
-
-obfuscationdictionary
-
-classobfuscationdictionary
-
-packageobfuscationdictionary
-
-useuniqueclassmembernames
-
-dontusemixedcaseclassnames
-
-keeppackagenames
-
-flattenpackagehierarchy
-
-repackageclasses
-
-keepattributes
-
-adaptclassstrings
Ignored options
Ignored options include the following:
-
-dontoptimize // Jack does not optimize
-
-dontpreverify // Jack does not preverify
-
-skipnonpubliclibraryclasses
-
-dontskipnonpubliclibraryclasses
-
-dontskipnonpubliclibraryclassmembers
-
-keepdirectories
-
-target
-
-forceprocessing
-
-printusage
-
-whyareyoukeeping
-
-optimizations
-
-optimizationpasses
-
-assumenosideeffects
-
-allowaccessmodification
-
-mergeinterfacesaggressively
-
-overloadaggressively
-
-microedition
-
-verbose
-
-dontnote
-
-dontwarn
-
-ignorewarnings
-
-printconfiguration
-
-dump
Note: Other options will generate an error.
Repackaging
Jack uses jarjar configuration files to do the repackaging.
Note: Jack is compatible with "rule" rule types, but is not compatible with "zap" or"keep" rule types. If you need "zap" or "keep" rule types please file a featurerequest with a description of how you use the feature in your app.
Multidex support
Since dex files are limited to 65K methods, apps with over 65K methods must besplit into multiple dex files. (See ‘Building Apps with Over 65K Methods’ for more information about multidex.)
Jack offers native and legacy multidex support.