failed in testing tokenizer with tokenizer-sample-input

[Rexime]

the output files are all empty

*** Starting priority projects...
*** Starting regular projects...
Starting new process 0
[INFO] (MainThread) Process 0 starting
[INFO] (MainThread) Starting zip project <1,./tokenizer-sample-input/aesthetic-master.zip> (process 0)
[INFO] (MainThread) Attempting to process_zip_ball ./tokenizer-sample-input/aesthetic-master.zip
[INFO] (MainThread) Successfully ran process_zip_ball ./tokenizer-sample-input/aesthetic-master.zip
[INFO] (MainThread) Project finished <1,./tokenizer-sample-input/aesthetic-master.zip> (process 0)
[INFO] (MainThread) (0): Total: 0:00:00.001463micros | Zip: 0 Read: 0 Separators: 0micros Tokens: 0micros Write: 0micros Hash: 0 regex: 0
[INFO] (MainThread) Starting zip project <2,./tokenizer-sample-input/OffsetAnimator-master.zip> (process 0)
[INFO] (MainThread) Attempting to process_zip_ball ./tokenizer-sample-input/OffsetAnimator-master.zip
[INFO] (MainThread) Successfully ran process_zip_ball ./tokenizer-sample-input/OffsetAnimator-master.zip
[INFO] (MainThread) Project finished <2,./tokenizer-sample-input/OffsetAnimator-master.zip> (process 0)
[INFO] (MainThread) (0): Total: 0:00:00.000711micros | Zip: 0 Read: 0 Separators: 0micros Tokens: 0micros Write: 0micros Hash: 0 regex: 0
[INFO] (MainThread) Process 0 finished. 0 files in 0s.
Process 0 finished, 0 files processed (1). Current total: 0
Starting new process 0
*** No more projects to process. Waiting for children to finish...
[INFO] (MainThread) Process 0 starting
[INFO] (MainThread) Starting zip project <3,./tokenizer-sample-input/ResourceInspector-master.zip> (process 0)
[INFO] (MainThread) Attempting to process_zip_ball ./tokenizer-sample-input/ResourceInspector-master.zip
[INFO] (MainThread) Successfully ran process_zip_ball ./tokenizer-sample-input/ResourceInspector-master.zip
[INFO] (MainThread) Project finished <3,./tokenizer-sample-input/ResourceInspector-master.zip> (process 0)
[INFO] (MainThread) (0): Total: 0:00:00.000759micros | Zip: 0 Read: 0 Separators: 0micros Tokens: 0micros Write: 0micros Hash: 0 regex: 0
[INFO] (MainThread) Starting zip project <4,./tokenizer-sample-input/zachtaylor-JPokemon.zip> (process 0)
[INFO] (MainThread) Attempting to process_zip_ball ./tokenizer-sample-input/zachtaylor-JPokemon.zip
[INFO] (MainThread) Successfully ran process_zip_ball ./tokenizer-sample-input/zachtaylor-JPokemon.zip
[INFO] (MainThread) Project finished <4,./tokenizer-sample-input/zachtaylor-JPokemon.zip> (process 0)
[INFO] (MainThread) (0): Total: 0:00:00.002997micros | Zip: 0 Read: 0 Separators: 0micros Tokens: 0micros Write: 0micros Hash: 0 regex: 0
[INFO] (MainThread) Process 0 finished. 0 files in 0s.
Process 0 finished, 0 files processed (1). Current total: 0
*** All done. 0 files in 0:00:00.020079
rexime@10-60-75-142:~/SourcererCC-master/tokenizers/file-level$

[Coppelian]

Hi there.
Did you try to modify the config.ini under ./block-level ?
You have to set up the File_extensions in the config.ini to let tokenizer detect your file.
It looks like you didn't set it up properly.