gobbli.test.test_util module

gobbli.test.test_util.TEST_ARCHIVE_DATA = ['./a', './b/c']

gobbli.test.test_util.make_gz(tmpdir, name)

Create a gzip-compressed file with the given name under the given temp directory. Return the path to the compressed file.

Return type

Path

gobbli.test.test_util.make_tar_gz(tmpdir, relative_paths)

Make a .tar.gz archive from a list of relative paths. Create empty files at each path and add them to the archive.

Return type

Path

gobbli.test.test_util.make_zip(tmpdir, relative_paths)

Make a zip archive from a list of relative paths. Create empty files at each path and add them to the archive.

Return type

Path

gobbli.test.test_util.test_blob_to_dir(tmpdir)

gobbli.test.test_util.test_detokenize_split_spacy(text, tokens, tokenize_method)

gobbli.test.test_util.test_dir_to_blob(tmpdir)

gobbli.test.test_util.test_extract_archive(tmpdir, archive_func, junk, expected_paths)

gobbli.test.test_util.test_extract_gz(tmpdir)

gobbli.test.test_util.test_is_archive(name, expected_is_archive)

gobbli.test.test_util.test_shuffle_together(l1, l2, err)

gobbli.test.test_util.test_tokenize_detokenize_sentencepiece(tmpdir, model_path)

gobbli.test.test_util.test_tokenize_spacy(text, tokens)

gobbli.test.test_util.test_tokenize_split(text, tokens)