luomingshuang
commited on
Commit
•
b815ccf
1
Parent(s):
4a6a58c
Commit models
Browse files- data/lang_bpe_500/bpe.model +3 -0
- exp/pretrained_average_14_to_29.pt +3 -0
- log/beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/beam_search/log-decode-epoch-29-avg-16-beam-4-2022-03-02-10-52-09 +69 -0
- log/beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/greedy_search/errs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt +0 -0
- log/greedy_search/errs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt +0 -0
- log/greedy_search/log-decode-epoch-29-avg-16-context-2-max-sym-per-frame-3-2022-03-02-10-34-49 +27 -0
- log/greedy_search/recogs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt +0 -0
- log/greedy_search/recogs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt +0 -0
- log/modified_beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/modified_beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/modified_beam_search/log-decode-epoch-29-avg-16-beam-4-2022-03-02-11-25-20 +69 -0
- log/modified_beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
- log/modified_beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt +0 -0
data/lang_bpe_500/bpe.model
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fd8b4231858d8fb08bdaa2769b6afe4e31e3997df241ca078c4471e409a3b5f0
|
3 |
+
size 244908
|
exp/pretrained_average_14_to_29.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0b2d354d0dd71c8d1f02302bc106bca1dd3f6e440ca3715bfd5734869cd19098
|
3 |
+
size 336195417
|
log/beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/beam_search/log-decode-epoch-29-avg-16-beam-4-2022-03-02-10-52-09
ADDED
@@ -0,0 +1,69 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
2022-03-02 10:52:09,149 INFO [decode.py:416] Decoding started
|
2 |
+
2022-03-02 10:52:09,149 INFO [decode.py:422] Device: cuda:0
|
3 |
+
2022-03-02 10:52:09,162 INFO [decode.py:432] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.11', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'd6323d5fe6ae70eb36432e2e26018928e669b7ac', 'k2-git-date': 'Mon Jan 17 10:33:23 2022', 'lhotse-version': '1.0.0.dev+git.2a116ff.dirty', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-transducer-stateless', 'icefall-git-sha1': 'ac7c2d8-dirty', 'icefall-git-date': 'Wed Feb 23 08:33:20 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.2a116ff.dirty-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-6-1217190258-77fd9bbbc8-d7dpq', 'IP address': '10.48.40.206'}, 'epoch': 29, 'avg': 16, 'exp_dir': PosixPath('transducer_stateless/exp-4-gpu-new'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-4-gpu-new/beam_search'), 'suffix': 'epoch-29-avg-16-beam-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
|
4 |
+
2022-03-02 10:52:09,162 INFO [decode.py:434] About to create model
|
5 |
+
2022-03-02 10:52:09,759 INFO [decode.py:445] averaging ['transducer_stateless/exp-4-gpu-new/epoch-14.pt', 'transducer_stateless/exp-4-gpu-new/epoch-15.pt', 'transducer_stateless/exp-4-gpu-new/epoch-16.pt', 'transducer_stateless/exp-4-gpu-new/epoch-17.pt', 'transducer_stateless/exp-4-gpu-new/epoch-18.pt', 'transducer_stateless/exp-4-gpu-new/epoch-19.pt', 'transducer_stateless/exp-4-gpu-new/epoch-20.pt', 'transducer_stateless/exp-4-gpu-new/epoch-21.pt', 'transducer_stateless/exp-4-gpu-new/epoch-22.pt', 'transducer_stateless/exp-4-gpu-new/epoch-23.pt', 'transducer_stateless/exp-4-gpu-new/epoch-24.pt', 'transducer_stateless/exp-4-gpu-new/epoch-25.pt', 'transducer_stateless/exp-4-gpu-new/epoch-26.pt', 'transducer_stateless/exp-4-gpu-new/epoch-27.pt', 'transducer_stateless/exp-4-gpu-new/epoch-28.pt', 'transducer_stateless/exp-4-gpu-new/epoch-29.pt']
|
6 |
+
2022-03-02 10:52:26,908 INFO [decode.py:454] Number of model parameters: 84007924
|
7 |
+
2022-03-02 10:52:26,908 INFO [asr_datamodule.py:357] About to get dev cuts
|
8 |
+
2022-03-02 10:52:26,942 INFO [asr_datamodule.py:362] About to get test cuts
|
9 |
+
2022-03-02 10:52:27,004 INFO [asr_datamodule.py:300] About to create dev dataset
|
10 |
+
2022-03-02 10:52:27,006 INFO [asr_datamodule.py:319] About to create dev dataloader
|
11 |
+
2022-03-02 10:52:52,100 INFO [decode.py:341] batch 0/?, cuts processed until now is 22
|
12 |
+
2022-03-02 10:53:39,854 INFO [decode.py:341] batch 2/?, cuts processed until now is 69
|
13 |
+
2022-03-02 10:54:28,566 INFO [decode.py:341] batch 4/?, cuts processed until now is 94
|
14 |
+
2022-03-02 10:55:04,388 INFO [decode.py:341] batch 6/?, cuts processed until now is 126
|
15 |
+
2022-03-02 10:55:52,725 INFO [decode.py:341] batch 8/?, cuts processed until now is 148
|
16 |
+
2022-03-02 10:56:40,318 INFO [decode.py:341] batch 10/?, cuts processed until now is 188
|
17 |
+
2022-03-02 10:57:31,829 INFO [decode.py:341] batch 12/?, cuts processed until now is 201
|
18 |
+
2022-03-02 10:58:21,484 INFO [decode.py:341] batch 14/?, cuts processed until now is 224
|
19 |
+
2022-03-02 10:58:56,287 INFO [decode.py:341] batch 16/?, cuts processed until now is 243
|
20 |
+
2022-03-02 10:59:43,349 INFO [decode.py:341] batch 18/?, cuts processed until now is 278
|
21 |
+
2022-03-02 11:00:31,863 INFO [decode.py:341] batch 20/?, cuts processed until now is 314
|
22 |
+
2022-03-02 11:01:17,863 INFO [decode.py:341] batch 22/?, cuts processed until now is 359
|
23 |
+
2022-03-02 11:01:57,286 INFO [decode.py:341] batch 24/?, cuts processed until now is 380
|
24 |
+
2022-03-02 11:02:37,120 INFO [decode.py:341] batch 26/?, cuts processed until now is 401
|
25 |
+
2022-03-02 11:03:06,524 INFO [decode.py:341] batch 28/?, cuts processed until now is 425
|
26 |
+
2022-03-02 11:03:49,672 INFO [decode.py:341] batch 30/?, cuts processed until now is 445
|
27 |
+
2022-03-02 11:04:20,302 INFO [decode.py:341] batch 32/?, cuts processed until now is 457
|
28 |
+
2022-03-02 11:04:37,646 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt
|
29 |
+
2022-03-02 11:04:37,674 INFO [utils.py:404] [dev-beam_4] %WER 7.12% [1297 / 18226, 225 ins, 409 del, 663 sub ]
|
30 |
+
2022-03-02 11:04:37,746 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt
|
31 |
+
2022-03-02 11:04:37,754 INFO [decode.py:388]
|
32 |
+
For dev, WER of different settings are:
|
33 |
+
beam_4 7.12 best for dev
|
34 |
+
|
35 |
+
2022-03-02 11:05:02,169 INFO [decode.py:341] batch 0/?, cuts processed until now is 29
|
36 |
+
2022-03-02 11:05:50,315 INFO [decode.py:341] batch 2/?, cuts processed until now is 107
|
37 |
+
2022-03-02 11:06:37,656 INFO [decode.py:341] batch 4/?, cuts processed until now is 140
|
38 |
+
2022-03-02 11:07:22,209 INFO [decode.py:341] batch 6/?, cuts processed until now is 216
|
39 |
+
2022-03-02 11:08:10,208 INFO [decode.py:341] batch 8/?, cuts processed until now is 246
|
40 |
+
2022-03-02 11:08:57,943 INFO [decode.py:341] batch 10/?, cuts processed until now is 304
|
41 |
+
2022-03-02 11:09:46,256 INFO [decode.py:341] batch 12/?, cuts processed until now is 320
|
42 |
+
2022-03-02 11:10:33,712 INFO [decode.py:341] batch 14/?, cuts processed until now is 351
|
43 |
+
2022-03-02 11:11:19,999 INFO [decode.py:341] batch 16/?, cuts processed until now is 393
|
44 |
+
2022-03-02 11:12:06,014 INFO [decode.py:341] batch 18/?, cuts processed until now is 434
|
45 |
+
2022-03-02 11:12:54,341 INFO [decode.py:341] batch 20/?, cuts processed until now is 465
|
46 |
+
2022-03-02 11:13:35,172 INFO [decode.py:341] batch 22/?, cuts processed until now is 583
|
47 |
+
2022-03-02 11:14:22,685 INFO [decode.py:341] batch 24/?, cuts processed until now is 624
|
48 |
+
2022-03-02 11:15:10,170 INFO [decode.py:341] batch 26/?, cuts processed until now is 658
|
49 |
+
2022-03-02 11:15:57,098 INFO [decode.py:341] batch 28/?, cuts processed until now is 699
|
50 |
+
2022-03-02 11:16:42,749 INFO [decode.py:341] batch 30/?, cuts processed until now is 738
|
51 |
+
2022-03-02 11:17:29,626 INFO [decode.py:341] batch 32/?, cuts processed until now is 794
|
52 |
+
2022-03-02 11:18:06,943 INFO [decode.py:341] batch 34/?, cuts processed until now is 836
|
53 |
+
2022-03-02 11:18:54,191 INFO [decode.py:341] batch 36/?, cuts processed until now is 881
|
54 |
+
2022-03-02 11:19:41,183 INFO [decode.py:341] batch 38/?, cuts processed until now is 907
|
55 |
+
2022-03-02 11:20:05,642 INFO [decode.py:341] batch 40/?, cuts processed until now is 943
|
56 |
+
2022-03-02 11:20:45,652 INFO [decode.py:341] batch 42/?, cuts processed until now is 979
|
57 |
+
2022-03-02 11:21:32,986 INFO [decode.py:341] batch 44/?, cuts processed until now is 1011
|
58 |
+
2022-03-02 11:22:08,039 INFO [decode.py:341] batch 46/?, cuts processed until now is 1068
|
59 |
+
2022-03-02 11:22:33,817 INFO [decode.py:341] batch 48/?, cuts processed until now is 1084
|
60 |
+
2022-03-02 11:23:13,370 INFO [decode.py:341] batch 50/?, cuts processed until now is 1113
|
61 |
+
2022-03-02 11:23:39,373 INFO [decode.py:341] batch 52/?, cuts processed until now is 1155
|
62 |
+
2022-03-02 11:23:39,656 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt
|
63 |
+
2022-03-02 11:23:39,700 INFO [utils.py:404] [test-beam_4] %WER 6.37% [1811 / 28430, 266 ins, 623 del, 922 sub ]
|
64 |
+
2022-03-02 11:23:39,813 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt
|
65 |
+
2022-03-02 11:23:39,822 INFO [decode.py:388]
|
66 |
+
For test, WER of different settings are:
|
67 |
+
beam_4 6.37 best for test
|
68 |
+
|
69 |
+
2022-03-02 11:23:39,822 INFO [decode.py:480] Done!
|
log/beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/greedy_search/errs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/greedy_search/errs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/greedy_search/log-decode-epoch-29-avg-16-context-2-max-sym-per-frame-3-2022-03-02-10-34-49
ADDED
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
2022-03-02 10:34:49,168 INFO [decode.py:416] Decoding started
|
2 |
+
2022-03-02 10:34:49,168 INFO [decode.py:422] Device: cuda:0
|
3 |
+
2022-03-02 10:34:49,181 INFO [decode.py:432] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.11', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'd6323d5fe6ae70eb36432e2e26018928e669b7ac', 'k2-git-date': 'Mon Jan 17 10:33:23 2022', 'lhotse-version': '1.0.0.dev+git.2a116ff.dirty', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-transducer-stateless', 'icefall-git-sha1': 'ac7c2d8-dirty', 'icefall-git-date': 'Wed Feb 23 08:33:20 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.2a116ff.dirty-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-6-1217190258-77fd9bbbc8-d7dpq', 'IP address': '10.48.40.206'}, 'epoch': 29, 'avg': 16, 'exp_dir': PosixPath('transducer_stateless/exp-4-gpu-new'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-4-gpu-new/greedy_search'), 'suffix': 'epoch-29-avg-16-context-2-max-sym-per-frame-3', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
|
4 |
+
2022-03-02 10:34:49,181 INFO [decode.py:434] About to create model
|
5 |
+
2022-03-02 10:34:49,747 INFO [decode.py:445] averaging ['transducer_stateless/exp-4-gpu-new/epoch-14.pt', 'transducer_stateless/exp-4-gpu-new/epoch-15.pt', 'transducer_stateless/exp-4-gpu-new/epoch-16.pt', 'transducer_stateless/exp-4-gpu-new/epoch-17.pt', 'transducer_stateless/exp-4-gpu-new/epoch-18.pt', 'transducer_stateless/exp-4-gpu-new/epoch-19.pt', 'transducer_stateless/exp-4-gpu-new/epoch-20.pt', 'transducer_stateless/exp-4-gpu-new/epoch-21.pt', 'transducer_stateless/exp-4-gpu-new/epoch-22.pt', 'transducer_stateless/exp-4-gpu-new/epoch-23.pt', 'transducer_stateless/exp-4-gpu-new/epoch-24.pt', 'transducer_stateless/exp-4-gpu-new/epoch-25.pt', 'transducer_stateless/exp-4-gpu-new/epoch-26.pt', 'transducer_stateless/exp-4-gpu-new/epoch-27.pt', 'transducer_stateless/exp-4-gpu-new/epoch-28.pt', 'transducer_stateless/exp-4-gpu-new/epoch-29.pt']
|
6 |
+
2022-03-02 10:35:19,190 INFO [decode.py:454] Number of model parameters: 84007924
|
7 |
+
2022-03-02 10:35:19,191 INFO [asr_datamodule.py:357] About to get dev cuts
|
8 |
+
2022-03-02 10:35:19,233 INFO [asr_datamodule.py:362] About to get test cuts
|
9 |
+
2022-03-02 10:35:19,296 INFO [asr_datamodule.py:300] About to create dev dataset
|
10 |
+
2022-03-02 10:35:19,298 INFO [asr_datamodule.py:319] About to create dev dataloader
|
11 |
+
2022-03-02 10:35:21,343 INFO [decode.py:341] batch 0/?, cuts processed until now is 22
|
12 |
+
2022-03-02 10:36:01,497 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/greedy_search/recogs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
|
13 |
+
2022-03-02 10:36:01,526 INFO [utils.py:404] [dev-greedy_search] %WER 7.19% [1311 / 18226, 187 ins, 466 del, 658 sub ]
|
14 |
+
2022-03-02 10:36:01,600 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/greedy_search/errs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
|
15 |
+
2022-03-02 10:36:01,608 INFO [decode.py:388]
|
16 |
+
For dev, WER of different settings are:
|
17 |
+
greedy_search 7.19 best for dev
|
18 |
+
|
19 |
+
2022-03-02 10:36:03,619 INFO [decode.py:341] batch 0/?, cuts processed until now is 29
|
20 |
+
2022-03-02 10:37:08,516 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/greedy_search/recogs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
|
21 |
+
2022-03-02 10:37:08,560 INFO [utils.py:404] [test-greedy_search] %WER 6.57% [1869 / 28430, 206 ins, 733 del, 930 sub ]
|
22 |
+
2022-03-02 10:37:08,675 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/greedy_search/errs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
|
23 |
+
2022-03-02 10:37:08,684 INFO [decode.py:388]
|
24 |
+
For test, WER of different settings are:
|
25 |
+
greedy_search 6.57 best for test
|
26 |
+
|
27 |
+
2022-03-02 10:37:08,684 INFO [decode.py:480] Done!
|
log/greedy_search/recogs-dev-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/greedy_search/recogs-test-greedy_search-epoch-29-avg-16-context-2-max-sym-per-frame-3.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/modified_beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/modified_beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/modified_beam_search/log-decode-epoch-29-avg-16-beam-4-2022-03-02-11-25-20
ADDED
@@ -0,0 +1,69 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
2022-03-02 11:25:20,873 INFO [decode.py:416] Decoding started
|
2 |
+
2022-03-02 11:25:20,873 INFO [decode.py:422] Device: cuda:0
|
3 |
+
2022-03-02 11:25:20,883 INFO [decode.py:432] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.11', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'd6323d5fe6ae70eb36432e2e26018928e669b7ac', 'k2-git-date': 'Mon Jan 17 10:33:23 2022', 'lhotse-version': '1.0.0.dev+git.2a116ff.dirty', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-transducer-stateless', 'icefall-git-sha1': 'ac7c2d8-dirty', 'icefall-git-date': 'Wed Feb 23 08:33:20 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.2a116ff.dirty-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-6-1217190258-77fd9bbbc8-d7dpq', 'IP address': '10.48.40.206'}, 'epoch': 29, 'avg': 16, 'exp_dir': PosixPath('transducer_stateless/exp-4-gpu-new'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-4-gpu-new/modified_beam_search'), 'suffix': 'epoch-29-avg-16-beam-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
|
4 |
+
2022-03-02 11:25:20,884 INFO [decode.py:434] About to create model
|
5 |
+
2022-03-02 11:25:21,503 INFO [decode.py:445] averaging ['transducer_stateless/exp-4-gpu-new/epoch-14.pt', 'transducer_stateless/exp-4-gpu-new/epoch-15.pt', 'transducer_stateless/exp-4-gpu-new/epoch-16.pt', 'transducer_stateless/exp-4-gpu-new/epoch-17.pt', 'transducer_stateless/exp-4-gpu-new/epoch-18.pt', 'transducer_stateless/exp-4-gpu-new/epoch-19.pt', 'transducer_stateless/exp-4-gpu-new/epoch-20.pt', 'transducer_stateless/exp-4-gpu-new/epoch-21.pt', 'transducer_stateless/exp-4-gpu-new/epoch-22.pt', 'transducer_stateless/exp-4-gpu-new/epoch-23.pt', 'transducer_stateless/exp-4-gpu-new/epoch-24.pt', 'transducer_stateless/exp-4-gpu-new/epoch-25.pt', 'transducer_stateless/exp-4-gpu-new/epoch-26.pt', 'transducer_stateless/exp-4-gpu-new/epoch-27.pt', 'transducer_stateless/exp-4-gpu-new/epoch-28.pt', 'transducer_stateless/exp-4-gpu-new/epoch-29.pt']
|
6 |
+
2022-03-02 11:25:39,165 INFO [decode.py:454] Number of model parameters: 84007924
|
7 |
+
2022-03-02 11:25:39,165 INFO [asr_datamodule.py:350] About to get dev cuts
|
8 |
+
2022-03-02 11:25:39,198 INFO [asr_datamodule.py:355] About to get test cuts
|
9 |
+
2022-03-02 11:25:39,258 INFO [asr_datamodule.py:293] About to create dev dataset
|
10 |
+
2022-03-02 11:25:39,260 INFO [asr_datamodule.py:312] About to create dev dataloader
|
11 |
+
2022-03-02 11:25:43,016 INFO [decode.py:341] batch 0/?, cuts processed until now is 22
|
12 |
+
2022-03-02 11:25:49,245 INFO [decode.py:341] batch 2/?, cuts processed until now is 69
|
13 |
+
2022-03-02 11:25:56,523 INFO [decode.py:341] batch 4/?, cuts processed until now is 94
|
14 |
+
2022-03-02 11:26:01,455 INFO [decode.py:341] batch 6/?, cuts processed until now is 126
|
15 |
+
2022-03-02 11:26:07,958 INFO [decode.py:341] batch 8/?, cuts processed until now is 148
|
16 |
+
2022-03-02 11:26:14,249 INFO [decode.py:341] batch 10/?, cuts processed until now is 188
|
17 |
+
2022-03-02 11:26:20,949 INFO [decode.py:341] batch 12/?, cuts processed until now is 201
|
18 |
+
2022-03-02 11:26:27,922 INFO [decode.py:341] batch 14/?, cuts processed until now is 224
|
19 |
+
2022-03-02 11:26:32,768 INFO [decode.py:341] batch 16/?, cuts processed until now is 243
|
20 |
+
2022-03-02 11:26:39,312 INFO [decode.py:341] batch 18/?, cuts processed until now is 278
|
21 |
+
2022-03-02 11:26:45,808 INFO [decode.py:341] batch 20/?, cuts processed until now is 314
|
22 |
+
2022-03-02 11:26:51,964 INFO [decode.py:341] batch 22/?, cuts processed until now is 359
|
23 |
+
2022-03-02 11:26:57,142 INFO [decode.py:341] batch 24/?, cuts processed until now is 380
|
24 |
+
2022-03-02 11:27:02,297 INFO [decode.py:341] batch 26/?, cuts processed until now is 401
|
25 |
+
2022-03-02 11:27:06,347 INFO [decode.py:341] batch 28/?, cuts processed until now is 425
|
26 |
+
2022-03-02 11:27:11,996 INFO [decode.py:341] batch 30/?, cuts processed until now is 445
|
27 |
+
2022-03-02 11:27:15,993 INFO [decode.py:341] batch 32/?, cuts processed until now is 457
|
28 |
+
2022-03-02 11:27:18,521 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/modified_beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt
|
29 |
+
2022-03-02 11:27:18,548 INFO [utils.py:404] [dev-beam_4] %WER 7.00% [1276 / 18226, 202 ins, 408 del, 666 sub ]
|
30 |
+
2022-03-02 11:27:18,621 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/modified_beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt
|
31 |
+
2022-03-02 11:27:18,629 INFO [decode.py:388]
|
32 |
+
For dev, WER of different settings are:
|
33 |
+
beam_4 7.0 best for dev
|
34 |
+
|
35 |
+
2022-03-02 11:27:22,234 INFO [decode.py:341] batch 0/?, cuts processed until now is 29
|
36 |
+
2022-03-02 11:27:28,220 INFO [decode.py:341] batch 2/?, cuts processed until now is 107
|
37 |
+
2022-03-02 11:27:34,441 INFO [decode.py:341] batch 4/?, cuts processed until now is 140
|
38 |
+
2022-03-02 11:27:40,347 INFO [decode.py:341] batch 6/?, cuts processed until now is 216
|
39 |
+
2022-03-02 11:27:46,625 INFO [decode.py:341] batch 8/?, cuts processed until now is 246
|
40 |
+
2022-03-02 11:27:52,897 INFO [decode.py:341] batch 10/?, cuts processed until now is 304
|
41 |
+
2022-03-02 11:27:59,337 INFO [decode.py:341] batch 12/?, cuts processed until now is 320
|
42 |
+
2022-03-02 11:28:05,790 INFO [decode.py:341] batch 14/?, cuts processed until now is 351
|
43 |
+
2022-03-02 11:28:12,044 INFO [decode.py:341] batch 16/?, cuts processed until now is 393
|
44 |
+
2022-03-02 11:28:18,171 INFO [decode.py:341] batch 18/?, cuts processed until now is 434
|
45 |
+
2022-03-02 11:28:24,565 INFO [decode.py:341] batch 20/?, cuts processed until now is 465
|
46 |
+
2022-03-02 11:28:30,670 INFO [decode.py:341] batch 22/?, cuts processed until now is 583
|
47 |
+
2022-03-02 11:28:37,255 INFO [decode.py:341] batch 24/?, cuts processed until now is 624
|
48 |
+
2022-03-02 11:28:43,581 INFO [decode.py:341] batch 26/?, cuts processed until now is 658
|
49 |
+
2022-03-02 11:28:50,087 INFO [decode.py:341] batch 28/?, cuts processed until now is 699
|
50 |
+
2022-03-02 11:28:56,305 INFO [decode.py:341] batch 30/?, cuts processed until now is 738
|
51 |
+
2022-03-02 11:29:02,537 INFO [decode.py:341] batch 32/?, cuts processed until now is 794
|
52 |
+
2022-03-02 11:29:07,438 INFO [decode.py:341] batch 34/?, cuts processed until now is 836
|
53 |
+
2022-03-02 11:29:13,738 INFO [decode.py:341] batch 36/?, cuts processed until now is 881
|
54 |
+
2022-03-02 11:29:20,810 INFO [decode.py:341] batch 38/?, cuts processed until now is 907
|
55 |
+
2022-03-02 11:29:24,185 INFO [decode.py:341] batch 40/?, cuts processed until now is 943
|
56 |
+
2022-03-02 11:29:29,528 INFO [decode.py:341] batch 42/?, cuts processed until now is 979
|
57 |
+
2022-03-02 11:29:36,740 INFO [decode.py:341] batch 44/?, cuts processed until now is 1011
|
58 |
+
2022-03-02 11:29:42,860 INFO [decode.py:341] batch 46/?, cuts processed until now is 1068
|
59 |
+
2022-03-02 11:29:47,492 INFO [decode.py:341] batch 48/?, cuts processed until now is 1084
|
60 |
+
2022-03-02 11:29:52,941 INFO [decode.py:341] batch 50/?, cuts processed until now is 1113
|
61 |
+
2022-03-02 11:29:56,544 INFO [decode.py:341] batch 52/?, cuts processed until now is 1155
|
62 |
+
2022-03-02 11:29:56,824 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/modified_beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt
|
63 |
+
2022-03-02 11:29:56,871 INFO [utils.py:404] [test-beam_4] %WER 6.19% [1761 / 28430, 219 ins, 625 del, 917 sub ]
|
64 |
+
2022-03-02 11:29:56,974 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/modified_beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt
|
65 |
+
2022-03-02 11:29:56,983 INFO [decode.py:388]
|
66 |
+
For test, WER of different settings are:
|
67 |
+
beam_4 6.19 best for test
|
68 |
+
|
69 |
+
2022-03-02 11:29:56,983 INFO [decode.py:480] Done!
|
log/modified_beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
log/modified_beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|