This page shows visualizations of some width-7 1-d convolutional filters from Google's lm_1b language model. Each column corresponds to one position in the filter, and shows the characters with the most positive weights. Use the checkbox in the bottom-right to also see the most negative weights (may be slow).

Below that are examples of words for which the filter emits the highest values. A filter's response is its maximum value over all substrings it sees in the word. So if a filter has high weights on 'c' in the first position, then 'a', then 't', it will assign equally high scores to 'cat', 'fatcat', 'concatenate', etc. The portion of the string in blue is the substring the filter is responding to.

'^' and '$' represent beginning and end of word markers, respectively. '_' is a padding character. Literal versions of those characters are escaped with a backslash.

Use the links at the top to see filters of other widths.

Check out my blog post here for a bit more context.

Filter 0 (bias = -0.47) #

Y f
R e
C -
z y
G .
T w
V x
<BOS> d
0 F
\194 u
Q h
k a
B E
X m
9 n
K q
7 H
l s
J N
D \163
x D
W u
b d
B r
V R
S -
X U
v j
\194 P
k 1
p H
Y J
f I
" C
: \195
q L
m )
a y
K g
Q E
D m
0 f
\194 y
c -
I r
v h
X s
Q u
5 i
2 k
6 b
7 g
z M
9 H
d U
C '
8 S
q Y
1 x
T V
o H
z h
O F
- A
K q
G n
s j
U k
R g
E V
" 4
J t
w 7
\195 e
' C
v b
u B
c X
$ .
9 I
Z p
M z
H l
4 r
V o
6 P
h -
X O
8 f
5 a
W s
7 d
1 \195
3 I
F t
Y R
\194 U
2 b
9 x
$ E
J c
n y
l "
L T
5 v
Z \163
A t
i d
6 '
H r
V k
3 O
7 .
B E
I p
4 h
/ g
\195 Q
2 e
K u
b c
B d
f D
F z
Q C
r g
e -
X u
N o
k v
V G
W 0
K s
E .
q n
" 1
P T
S U
H l
x t

Non-zero for 14.8% of words.

Filter 1 (bias = -0.46) #

N -
D s
B m
K w
r g
T i
8 j
L '
9 u
Q M
0 f
R V
P .
A e
\195 n
q t
O v
o 4
a S
X k
K p
U g
o C
s c
% r
u d
& k
B t
W P
N I
M n
L j
f q
" D
: H
J h
E T
9 1
\194 A
/ \163
H z
F o
Q l
M G
7 w
Z x
4 s
8 -
P v
X p
r g
N m
1 .
3 c
9 O
k a
I K
q S
6 b
u 0
x H
f I
S D
b A
B d
9 t
K u
v T
V g
" 1
W U
8 r
o n
\194 C
Y y
5 .
' _
6 P
F -
s a
k d
V D
B y
b -
R .
f c
P 1
Y o
F u
K g
' E
m h
M 2
Q a
J \163
S e
C w
r q
X O
Z 0
l c
I y
d k
\194 M
7 g
Q h
6 w
X r
P m
5 u
L o
j b
/ Z
, B
n
T
U
G
N
v
y l
Z B
. j
Q S
c f
" J
W k
/ t
$ i
X x
8 F
1 v
M b
d s
G E
H T
p
P
R
e

Non-zero for 15.4% of words.

Filter 2 (bias = -0.45) #

<BOS> A
f g
- k
M h
. C
W Y
e H
" R
O b
' 1
/ 0
w r
o G
m V
K T
N i
\194 B
Q a
y \195
t p
M r
m s
v O
- I
u p
H z
\194 R
j C
h U
X A
6 a
. S
D k
L G
T E
J P
q ,
e Q
l K
Z c
z f
0 y
A m
5 F
w r
W -
B P
E p
2 '
G u
I h
Y M
\194 k
K H
O d
o e
9 j
X n
T x
a b
Q v
7 k
j w
X a
D B
8 m
F b
3 z
6 x
P U
O c
5 i
/ u
" t
S A
$ .
4 g
1 T
L s
2 q
A v
. k
n R
g f
Z J
H P
L u
/ T
y B
C E
h U
X -
5 b
1 s
c z
w o
q \195
4 9
7 "
2 r
R c
J .
P y
Y m
I n
9 w
7 g
Q t
3 h
6 A
- f
\195 F
\194 x
" M
E e
X q
2 a
O v
l C
1 N
y j
O v
K F
m k
p u
o E
/ s
W e
G -
Y J
L R
X b
, g
" I
P 9
Q n
$ x
U B
0
t

Non-zero for 12.8% of words.

Filter 3 (bias = -0.43) #

Q s
<BOS> x
X F
I f
" h
W c
P m
q S
r .
O g
^ L
Y A
R j
2 l
\195 t
H n
1 v
9 C
7 y
5
. T
b i
x t
? O
! o
F D
Q p
\$ I
: 1
Z P
8 ,
" C
a K
V l
q ;
9 z
' J
e H
( %
h 0
S a
j m
R f
Y w
Q p
O b
G n
D x
" U
\194 i
0 y
7 q
$ B
C v
M P
g d
T k
5 -
8 .
c z
x H
v A
9 g
W t
K F
o C
J m
0 y
6 j
p M
B r
8 .
z u
b n
" h
\194 U
X D
a Z
q s
2 L
5 -
c u
A P
w b
N r
K p
C d
/ m
n f
Z k
W h
, j
2 i
B e
\194 \195
0 J
z x
X v
Q H
4 y
y j
L -
c R
Z k
G J
p t
K E
m v
a u
d T
C I
/ r
8 e
x B
. S
U M
1 i
A b
D q
n \195
- h
E y
J c
I A
X F
2 .
O x
P n
w C
j f
z L
G m
W B
Q ,
e a
3 t
\195 U
0 N
6 u
9 s

Non-zero for 18.0% of words.

Filter 4 (bias = -0.60) #

<BOS> c
Y T
l a
\194 1
' U
V D
m y
- d
S k
X u
Q I
/ t
^ E
" 2
. H
<EOS> q
b \163
A
p
P
2 k
1 m
5 f
7 t
6 r
d B
4 M
3 T
8 u
I '
0 b
X R
! ;
G U
9 o
E v
W h
Z F
\$ Y
Q y
b c
Y w
Q o
q s
X n
l C
h O
" G
H i
B 5
\194 z
V y
r g
L 2
k K
T -
x 1
. 3
7 ,
a t
V d
Z l
w D
4 r
W p
n T
M o
5 P
C L
3 -
i u
k .
2 \163
B z
H \195
$ O
6 y
X a
9 v
b
C l
s p
R q
U e
u t
Z f
' o
" T
V B
Q J
$ a
8 L
c K
4 b
G v
Y m
k x
9 P
M w
3 \195
A M
z -
I j
a F
t f
U x
T h
B Z
w y
O '
E n
W 8
l u
i m
, c
k .
K 9
p V
2 6
_ 7
x j
S M
s k
G n
O t
o T
" H
8 m
L v
a w
Y -
Q J
y e
z I
h q
U P
W i
, B
K V
3 F

Non-zero for 18.7% of words.

Filter 5 (bias = -0.58) #

Q D
<BOS> z
" c
Y v
r U
W 0
N T
' d
h m
q C
^ J
\194 G
X g
S w
P
L
j
i
t
s
. k
L P
! f
A p
? F
& i
D V
l j
( ;
m R
/ S
a )
z 9
u 3
: J
d C
o 4
q r
w B
\194 7
s P
A p
S J
. -
F T
Q m
C M
5 r
\194 \195
a o
4 K
x f
h i
, v
t k
L b
/ y
7 e
$ O
q
O H
o h
z u
K F
G m
p A
E k
S Z
0 n
- V
J b
c .
w q
5 y
I M
P L
9 4
2 U
R B
\163 C
X u
Q -
I M
p m
7 U
q s
\194 E
6 g
, y
5 R
W j
a o
l J
2 f
/ k
8 h
C r
A w
T
G
. p
u y
U G
A P
B 1
t i
N x
w g
s O
R c
E d
a 3
I o
v 0
b 8
z 7
\194 5
Q K
L h
/ C
x t
b T
Q D
9 i
" y
8 m
V O
\194 g
B p
v H
7 l
W j
X d
' P
N o
. _
6 I
q -
Z A
$ M

Non-zero for 17.4% of words.

Filter 6 (bias = -0.57) #

<BOS> y
v h
J p
- g
w C
I i
X c
N G
\194 S
q m
. s
Q k
9 H
B x
E A
e 1
j U
\195 O
z Y
6 ,
c -
D k
G r
5 u
L b
K i
0 f
& H
8 ;
S P
z p
O m
6 q
o '
\194 I
/ n
( j
N \195
9 R
C w
V t
Y .
G f
Z n
X o
b a
k d
R x
P N
M w
Q ,
J -
" l
9 A
g q
7 s
T e
8 I
$ y
3 h
p u
z h
c H
k 4
C -
O j
P F
K e
G M
T 3
t 6
Q J
' E
m N
I 8
r L
A 9
l 7
a 5
U 1
K v
s T
/ q
O h
S c
M k
f d
L 0
Z p
m x
U g
Q b
, D
w u
C
\163
1
a
B
r
y -
W j
c R
1 r
w l
A '
a J
2 s
K k
Z P
L f
5 u
h b
8 S
H \195
4 I
q V
n Y
6 \194
3 F
t U
B G
T s
q y
\194 d
W P
X -
S z
j u
l Z
h p
H c
e 1
A R
v \195
Q C
N g
F L
k 8
M o

Non-zero for 19.4% of words.

Filter 7 (bias = -0.50) #

g x
G f
Y B
j v
O a
H b
Q K
- q
^ n
S F
I N
R p
o
k
9
,
L
m
e
c
l y
. d
N P
: p
w )
& U
X F
b k
o c
( u
/ i
J T
A C
\194 1
! D
Y s
L h
B \163
q H
n E
6 c
4 r
7 t
X p
5 o
J y
9 '
8 g
L C
3 k
V -
2 O
B .
F z
H m
Z n
E T
W w
\194 d
Y s
T .
i s
H N
m w
k g
Y E
P F
p n
y x
W A
v c
u S
M 5
B r
1 e
t j
U Z
h L
\194 -
X Q
Q m
" h
R x
O F
r n
I L
- A
T f
$ g
\194 i
X s
N V
\163 5
B
l
4
y
w
Z
C
, T
W g
/ D
K j
s c
i r
3 e
n v
U \163
5 b
f t
4 d
w E
6 .
$ F
o 0
h
q
k
p
s H
S L
t y
' 1
v Z
j N
k \195
c K
z q
F 3
x X
f h
g J
- Y
\194 r
C 8
E P
. n
V B
d A

Non-zero for 18.3% of words.

Filter 8 (bias = -0.68) #

F p
M a
C E
n g
/ i
<BOS> b
Z h
f T
\194 w
j z
5 \163
' r
D q
Q G
L -
N W
6 O
V o
, v
X u
Q M
A f
. j
: )
! i
a p
& v
( e
l c
q y
/ F
L m
N k
Y P
b -
X g
? T
I J
r G
\194 0
Q j
a f
W F
X S
U t
z h
" l
Z M
I s
P -
2 o
q e
K x
\195 n
b g
1 m
G u
8 J
Y D
\163 5
h k
L C
Y p
o c
l P
u '
H I
x t
N n
a F
A f
W j
. V
q g
3 w
J s
8 z
6 v
E r
4 M
T x
t 9
c J
M 3
m s
D -
y 5
k 7
g 6
H 8
r 2
F 4
A a
. R
C o
v \195
\163 1
e i
h n
j L
Q y
. T
X D
V U
Z o
n P
w p
$ f
' u
I d
\194 K
/ c
v
h
E
O
G
L
0
x
Q U
S c
l u
X z
q G
h M
7 m
\194 v
A D
W K
. y
x T
H o
I w
" Z
F P
J
C
k
0

Non-zero for 14.0% of words.

Filter 9 (bias = -0.37) #

<BOS> p
. P
- C
w k
W F
" i
Q f
\194 n
E ,
Y 1
X y
M c
^ U
N B
d
D
I
r
x
A
S u
Q -
K w
F H
p v
X h
G .
C q
P a
O i
V ?
8 n
5 g
" U
7 \195
, o
f d
; J
c A
6 T
w d
g f
A -
E l
G P
Z D
V u
k p
W ,
B x
z y
c o
b L
K F
Y n
M j
X 6
2 \194
U '
4 7
B .
K g
p F
o j
W s
k d
T L
O u
v D
P Z
i h
q -
J A
9 H
\195 C
, e
a c
z m
f S
N y
L v
U g
Q T
R w
/ t
8 e
, -
7 c
A k
C j
Z p
9 q
P m
K M
N i
3 E
s \163
Y h
l W
5 b
H x
T c
W s
t '
B f
i p
I -
A G
Y .
X g
q d
1 b
4 z
2 C
6 r
M y
E n
h m
3 o
N F
W C
K k
w j
O R
a n
E F
X u
L g
N c
Q v
2 '
y t
" D
/ V
. h
o r
3 P
e T
q d
0

Non-zero for 12.8% of words.

Filter 10 (bias = -0.53) #

L k
l w
X t
P c
7 v
Q s
d f
6 u
Y B
/ E
D M
8 o
p n
H T
^ S
1 R
G g
\194 i
Z C
'
C -
c e
A d
N E
R J
o j
B %
k m
, b
t P
& l
Y v
( 6
K u
r i
O f
Q L
/ 2
y !
n w
P c
I .
X h
J y
2 f
7 o
Q u
6 x
l s
1 t
p v
3 M
\195 '
V m
9 g
5 n
z F
i k
H N
0 w
R c
P v
r .
u g
H x
U w
\195 t
Q z
J A
3 0
" l
Y p
9 h
M e
I S
Z a
N 5
8 q
/ W
1 m
- k
o c
L g
l C
x t
" A
N w
/ T
Y z
\194 V
6 I
8 F
J B
9 U
f p
7 i
u v
d G
X E
Q j
t u
W -
I L
Q G
, m
q J
S g
N U
O Z
B b
X \195
" z
\194 s
p Y
F R
f l
e d
T D
k h
$ V
m R
y r
M N
V I
f E
' \195
g o
F O
x B
i T
Z J
n 9
p A
s a
6 z
C q
d Q
- U
. 0
j u

Non-zero for 18.0% of words.

Filter 11 (bias = -0.50) #

. f
A k
L P
g v
w p
Z d
G F
Y u
/ R
X i
<EOS> x
l T
z B
m t
W 9
O I
Q ,
K j
^ C
N '
C -
Q f
c w
\194 o
7 m
0 i
D u
X %
8 y
9 M
z e
) H
6 h
v s
V r
& O
B g
" E
5 j
d J
s r
S H
w D
z q
f h
m T
' u
x 1
W N
i P
V d
K \195
O y
- R
G A
o 7
\194 L
5 8
$ F
v \163
p b
y B
d v
O j
I J
1 M
P V
2 x
, k
Q m
a h
C Y
\163 l
D F
G f
/ u
U S
3 .
W L
r \194
D w
j x
d W
F k
T i
e p
L a
u K
H B
r n
P z
Q b
l o
E m
7 V
t v
I c
R f
M s
\194 G
V d
k L
Z D
n l
g O
w y
C o
M f
' E
Y a
R P
H U
b z
4 e
W p
$ s
X ,
9 t
Q K
q T
S A
x r
\194 g
" H
o q
O n
K .
W u
f I
s w
5 a
6 \195
, b
$ k
Y Z
8 T
' _
9 t
3 D
Q e

Non-zero for 20.5% of words.

Filter 12 (bias = -0.69) #

P .
p g
f u
K Z
O A
, w
B h
o -
r c
S H
k m
R L
i n
I s
<BOS> v
J b
9 d
3 V
T M
" D
Z -
X u
A i
n d
Q s
N P
. T
5 E
B t
! f
V p
8 U
7 m
9 %
( O
? ;
/ y
q j
x e
L k
R y
v p
\194 o
V m
Q n
9 f
Y O
" c
k K
b w
u g
7 L
s r
$ A
B e
U D
6 t
' M
8 .
J N
o H
c V
O h
K b
N m
D F
z x
T i
R k
w g
0 4
t 7
G X
M a
E 6
r l
B q
_ Y
J d
9 p
y v
p .
P j
U -
i \194
, q
O t
1 T
G l
C B
K 0
H b
3 J
2 e
a x
s u
Z N
I o
A D
r M
K d
w u
Z v
V T
5 D
S -
M R
f c
F z
n r
/ \163
X 0
4 q
A P
W U
, \195
3 h
m k
N o
L p
V U
j B
- T
g N
X o
x u
l t
7 K
' R
6 c
S r
m k
\194 a
4 A
. D
b O
5 y
Q z
$ _
F \195

Non-zero for 23.7% of words.

Filter 13 (bias = -0.61) #

R f
Q t
<BOS> y
\194 m
9 i
v K
7 e
- M
" w
Y ,
' O
V A
C F
d B
8 H
b S
z o
0 L
G E
Z p
; F
r s
K 5
P \$
m 4
O .
p d
\195 v
% x
Y j
y h
o c
T C
b )
M 7
k 6
G S
J g
R n
f \194
Y -
S I
G n
K q
L d
O r
o p
M e
" P
\194 u
c a
z w
5 H
m j
U k
/ f
y \195
W .
$ t
8 v
H f
y j
h s
Y l
1 t
" o
q S
Q J
g K
d B
W w
X z
8 F
Z ,
a n
\163 5
u -
7 e
G M
r v
H l
W v
i f
" x
Q L
I D
4 b
O .
Y J
3 m
$ B
1 c
2 j
E 0
y F
U o
S n
z
d
e
X k
l c
E C
L f
J '
e s
j n
6 U
7 t
2 o
H R
d B
1 v
4 u
G ,
g y
D x
5 N
3 .
0 m
t J
g -
C u
c o
A x
k f
S \195
V L
T P
w d
W 9
Q R
$ l
M N
' 8
X b
a
r
3
6

Non-zero for 20.5% of words.

Filter 14 (bias = -0.43) #

T x
J S
R y
<BOS> h
v F
u s
\195 n
b .
k ,
B A
P 5
r f
U C
z p
- g
E c
Y 4
M L
9 d
0 /
x m
8 -
F T
\$ p
9 P
7 i
Q M
S y
h O
4 g
6 t
5 r
\194 w
N ;
B o
( G
a D
. z
: k
b u
z -
K H
B j
Q u
w h
A d
W y
a g
S D
s P
N M
U i
/ e
O r
, p
\194 m
5 T
. 1
9 F
x J
L v
Z t
Q i
Y E
/ w
N s
X k
r -
8 e
K j
y g
R p
" d
H I
7 z
M T
9 f
$ \163
S
x
K l
M d
m h
X u
Z -
" s
Q j
W n
y I
B i
b A
f g
G t
V 1
O a
P C
w x
N H
k 7
e D
u p
- A
v g
o F
" V
R b
\194 k
9 l
T P
Y f
D m
M S
d C
$ r
W n
N e
U j
8 G
J i
1 a
o u
O H
p U
c F
K b
W k
G m
x j
\194 E
0 s
5 A
, L
" e
X h
Q Z
8 V
z J
$ M
/ g
N r

Non-zero for 13.9% of words.

Filter 15 (bias = -0.39) #

b t
V -
B y
9 .
X g
K d
Y c
J u
<BOS> o
P e
6 h
Z j
8 w
Q D
7 n
z r
R O
L H
U T
<EOS> M
N k
( v
/ g
! T
L j
? p
: )
n s
H b
Q G
. S
Z c
X z
A i
\$ V
& m
, x
2 t
q '
a E
E k
. C
h n
e P
d f
D U
O m
g V
l B
L '
S R
o Z
W i
q K
\163 M
0 F
" p
G ,
T s
X b
V d
Z T
M U
b z
Q t
Y a
' E
j D
X v
r u
n y
R p
7 O
F c
$ i
9 s
N \163
/ I
J 1
o
G B
s q
O N
d e
y b
z w
C H
p n
" A
U j
' J
S r
$ h
c F
P .
Q k
\194 t
Y v
, M
/ \195
q s
p u
X F
w U
K S
J h
o y
0 t
\195 M
z k
a m
N H
2 C
9 '
I j
n f
l i
b R
W "
x 4
Q g
W m
" j
x C
N i
9 t
8 D
q n
X M
a c
B u
\194 l
b T
K s
6 H
7 -
2 A
3 G
$ k
y

Non-zero for 14.8% of words.

Filter 16 (bias = -0.35) #

. v
<BOS> p
r x
t 0
' 1
A P
S 6
/ 9
Q B
s 2
g d
- J
j 8
M i
l 3
m a
N T
O 4
^ 7
K
Q g
9 m
N h
R p
I i
8 c
7 t
P j
& v
U w
( -
/ G
2 k
: x
X y
6 S
3 T
, .
" M
K e
D u
P g
F w
X b
Q h
O .
K A
6 -
8 k
e m
p a
5 U
7 Y
f s
, i
d n
2 H
j z
S x
0 v
U e
m q
z j
Y x
G -
s v
/ d
K p
y I
L F
Z 7
A J
M 2
' 0
C 9
$ N
O E
V h
n
r
U g
y j
P -
, x
D v
K b
O V
d h
Q w
C l
r J
T .
I Y
/ 0
u 5
a S
" 4
R e
f q
F n
" z
Q p
h c
H v
Y d
W 0
M P
$ I
y D
X C
N l
\194 n
. J
S w
i
t
g
G
_
T
x -
B g
p j
a u
f M
P T
K t
9 .
, D
8 E
b m
n Y
F G
q H
6 w
7 O
N s
k o
Q e
2 c

Non-zero for 14.1% of words.

Filter 17 (bias = -0.41) #

Y z
H I
h c
X t
V w
M U
4 r
6 v
L s
Z k
m a
7 p
W R
\194 f
" o
^ E
8 P
y d
Q \195
/ B
D b
T x
d f
1 r
t m
C .
c B
I a
0 k
2 !
O %
\194 q
) ?
5 \195
& l
6 N
G V
4 n
E :
i h
G u
w h
z t
g N
p F
V T
Z H
m q
K r
i D
5 B
s R
2 f
X .
- "
C e
J d
n \194
c v
P A
E c
I C
N m
e '
q g
2 k
X y
J G
a s
l n
Q M
H v
W U
6 z
7 V
L p
B u
3 Z
A -
4 R
Q u
X i
S U
" n
8 H
E k
O T
G t
7 v
\194 1
e m
$ C
x -
F d
. _
b y
V w
W a
h
B
x t
b O
Y y
9 E
\194 s
7 w
q i
X M
v U
V f
l T
L p
6 I
B c
8 e
h r
. g
Q S
a P
0 -
s r
S T
x M
t H
' Z
C \195
\194 K
, X
f y
d b
n L
i J
v N
5 P
- q
I D
l Y
j B
F m
z G

Non-zero for 18.7% of words.

Filter 18 (bias = -0.56) #

Z h
G l
w u
V q
M d
Q x
<BOS> f
g v
c r
X p
K a
z o
W P
^ H
s B
E -
/ T
C i
5 t
<EOS> \195
d i
D k
u B
c t
8 p
s ;
) w
G l
. W
U A
? H
E m
- q
" I
L ,
9 n
R V
Z f
F K
0 Y
m -
T s
c j
z i
X 3
A 4
b E
D f
K J
Q u
G x
Z S
. 5
y 2
C e
U o
Y 9
k I
B h
/ 7
W p
B P
t y
\194 r
E d
4 m
X -
5 f
T x
w l
2 L
M b
S U
6 s
N u
Q \195
I '
$ n
v G
9 g
x T
8 t
n u
9 D
W -
5 j
Z l
V d
4 m
3 U
K E
7 I
a M
N z
Q J
6 P
b H
X O
2 v
B _
p D
P L
k c
r n
Q .
b M
" h
I A
E u
f y
R m
O Z
\163 H
' C
S o
V g
W /
x 1
X 0
a 5
g v
L T
y R
h t
G B
A u
x k
4 o
m D
S J
Z I
s N
V -
. 9
5 r
H \195
F \194
p 0
a q
3 z

Non-zero for 19.0% of words.

Filter 19 (bias = -0.68) #

W j
<BOS> g
Q p
\194 e
B G
N E
/ F
q d
n l
" L
^ P
w f
X s
I -
C J
h
S
x
m
y
z u
l H
p M
G ?
O h
S y
& Z
C e
c m
0 F
o -
\194 )
Q n
I 4
K f
t q
5 w
, N
P U
Y \$
C v
/ b
M x
5 d
K a
S u
O q
n -
, .
Z h
3 \163
A p
N e
I m
4 E
$ k
G T
t f
j \195
"
E v
G m
g f
O d
3 \194
r l
w t
2 D
4 x
A '
H n
R .
W F
Y C
1 c
S B
N T
Z /
I 6
i q
r c
H x
P s
I v
j z
l g
J G
T .
t C
X w
N U
e a
O d
\195 Z
M y
q '
Q n
R 0
B 8
f u
V T
7 y
4 D
9 t
6 c
\194 r
5 O
n p
x m
Z d
3 \163
$ e
Q U
Y o
' E
8 P
- _
X K
R A
s z
T x
t s
D E
H S
d f
u G
v K
\194 b
q 3
m 9
C O
l p
. w
M 8
n J
/ 5
c r
A 4
I F
1 2

Non-zero for 20.8% of words.

Filter 20 (bias = -0.44) #

7 U
j f
g m
0 y
V t
5 w
G B
C u
l K
4 T
1 W
X v
J M
6 a
8 o
Y k
9 s
3 N
Q O
R ,
f z
y R
m 0
F v
M J
\$ I
h G
S -
L \195
. g
H T
: )
/ 1
W c
e 9
, d
x D
! C
? u
( 2
Z v
r x
M t
R p
Q h
H d
/ a
N c
P i
\195 S
L s
X W
K z
J 0
U T
Y k
$ q
n \194
m E
B
k .
M l
f A
i L
U g
R d
B q
K D
' a
V e
C E
P z
, \163
" -
s I
u X
m j
y 0
W b
3 r
d B
I o
7 T
- A
2 h
P m
6 b
1 t
Q N
4 .
j K
3 v
C k
8 c
5 L
X a
V Y
Z y
9 r
$ x
y k
L j
K v
X -
W R
Q t
/ C
Z g
" n
8 u
m I
O i
N s
a J
6 '
. 0
G c
3 T
H r
U z
x D
b y
Y M
V 1
k c
l e
v N
B n
h O
\194 2
S w
a u
' d
Q Z
" I
W E
q H
z t
p -
X o

Non-zero for 13.4% of words.

Filter 21 (bias = -0.55) #

<BOS> y
b h
z t
Q H
V u
P M
R D
G c
X T
J F
\195 n
p e
<EOS> 1
Y i
9 .
l m
K A
' d
" j
7 N
U j
? l
Z F
! f
W e
Q h
" x
& S
y J
w p
z t
K -
G d
a i
c v
/ 0
) 5
Y \$
( D
u g
K g
f d
M h
N T
w C
m D
W u
/ v
B 0