This page shows visualizations of some width-6 1-d convolutional filters from Google's lm_1b language model. Each column corresponds to one position in the filter, and shows the characters with the most positive weights. Use the checkbox in the bottom-right to also see the most negative weights (may be slow).

Below that are examples of words for which the filter emits the highest values. A filter's response is its maximum value over all substrings it sees in the word. So if a filter has high weights on 'c' in the first position, then 'a', then 't', it will assign equally high scores to 'cat', 'fatcat', 'concatenate', etc. The portion of the string in blue is the substring the filter is responding to.

'^' and '$' represent beginning and end of word markers, respectively. '_' is a padding character. Literal versions of those characters are escaped with a backslash.

Use the links at the top to see filters of other widths.

Check out my blog post here for a bit more context.

Filter 0 (bias = -0.61) #

5 -
K h
C .
B u
, m
I g
2 r
9 y
S b
3 d
F q
6 v
4 T
U o
s H
8 Y
7 '
z \163
A x
Z p
Q j
! v
Y t
? D
: e
& T
Z d
b f
V -
" p
A J
U o
( 0
. i
a P
R F
/ M
G c
' l
X n
v g
B G
f y
N Y
9 i
n m
x O
\194 H
F p
q h
6 S
I r
8 T
a E
. A
, V
R M
d 1
J j
5 \163
u x
H p
T f
D .
- S
J m
R A
E a
M c
j l
1 K
I b
d s
2 n
U '
3 z
\195 ,
9 w
P C
r V
f g
, c
/ u
l T
K v
L -
Q E
X G
S D
F 0
x r
B d
\194 \163
6 R
5 k
W z
m w
N 1
$ j
h
b d
Y D
B U
h P
V C
k y
W t
x z
N m
r s
q p
9 l
" L
S I
E ,
R c
Q n
4 /
X u
J 1

Non-zero for 13.3% of words.

Filter 1 (bias = -0.43) #

<BOS> x
w p
r h
. d
N l
Q i
M s
Z L
n f
I S
q P
X 6
t a
- v
/ F
R 5
' y
^ ,
0
G
S u
x U
l r
Y n
W k
5 R
G D
: )
p T
\194 M
h P
O H
X ?
6 Z
7 \195
4 C
V I
% N
o t
g c
W o
X -
6 r
Q g
4 m
E c
F p
2 n
B y
\194 G
e R
7 u
8 l
" C
5 z
9 \195
V '
q O
S P
3 D
A f
a M
g o
H F
i -
Y D
I m
W '
V c
1 j
2 .
k N
4 y
w e
q v
G u
b t
X d
z K
E n
v p
B r
T e
u O
Y -
c I
U f
\194 P
M E
k S
m j
C 2
D d
Z 3
h \163
V F
z i
0 g
R s
A Q
Q A
" p
\194 g
- h
$ i
u c
' n
X y
R w
d B
f
o
x
K
k
r
a
_
F
G

Non-zero for 16.5% of words.

Filter 2 (bias = -0.42) #

<BOS> U
S u
f w
F Z
Q H
j z
O g
p a
x A
\194 m
' 1
" i
e \195
, L
N G
l T
t v
X k
r b
o y
Z -
2 h
5 p
X m
Q u
K o
8 k
6 r
A '
N g
L f
4 v
9 T
I i
7 j
3 t
& y
B l
w x
/ d
W n
T R
X -
m j
v C
K u
E r
" s
z J
w F
\163 7
O h
t 9
y o
B N
p f
e l
Q 3
q '
a \195
Y B
' f
C e
Q E
\194 y
- F
V N
G a
$ U
g w
R u
l K
7 h
z L
X H
A
_
q
M
t
R D
Q d
k l
Y m
b t
V -
" e
r p
C T
h f
9 P
' i
x j
Z L
8 J
A o
S y
N v
$ M
B O
u f
H p
A x
U S
T '
D Q
h \194
g X
1 P
R "
_ V
Z F
\195 6
N l
L ,
w
r
E
B
c

Non-zero for 24.5% of words.

Filter 3 (bias = -0.60) #

U g
s h
F p
<BOS> q
f w
Q G
, o
R 0
C T
/ c
' v
P b
S Y
I -
\194 i
" 1
u e
x
J
W
Y F
W j
z )
K e
a d
! D
w C
m f
l \$
o c
A E
: s
& u
/ k
% S
L P
X R
O 4
B M
b g
7 m
E n
8 c
4 w
6 .
3 p
Q f
2 o
9 k
5 t
1 -
" '
X v
F z
H g
S y
I l
0 b
e C
W M
\194 p
H f
u y
Y c
6 r
9 O
4 P
7 m
W K
$ G
X g
V o
Q z
" t
R e
8 F
v s
q \163
Z S
J x
d w
D K
7 W
F o
j i
8 O
h f
0 t
\194 I
L N
6 B
x a
C k
G r
c ,
g n
v p
V m
9 A
4 \195
r L
k 6
I M
p 5
t 4
g Z
b 8
Q 3
R 1
' K
\163 D
A J
q W
P 9
. y
a 0
j o
- m
C Y
E u

Non-zero for 19.3% of words.

Filter 4 (bias = -0.44) #

. p
Z P
M d
n O
N T
h z
w I
H G
A r
B D
V l
/ i
W \163
4 E
\194 -
<EOS> J
u 0
L \195
m o
F j
I m
Q .
; f
X s
r F
R v
P c
Y j
1 t
W x
2 M
\195 e
3 u
p h
9 L
7 D
q d
H S
O -
: g
K c
I g
J v
l h
L u
5 y
X .
B T
, -
/ d
6 k
3 '
2 \163
7 t
A m
P "
n r
9 x
N e
Z s
u m
R p
Q t
U v
8 T
9 g
N w
7 i
" k
3 l
s c
r z
d j
F M
Z B
H o
L V
I G
2 K
1 0
- C
J p
E y
w c
M ,
e k
N U
b A
j d
X t
. i
\195 s
9 P
Z h
v a
q F
o S
u 1
W n
" D
c H
x i
' l
C T
f t
8 I
F J
Q A
s j
" h
Z Y
. u
9 1
G E
b L
K q
y -
n D
V e
k \195

Non-zero for 19.5% of words.

Filter 5 (bias = -0.43) #

<BOS> d
b D
V o
Q t
B y
k -
" p
X i
Y 1
Z n
9 g
W c
\194 O
U j
R l
' h
K u
^ I
<EOS> T
x H
D f
& p
L k
d i
Q w
\194 x
! j
U e
. S
( F
Y -
/ n
u s
T g
z J
X M
A b
: r
" E
? V
A -
B d
S e
k D
Q 1
s g
U u
z v
C y
, j
R 2
K 0
' J
l p
/ E
V q
Y h
t H
b \163
\194 6
P x
d h
- S
D o
I B
Z A
1 Y
j b
J W
2 a
n k
7 .
6 t
H c
X O
C N
u s
M K
\195 w
3 v
n -
C E
D b
/ g
, r
B e
K \163
c p
L G
A "
N s
t k
5 j
M u
o d
\194 w
F x
y J
Z V
1 Q
Q f
r v
Y d
X s
R p
H x
" m
N i
7 z
$ c
V w
Z o
A t
b -
q y
U
n
,
a
u

Non-zero for 13.2% of words.

Filter 6 (bias = -0.40) #

7 y
9 t
J f
<BOS> w
6 m
V A
R .
0 o
\194 h
8 r
X a
Q N
Y p
j c
P O
4 e
Z q
G n
5 K
2 ,
W l
w L
u F
? b
v %
c j
- P
" f
1 r
) A
2 p
M x
i m
U S
o e
3 J
y .
( \195
4 D
T :
Y w
l E
S e
h Z
i N
C 2
\194 .
t q
o a
k U
' K
p \163
j M
V 8
g \195
x X
R F
T u
, 9
s I
w d
B p
N l
U g
K j
R S
\195 D
J F
u h
9 C
W c
E m
a x
Z y
q G
I '
2 t
r \194
3 s
o 7
Q P
\194 p
" T
Y m
W k
N D
$ t
o e
x j
S g
/ d
8 F
9 i
. v
7 U
z
_
c
r
f
r v
P -
Q g
f w
R E
K t
N T
, d
B c
b D
F j
y e
/ 0
Y z
k u
L .
H 2
A \163
\195 s
8 G

Non-zero for 20.6% of words.

Filter 7 (bias = -0.65) #

8 k
7 t
6 f
Z i
\194 E
9 p
n r
D O
d T
1 m
. S
X s
5 w
0 B
/ U
Q b
L P
C z
4 e
2 K
k -
h n
Y D
b w
S o
R d
A K
V p
U M
B f
s c
H /
u m
" e
a !
x O
F y
E .
Q J
4 P
w -
W u
K x
O h
c j
z R
E f
A k
X b
G J
Q P
2 l
/ r
Z F
t d
y v
N n
. '
T i
$ p
j x
M p
T c
J a
l C
D s
Y y
H n
t k
X g
e d
L z
E w
- U
\194 '
N G
u .
O 8
R \163
/ b
k p
u x
R e
H G
C E
t L
Y d
U f
' K
T 5
$ 0
\194 l
n o
I O
B 2
Q P
M J
A y
/ \163
V 6
x u
f D
b H
V d
k T
B g
' 1
K -
Q E
S t
p y
F h
" A
9 I
\194 2
X i
P _
, w
8 e
v j

Non-zero for 19.8% of words.

Filter 8 (bias = -0.59) #

v y
<BOS> L
\194 m
V O
9 l
c o
Q f
C K
0 P
k r
7 p
' U
g H
" ,
4 A
x i
8 \195
6 /
. D
Z T
G u
p H
O h
c B
P k
D t
z .
d n
K A
8 b
0 q
y -
Q w
2 j
X m
1 f
\163 N
" M
C i
6 l
G h
K v
z k
L u
Z t
X j
U -
Q q
O n
/ f
E i
2 H
w x
A T
m F
5 R
r
'
o
d
M p
o k
t a
\194 P
/ r
N g
m b
j C
K d
X x
. U
W G
$ 1
D s
T R
l \163
L i
w h
- z
e A
h -
H v
Y f
A z
i j
y c
r D
k .
W s
a M
q e
1 d
p w
T J
3 F
4 0
" '
Q n
, m
g K
g U
j y
l K
V f
. u
b o
X N
S P
v ,
e R
E n
\194 B
- r
Y M
q C
w D
Q \195
t 1
G /
7 9

Non-zero for 18.3% of words.

Filter 9 (bias = -0.43) #

M g
<BOS> p
m d
Y c
K x
Q v
/ 0
U a
" n
Z I
X 1
L q
V w
^ h
B i
R 2
' t
\194 \163
C
e
R y
V D
b T
w d
n h
- p
' t
Z 1
s c
k e
J O
r \163
g H
I W
! L
z m
Q v
\195 ,
. P
& 6
A -
Q u
. i
r f
C J
c v
X M
a m
l o
/ s
I k
L w
q j
N U
g 3
D P
7 E
t e
z 6
4
m d
b c
r v
A 0
l 1
B D
L G
. 2
H s
N p
M E
/ C
X 5
Y z
Z 8
V g
f \163
\195 4
Q 6
q i
W j
y l
U f
" -
Y F
1 t
T .
G n
8 S
Z e
X s
H o
a J
Q r
2 N
k L
c I
\163 '
3 x
9 5
S p
Y w
h g
8 -
" I
9 n
\194 .
4 r
M a
6 d
B z
L q
3 t
R m
F P
x A
5 k
u \163
7 c
N i

Non-zero for 20.2% of words.

Filter 10 (bias = -0.52) #

. i
g B
c f
Z o
Q J
G l
X k
e ,
\163 P
D R
y u
E x
" v
M U
w p
F \195
r K
^ a
8 Y
t
u p
U f
s m
R o
) K
C l
Q w
( x
& b
4 n
" r
\194 e
7 y
H %
E q
I -
Y P
8 J
S M
9 .
Y c
l C
h r
S n
i k
W .
L F
6 t
x w
4 v
X D
3 '
5 U
7 f
H d
\194 Z
J \163
o u
O g
V e
u p
M l
H S
D x
U G
T g
N i
Z z
y s
. V
" 5
q O
v j
Q b
B o
R A
t Y
c J
d f
/ P
O v
K .
p u
P t
3 c
Q D
, T
r g
X A
W d
" h
i m
G j
R F
8 b
Y l
9 L
7 q
2 z
1 e
m u
X R
V o
L r
l N
Q E
6 t
Z k
\194 T
p I
b w
/ B
x U
' _
$ A
G h
P c
. O
\195
J

Non-zero for 16.3% of words.

Filter 11 (bias = -0.47) #

I g
, m
Q M
P -
9 b
C h
8 .
7 w
6 j
1 u
2 e
5 E
\194 G
/ v
d T
K H
p k
a y
3 Y
R V
v i
. p
\194 h
- A
M k
X H
? P
" %
w r
Q U
W a
( g
N C
& y
c s
D 1
e F
/ l
' ,
! S
K -
f T
x u
Z j
L g
8 t
F v
, d
5 H
B i
/ h
Q r
N D
U J
s q
C k
9 I
a E
S l
A Y
T -
K x
r d
c u
A s
B h
t i
N v
M l
O 6
k '
Q \194
E f
D n
X a
C 7
F .
G o
Z 4
w m
H S
n z
1 t
Z s
h O
3 v
4 E
u l
7 o
8 f
C .
9 -
y '
q e
2 c
6 G
A j
i T
L \194
N m
X A
Q l
9 s
" t
8 i
W U
6 z
M g
Z o
N u
\194 m
7 p
V a
q C
v y
4 h
e _
2 d
$ O
b L

Non-zero for 19.3% of words.

Filter 12 (bias = -0.50) #

y E
h w
x J
Y I
" z
W -
\194 j
o U
, <BOS>
8 s
/ k
p \195
S R
6 b
c u
1 e
X g
7 P
L r
Q v
u A
- a
D w
M x
R p
j g
" b
d h
\194 B
T i
P n
Q l
) z
v K
J W
' q
; .
9 L
8 !
( %
7 -
5 f
C m
6 r
4 O
0 y
8 o
A p
\194 P
h w
1 U
9 E
V u
n K
X k
Z s
L '
F M
D \195
2 e
- h
Z t
w D
V T
' A
M p
m d
b F
. y
$ ,
J a
X 1
Q S
Y l
R H
" L
n P
c
i
O
X u
L -
K k
Q g
p j
d M
a h
, R
/ r
6 w
P H
l i
8 J
z v
D s
5 E
7 t
O T
\194 '
2 b
E n
" l
O a
G d
S A
M m
Q p
K H
W i
T L
9 .
8 q
R C
Y h
c -
N I
e x
3 ,
$ P
\163 f

Non-zero for 11.4% of words.

Filter 13 (bias = -0.46) #

Y d
K F
W D
<BOS> n
M j
O p
" -
X e
o P
B u
V I
Q s
<EOS> .
G g
^ f
\194 a
S C
t
c
\163
I h
d m
P B
Q M
C S
! L
p b
1 f
7 E
R %
- e
n x
2 A
r v
' T
8 t
? F
9 w
& o
X l
u p
\194 f
D y
R b
J P
Y r
- k
j m
0 K
o a
l e
5 \163
7 F
9 x
1 w
v O
6 W
C Q
n E
H q
n g
f G
, z
B T
N c
M E
H \163
F v
/ d
K p
3 .
9 b
Z D
i 0
U e
R O
C -
4 q
u l
5 r
b p
B g
u c
" t
v C
Y O
9 D
V G
\194 d
W A
Q y
x I
X z
q i
M o
R S
J j
k 1
Z l
8 n
S L
C m
Q f
s d
k e
Y u
R .
V D
G q
$ v
O -
' y
g J
" l
I n
b
\195
a
N
x

Non-zero for 14.4% of words.

Filter 14 (bias = -0.42) #

N p
W m
Q g
" z
q C
X d
E s
K v
O l
<BOS> -
3 k
8 j
H P
2 i
B '
9 c
/ G
e V
r n
4 U
x T
. P
5 H
\$ r
9 U
8 u
N D
6 k
W m
\194 t
f ;
4 i
S y
w p
( R
: O
n \195
! Y
7 g
Q M
L p
Z h
J k
5 y
6 T
z r
/ t
w c
9 q
s g
K i
2 \163
l H
n "
X O
U Y
7 v
. x
3 W
N '
B -
A j
W g
a '
N J
y R
E n
K V
q C
L i
Q p
U G
T P
, l
F s
t m
h u
" d
X r
H k
I M
S u
O -
, m
Q j
A e
z f
W b
a v
t J
s F
\194 Z
$ r
h
y
g
D
n
c
.
G u
c f
p -
X n
Q B
g H
0 h
O N
z l
\163 o
C s
" t
8 U
2 J
D R
7 m
V i
W L
1 .
Z F

Non-zero for 17.6% of words.

Filter 15 (bias = -0.68) #

w p
W F
<BOS> P
E f
I x
z d
Q D
. h
^ y
U j
2 l
O r
C
L
c
0
n
8
7
b
Y m
R f
" F
Q L
r s
9 U
G A
? t
7 n
0 %
O w
8 l
o .
q ,
; y
\194 a
X B
T e
W i
( K
M x
W p
E l
O A
K h
3 b
w g
- .
2 F
" a
u k
J C
Z c
$ n
U r
X q
T f
6 d
1 S
/ t
y k
D w
F i
d R
8 b
L -
M Y
e l
6 g
" A
P z
c B
K v
X J
f n
Q I
Z \195
\163 a
/ V
2 o
G t
. H
b i
- k
Q T
L I
x B
' u
m A
X h
" 1
l q
Z ,
K a
z U
/ n
o 2
8 C
Y 4
\194 w
x j
a P
. r
v O
q M
W T
h J
8 m
c G
\194 i
n p
9 l
6 R
B g
N t
d S
5 -
4 k
2 I
7 E

Non-zero for 15.7% of words.

Filter 16 (bias = -0.33) #

F -
h z
H w
6 o
7 s
X U
\194 \195
8 r
4 O
D R
Q J
q <EOS>
" G
5 E
C K
1 a
M u
V m
j I
T b
? k
! p
. f
d i
( B
Q m
- C
: t
E S
" l
u P
2 j
8 V
W K
& F
\$ r
X n
6 %
D T
q ;
C g
n b
, x
I E
/ G
P h
t -
H .
F v
f Y
M o
U z
D S
K \163
1 e
B r
Z w
y 0
i J
6 s
o j
K F
N -
O i
z H
c e
a V
W f
A m
B d
Q P
G M
" g
Y u
. k
y s
r J
U 4
/ n
8 t
H x
M c
W v
2 p
w b
X k
Z r
4 f
3 h
I a
i .
E o
/ d
$ C
6 F
1 B
O '
5 l
R
q
X U
7 f
4 m
6 o
V c
W y
2 t
Q s
5 z
j u
Y K
8 r
3 B
\194 k
H A
q C
1 _
g R
9 n
" ,

Non-zero for 13.0% of words.

Filter 17 (bias = -0.66) #

p u
P .
K -
X t
Q g
8 v
y A
O w
6 h
" l
2 s
3 j
7 n
W k
G m
1 R
, o
9 b
5 z
4 T
t G
v !
T g
M z
e A
f r
j Z
D ?
\194 R
F C
d a
6 b
u U
W \195
h V
m s
- Q
H n
q &
l w
T -
X g
Q w
Y n
\194 s
B o
H r
t J
A f
W x
/ j
L u
m R
" E
l c
$ G
D p
, e
6 \195
3
R y
j m
Q f
E K
7 o
u L
- p
9 w
" a
V x
I A
r ,
k n
J l
Y .
g B
$ t
8 /
\194 W
4 c
- A
" c
E C
9 m
7 y
Q n
J t
6 p
\194 k
j U
8 K
X z
e i
v g
u w
4 ,
d B
3 a
2 _
R f
n E
r T
. t
Z S
R e
- W
\195 v
C F
b i
' h
/ 4
z j
A M
Q O
l 6
L B
a 2
g f
V 5
m D

Non-zero for 20.5% of words.

Filter 18 (bias = -0.60) #

G k
Q B
<BOS> f
z h
. i
O F
X H
/ t
" u
^ v
\194 T
Z q
n
x
b
p
j
r
P
e
j w
D a
F W
d m
7 k
0 B
5 b
S i
8 p
6 q
) A
C K
\$ U
e y
4 ;
\194 !
9 ?
J z
M o
c \195
Q -
X n
W o
S u
" .
E c
Y v
4 w
V f
H m
7 g
6 d
B J
2 '
F j
8 \195
A r
T x
$ M
l
O u
K F
p h
G .
T s
X L
W H
o A
z a
w U
M d
0 n
Y x
J y
c f
v 4
V N
" C
$ 8
P R
D x
O V
T h
U b
r i
R f
I g
Q 4
z v
t k
/ n
d w
N F
P j
u m
\195 5
o p
A 6
" S
L W
- B
g o
d t
Z K
2 N
E T
V f
4 ,
w A
G l
e S
X O
7 R
6 k
. r
1 c
\163 C
Q L
u D
j h

Non-zero for 15.2% of words.

Filter 19 (bias = -0.50) #

\194 r
Y a
X U
6 f
<BOS> A
7 s
W w
V .
" y
4 z
^ c
Q E
9 b
5 p
8 g
M m
H \195
0 L
1 F
o
I M
p m
r L
d B
O f
R Z
Q J
\163 K
s n
E V
a l
P X
z 6
g F
C j
G v
" b
k .
U /
1 w
X r
D x
m S
Z h
L o
d k
6 R
P f
M s
U N
/ c
2 '
H g
z O
T t
J p
1 C
l B
\194 F
V n
J y
j p
X s
5 U
6 d
4 c
B z
M O
Z '
V r
7 u
H a
9 k
N P
e o
0 -
2 m
L \163
3 G
n "
d k
- B
D r
/ f
\194 b
1 F
Z x
$ N
X S
6 E
m R
G h
. a
A
e
K
p
q
s
\195
s T
V t
C e
7 f
Y M
Q o
A -
x p
8 m
Z O
4 w
R v
S y
G D
9 P
5 K
U r
L q
\194 j
a J

Non-zero for 20.7% of words.

Filter 20 (bias = -0.53) #

<BOS> h
Q x
X y
I c
V g
\194 .
^ o
" f
R m
7 d
Y u
/ v
e
L
p
a
A
-
D
b
E C
e k
O n
f V
% Y
S Z
j )
- c
o H
\$ R
l ?
K h
J '
t u
F A
w U
\163 1
s !
2 B
N \194
Q u
c -
p J
W j
X o
z R
a f
A M
k h
C 3
. L
V H
" l
\163 9
b N
G e
w D
' i
m \195
K E
Y c
H v
- D
r d
R x
V 0
Q y
J F
l 8
I z
X \163
$ C
\195 p
i 5
/ G
a
e
E
h
s
X f
\194 m
Q g
6 r
" k
W n
7 y
9 h
2 A
8 F
I s
$ c
d p
D x
0 w
v .
1 b
t
C
i
D S
Z f
C x
c s
A -
U j
n E
1 e
T O
z i
H o
0 '
L h
q p
\195 F
I "
B l
a W
X b
/

Non-zero for 24.3% of words.

Filter 21 (bias = -0.44) #

A T
l v
N m
n P
S p
/ e
. y
, d
o E
5 M
C -
<EOS> \163
L u
<BOS> k
R G
\194 b
Q D
I U
7 g
a i
y j
K g
1 S
8 -
D t
P .
U s
6 l
Z E
9 b
X e
2 k
W r
3 F
/ A
, h
c w
d '
" \$
C f
7 w
V t
x .
j y
J m
b o
9 c
6 U
F u
4 O
8 N
0 M
S /
Y -
P T
5 n
h W
l A
3 K
G z
R d
Y p
N e
o P
k F
B D
r l
" f
M L
Q j
$ 6
' x
W 2
w y
K \163
9 m
V E
Z a
\194 -
/ i
u g
- p
R c
" A
N F
o C
Q G
\195 S
U k
/ i
\194 5
$ V
r j
. t
Y 0
9 x
' h
J e
M 4
w
f T
n E
Z g
V t
K h
/ u
' D
M d
X A
m \163
x c
F z
9 v
6 a
Q O
8 r
5 _
, I
P 0
$ H

Non-zero for 16.0% of words.

Filter 22 (bias = -0.51) #

<BOS> p
N m
Q i
R g
" l
\194 L
- s
9 A
' F
o G
r P
q z
^ E
/ e
. U
W f
X S
x
y
h
G f
z h
E k
c i
D x
& B
g m
O H
Q n
? F
! ,
Z t
. u
2 ;
0 l
\163 '
w v
X M
( p
d b
p F
d b
i M
O N
l Z
z f
1 .
T V
D B
o j
, r
t e
y k
I 9
a R
P x
G Q
A '
Y n
W 8
X R
W U
Q l
2 z
y u
6 s
e J
M o
" b
4 \195
q L
Z B
8 r
$ Y
c A
F k
\194 a
7 _
5 G
1 E
O x
I h
$ F
Q f
W b
Y .
z n
\194 c
i y
B
q
L
v
r
a
m
N
e
A
k
G f
c l
V -
g a
Z d
0 n
M x
Y .
C ,
T q
k p
E o
z y
R u
9 L
S H
" t
X i
4 I
j h

Non-zero for 27.1% of words.

Filter 23 (bias = -0.49) #

<BOS> x
W p
I r
w f
H h
U c
Q l
^ F
u o
\194 L
2 y
i b
Z G
g
D
P
e
j
0
d
L u
x g
K T
% c
l t
b ?
6 H
5 -
B r
z k
S y
X h
: C
a M
f n
Q D
s j
8 R
9 1
J q
k l
" d
h I
R p
S D
c n
Y L
r P
b -
u t
s /
E z
M X
x i
' J
y 6
U ,
F 1
8 m
V 2
7 k
g B
- f
5 m
1 U
G T
0 t
d b
8 K
n P
6 F
C v
4 M
3 E
j a
\194 e
9 w
. y
D u
Y r
X u
F s
K U
M -
N z
8 d
j a
e i
9 w
B t
7 I
Q .
f g
J v
5 A
6 k
b m
V '
r C
0 n
Q n
O H
" u
S i
' h
K a
G 1
r w
$ q
M A
X 2
P 4
\194 v
f d
Y -
c J
R g
x
I
3

Non-zero for 24.3% of words.

Filter 24 (bias = -0.48) #

. p
Q k
<BOS> P
/ i
L J
\194 0
X v
^ G
A c
l T
" z
H R
m E
g
1
o
C
w
j
2
n p
4 z
9 l
Z T
8 m
N %
( P
M O
3 t
7 b
5 ;
C a
? G
F E
6 d
H \163
\$ U
) r
1 A
R \195
V d
k y
i p
M x
Z .
j o
w D
H a
J f
B c
4 \163
Y r
C O
A q
R L
g "
I P
n -