This page shows visualizations of some width-4 1-d convolutional filters from Google's lm_1b language model. Each column corresponds to one position in the filter, and shows the characters with the most positive weights. Use the checkbox in the bottom-right to also see the most negative weights (may be slow).

Below that are examples of words for which the filter emits the highest values. A filter's response is its maximum value over all substrings it sees in the word. So if a filter has high weights on 'c' in the first position, then 'a', then 't', it will assign equally high scores to 'cat', 'fatcat', 'concatenate', etc. The portion of the string in blue is the substring the filter is responding to.

'^' and '$' represent beginning and end of word markers, respectively. '_' is a padding character. Literal versions of those characters are escaped with a backslash.

Use the links at the top to see filters of other widths.

Check out my blog post here for a bit more context.

Filter 0 (bias = -0.47) #

Z l
M r
8 -
c a
C t
5 p
6 i
X k
K b
F I
/ T
Q u
4 q
9 \195
V E
y A
G h
7 o
" z
\194 v
E y
R m
- p
j K
r n
Q L
I f
J ,
b c
9 i
u /
" C
( o
e A
7 M
\195 h
v D
s l
g x
k %
W j
B -
a g
K d
A G
Q D
w 0
, J
N v
/ c
U l
X p
H u
q o
I R
Z h
r
T
P
e
Z p
N z
Q t
M l
8 v
R m
9 i
" a
r k
3 x
7 T
X s
H f
$ d
4 B
/ A
- U
c
,
P

Non-zero for 19.0% of words.

Filter 1 (bias = -0.50) #

<BOS> h
w T
K t
Z D
E d
X H
W C
Q u
2 y
V l
9 g
<EOS> c
J A
b p
M r
6 k
3 i
5 1
" Y
f j
F z
x g
h G
f p
S c
\$ w
B -
4 T
N I
6 D
\194 O
8 r
: P
" \195
9 d
( !
H U
7 C
W m
, 0
Q m
R x
C a
r h
j L
I B
' i
" y
$ l
7 o
F f
- p
S w
K
W
v
A
q
b
H
l k
L U
7 T
X v
5 B
6 u
n s
. f
j c
/ t
D y
Z m
4 E
\194 z
8 R
1 b
d i
Q r
2 w
H p

Non-zero for 14.1% of words.

Filter 2 (bias = -0.71) #

Z l
8 -
9 d
Q t
3 m
N v
K j
C p
4 f
W .
7 e
2 g
1 T
X u
" b
5 z
V s
R x
6 i
B o
f g
; G
' 0
- 1
r L
t h
k D
" 5
Q A
M c
R d
N )
: 4
m 2
O 7
/ 6
o 8
W C
K Z
( x
g f
c M
A j
C -
a J
G e
Q o
z F
p u
d S
1 s
. t
X B
Z E
q i
7 m
\163 N
Y K
D v
0 w
Q h
P j
R g
k e
r D
b 4
' M
z E
p 5
" H
K F
U L
\195 t
I u
a 0
X .
B i
$ 1
Y S
V c

Non-zero for 18.9% of words.

Filter 3 (bias = -0.71) #

x D
V T
b y
<BOS> t
s c
9 d
S r
B u
5 H
<EOS> M
J O
4 \163
f g
6 1
3 .
W C
7 e
w h
8 m
a q
F g
f z
M G
N w
e !
j c
B a
; p
S C
\$ A
r d
J i
" s
K U
Q 1
P ?
X .
9 n
8 -
t &
z f
A F
m x
. S
Z h
w j
g R
X r
G e
/ N
l 9
U o
L E
a u
C 3
c -
D J
T 8
I "
V 4
6 m
7 r
X M
\194 k
Q T
8 g
d U
5 u
x t
2 o
9 w
W y
4 c
1 E
q f
I s
a O
$ G
" R
3 _

Non-zero for 29.7% of words.

Filter 4 (bias = -0.48) #

A d
B p
w -
<BOS> l
N D
Q P
U j
Z v
W h
K g
/ x
k J
<EOS> T
C y
s 0
, m
I e
V G
S o
R 1
z f
& F
Q M
I h
O y
! m
G n
Y x
: k
X j
\194 e
l H
( )
a B
" i
R u
\195 \$
E 4
W ,
s
H -
I c
A o
q s
X m
W G
2 u
i v
a M
7 f
1 '
4 .
, z
Q g
6 y
B R
5 U
3 x
t D
V r
X C
v A
W s
q y
- U
J t
w S
6 c
b h
9 ,
e r
2 F
E k
Q m
" l
7 R
\194 L
8 O
0 g
Z o

Non-zero for 14.4% of words.

Filter 5 (bias = -0.53) #

. J
c i
d B
y j
Q E
' 3
/ 4
C k
" 0
D 5
U e
u V
\194 K
m S
- 9
s 6
^ p
Z 2
a f
P
o A
Y z
" d
R U
h D
x g
9 m
W !
S .
N L
\194 w
; I
3 c
8 a
: C
O t
( Z
' P
M )
Q n
Q m
E -
8 o
2 f
7 n
9 l
4 p
I v
X '
3 y
F t
6 .
" i
5 M
Z g
N u
U w
1 c
A x
B h
Q t
X f
G F
Y h
" n
O u
r s
R m
K d
V v
$ x
\195 .
b y
9 L
W D
P A
z c
J i
l
j

Non-zero for 14.1% of words.

Filter 6 (bias = -0.43) #

K t
Z g
9 l
8 -
B r
3 p
6 d
2 j
5 .
4 T
N '
M h
J k
U m
W I
L A
X S
<EOS> i
w q
1 \163
y x
r 5
T J
m 4
k w
U 0
P 6
; E
' 2
? 3
t 9
Q S
C j
u 7
" o
! e
D l
H L
c B
d 8
H f
Z S
I p
X F
L k
q s
1 x
u y
\195 t
7 c
Q m
A e
Y M
D j
a O
/ '
. i
R K
9 o
J E
W A
" h
Q g
- D
\194 H
$ C
K n
' l
9 c
X r
E L
O y
w p
M d
S t
s T
f F
1
_
a

Non-zero for 16.5% of words.

Filter 7 (bias = -0.46) #

- x
R B
u c
<BOS> A
r o
Q p
j K
P a
" w
E v
I h
' n
H W
d l
F z
M 5
U i
J m
s 0
^ ,
V -
k u
C .
) y
B o
0 E
X r
Y ?
v s
b d
9 N
7 w
6 t
G O
\194 (
p e
5 %
x a
8 U
c \$
w p
W r
Z T
X h
Q g
V o
. D
B c
K j
6 C
2 d
b R
/ t
a 0
U l
4 y
$ O
m P
G
k
f z
W g
M l
F R
y T
6 r
4 u
X A
, b
5 G
n \195
8 Y
K U
3 k
2 -
Z v
N E
/ J
e D
x s

Non-zero for 20.2% of words.

Filter 8 (bias = -0.38) #

<BOS> f
X y
. U
g F
Q P
q K
- u
V s
Y c
b D
W ,
\194 C
w o
l M
^ B
I R
k
L
N
r
W f
T x
H r
i b
U p
1 F
Y l
M n
E .
4 P
2 '
y q
O j
G -
u k
) R
3 N
w \195
& \$
D a
L -
U f
A v
z c
l j
Y M
Q e
a k
/ n
X x
G '
K t
Z p
7 g
6 r
I h
o
F
q
w
x k
8 g
" w
S T
y i
\194 -
6 r
5 I
9 t
Q H
, j
L J
F m
7 b
f \195
c A
o u
N q
K V
/ P

Non-zero for 13.5% of words.

Filter 9 (bias = -0.54) #

o F
O k
K V
<BOS> b
N h
/ g
T H
D x
z 4
" s
W j
- A
M i
\194 a
Y n
, Z
Q C
R u
G e
r 7
Q m
O g
N v
( k
I b
X u
K -
& x
W )
/ h
, n
2 c
" i
E p
: V
S s
3 '
\$ d
5 j
8 f
V -
F y
j o
Z u
7 d
X m
A f
5 s
B p
0 O
4 i
9 U
J t
Q '
8 a
b v
6 w
L W
C z
H ,
h p
u K
H z
R c
Y P
k G
j d
S y
F O
V w
4 D
B m
A o
t 2
\194 a
M \163
r f
N X
s 0
b L

Non-zero for 13.6% of words.

Filter 10 (bias = -0.44) #

<BOS> p
Z t
M T
V y
- d
J i
Q a
b h
R ,
X c
j A
9 O
<EOS> 1
' o
. D
N q
/ \163
^ l
" x
8 I
. P
W G
\194 J
q p
( K
: f
t %
Q r
" R
! o
? \195
v C
H j
X k
d n
a )
& 3
h s
T i
\$ z
P g
9 h
8 m
2 k
6 A
X .
F t
J Y
N c
K s
e z
3 i
7 '
Q l
5 v
I o
D x
Z u
E T
f b
W .
i r
4 c
2 l
3 x
H d
w b
M L
V D
X A
6 a
1 f
5 z
Z F
Y o
$ R
J N
E u
7 v
t

Non-zero for 15.2% of words.

Filter 11 (bias = -0.56) #

d M
I h
- c
2 Y
P B
<BOS> o
a y
E k
6 m
s K
z N
l r
p b
i T
7 S
1 G
e g
J x
j A
Q Z
A f
U o
Z -
E v
X x
L n
Q t
H '
! c
G j
2 p
a M
V h
b \194
Y u
z d
) ,
4 S
I N
& k
Q p
N l
W h
X d
M m
w L
" y
9 A
$ g
Z s
\194 a
K i
2 U
3 x
P
F
D
u
C
k
x T
b D
. t
n y
l u
L P
5 O
a U
V M
A d
7 r
B k
6 c
q R
X E
w \163
9 i
Z p
4 H
N C

Non-zero for 16.1% of words.

Filter 12 (bias = -0.45) #

w R
. P
Z l
W J
m j
g p
A h
X f
c o
M d
<BOS> 7
a 9
Q D
E S
z F
y 0
/ i
2 r
e x
q ,
V t
G -
K d
k e
Y u
Z j
c l
9 .
C F
z H
B D
b f
) \$
X E
Q L
8 h
W %
" I
R s
0 y
5 k
8 T
6 h
2 A
3 u
4 a
Z b
7 t
9 m
X r
Q l
M B
F U
K q
j v
S H
e Y
$ z
G \195
/ i
I j
a -
W M
A f
t g
, F
U x
T b
i m
O .
z J
2 e
1 Z
Q '
H c
B r
q h
p n
/ V
v

Non-zero for 20.8% of words.

Filter 13 (bias = -0.57) #

O B
d f
T n
G F
D b
" x
z N
W k
p h
Q J
t L
\194 A
^ 9
g r
c R
- a
\163 Z
y \195
X u
Y V
M x
t p
U d
A v
Z 6
? 0
C J
m o
r -
k 9
H 7
/ l
T h
. 5
& 8
Q a
( i
R 1
' 2
u 3
c -
y j
K l
G J
O u
C I
U b
M H
W e
D i
z h
" E
/ q
Z g
T F
m R
o s
Q r
, 7
8 x
X u
Q m
\194 r
7 U
6 k
5 f
4 o
W b
S -
$ y
2 \195
8 c
" z
I w
R
v
n
s
p
B

Non-zero for 15.7% of words.

Filter 14 (bias = -0.49) #

X t
m v
y c
Y z
K C
Q s
" I
b D
W u
L d
M T
<BOS> 0
f g
V k
/ w
Z n
H U
^ j
8 A
P E
N j
W p
w g
K C
O k
( d
o P
& F
E )
Q l
? V
" h
: v
/ i
a D
U n
. m
B c
2 0
3 T
X t
p F
G n
Y u
x s
b A
6 j
8 I
v H
0 w
K N
" r
z f
W .
V C
9 M
P e
\194 k
7 S
J E
V y
Q H
b t
\194 u
7 o
S h
z w
9 q
G T
R i
X p
Y r
5 -
C a
j W
J O
l e
s d
Z 1
6 N

Non-zero for 15.5% of words.

Filter 15 (bias = -0.45) #

w F
<BOS> f
W P
X D
Q x
. c
- s
q C
Y d
I j
^ U
H S
p
y
k
h
L
v
0
B
h p
Y d
B -
N P
H z
( f
W s
A c
4 I
L m
X '
\194 C
: g
9 r
8 D
q t
5 G
6 i
7 \163
Q k
Y k
G F
K f
y v
O j
L t
M x
/ I
Z q
m n
X e
W r
U -
" b
$ p
o d
3 a
s
.
B
H f
h K
1 z
4 o
u B
y p
g l
d O
D r
7 P
Z J
6 R
8 s
W \195
Y b
X w
q k
2 x
" N
M S

Non-zero for 7.8% of words.

Filter 16 (bias = -0.51) #

V w
7 f
j o
Y a
C t
Z p
4 -
F y
8 W
G v
R O
6 m
X K
H q
5 z
L .
g x
0 i
Q ,
9 N
w L
W D
I h
q y
- %
. G
v Y
! l
Q P
? U
t R
a u
2 J
: C
X o
( m
e F
' r
E T
\194 H
L k
K -
X i
Z h
/ R
D '
m p
A v
Q u
E C
U n
M x
. g
6 r
e s
z o
G t
N j
l c
B d
X L
7 m
v u
6 o
9 l
Q A
V U
\194 .
C r
2 s
8 y
W f
0 h
4 -
5 O
I _
1 \195
p E
" a
q t

Non-zero for 14.1% of words.

Filter 17 (bias = -0.36) #

Q b
8 m
7 B
d .
3 k
6 A
2 w
1 v
" q
5 T
4 r
O g
s h
, t
9 l
S M
C n
^ \195
I f
\194 u
& j
W u
K -
Q F
X f
z e
\194 k
/ r
Y H
! P
8 t
5 g
( m
" i
G h
o d
O E
9 M
N J
c )
C v
U x
G q
Z o
V f
g -
A W
R e
H w
Y a
P N
k .
r B
s d
Q b
/ E
m h
M 9
S \194
$ \163
w T
n c
- G
W z
2 k
6 U
X Y
Z R
N r
e C
q S
4 g
3 D
5 A
I s
H h
M l
f p
J O
/ b

Non-zero for 12.6% of words.

Filter 18 (bias = -0.64) #

Q f
U x
X p
W j
Y g
" F
H c
Z v
<BOS> h
^ n
/ -
2 m
I l
1 e
3 t
.
k
b
s
S
v f
W l
c F
? P
w j
q %
T m
" L
0 p
9 S
2 r
a s
1 ;
z ,
) e
E J
N '
( i
Y /
8 d
z h
O F
C b
p e
d H
G M
c u
Q m
o j
\194 f
D k
0 B
1 E
/ w
, g
K r
$ .
I A
8 q
P V
m v
X u
Z U
. R
M s
y z
L k
H E
/ B
g T
Q 9
V a
l 0
A d
n I
$ x
r o
Y J
t
i

Non-zero for 15.9% of words.

Filter 19 (bias = -0.39) #

9 m
7 f
Y k
" A
\194 U
8 t
- p
R a
<BOS> B
Q b
3 F
6 w
o z
1 s
^ y
X P
0 i
4 l
N K
J L
D k
d b
" A
8 f
O i
0 m
& B
c V
\194 n
o F
G h
Q H
6 r
( l
2 a
X s
1 g
9 t
E x
7 p
U f
z -
C o
G j
Q x
A M
a e
s n
I h
c l
R J
Z N
E m
k v
P q
D i
T w
" t
1 F
\163 .
Q j
" D
W 0
U d
Y l
$ v
r c
H n
b p
y g
X 5
Z J
k x
' o
t
C
e
F
1
-

Non-zero for 14.5% of words.

Filter 20 (bias = -0.52) #

M g
F p
<BOS> d
f z
V c
B G
m r
/ -
X a
Z o
\194 T
6 \163
S E
K 0
4 D
H O
Q v
, 1
L \195
5 I
D p
H x
L b
( f
u k
/ w
U v
& -
I g
A o
T m
F '
1 a
M G
t c
7 r
Q z
C i
6 W
Z V
Y F
m f
i e
X E
g N
G B
w c
- s
W D
V x
l j
z v
p u
Z S
$ t
/ 8
H 9
h
r
R
F -
0 i
5 p
V r
\194 a
c O
9 y
B u
M U
6 I
8 w
v E
Z s
C d
X P
7 H
j \195
D t
x o
4 m

Non-zero for 14.3% of words.

Filter 21 (bias = -0.47) #

8 w
6 z
7 g
L t
9 s
F O
X -
H E
h G
x i
q k
N S
Z o
4 p
B T
1 c
n m
Q U
\194 I
D '
h c
Y z
H d
: v
( p
W P
S D
i )
A w
u C
4 e
o I
" \163
L 0
N s
3 G
l f
y -
; F
/ E
N k
5 m
8 -
X p
K u
9 g
Q i
L b
6 f
o s
7 P
\194 '
/ U
0 r
D v
3 d
O y
W t
2 V
4 w
I m
S -
Q u
E f
O v
t n
A x
W b
X U
2 '
7 y
5 M
N Z
4 c
T s
H d
, J
e o
.
k

Non-zero for 14.7% of words.

Filter 22 (bias = -0.47) #

L t
K k
y j
U -
G v
/ i
Z g
D I
8 w
O q
Q n
X h
P e
o u
N H
m '
z V
" s
<EOS> 4
Y <BOS>
c P
h f
0 U
Y m
o !
v I
g %
S -
x ;
G F
T r
\194 :
5 a
9 d
4 \195
W L
8 s
C Z
1 u
7 H
Q p
/ g
\194 i
$ x
" P
U h
. v
s 0
' J
N b
R e
G
d
c
1
q
r
y
k
f
X h
B y
K -
W d
Q g
Z t
z u
b r
V f
9 j
6 p
J s
2 n
Y c
w o
\194 F
8 i
U C
" '
5 H

Non-zero for 15.2% of words.

Filter 23 (bias = -0.36) #

. k
- B
<BOS> p
Q P
\194 f
/ K
^ i
" U
X x
v
J
T
C
0
b
z
c
F
R
\195
Z k
Q j
! h
& i
/ p
X t
? f
K F
" r
W u
( e
\194 l
M g
. P
8 E
G x
: v
d
T
J
G f
g u
j i
L y
z W
Z h
D x
A -
0 ,
X o
E q
V a
l k
c H
J p
5 n
. v
Q '
F t
b d
. p
Q P
b i
w T
E d
Z D
s y
W t
x H
" 1
z j
A C
N r
a n
V -
S k
X o
L f
B h
\194 u

Non-zero for 5.6% of words.

Filter 24 (bias = -0.43) #

<BOS> 1
f H
' g
F y
l G
x i
. h
\194 U
j 2
S u
v 3
t A
b a
m T
- 4
Q E
B Y
M D
e Z
N 0
G u
X t
K m
2 h
8 -
5 k
Z f
Q l
0 s
9 .
3 i
7 H
6 v
O '
1 U
4 a
c b
W A
E T
D %
m I
Y E
v 2
T r
k d
h N
\194 e
b n
B 3
V s
M w
W -
" 5
' 1
x P
$ O
X F
u a
t 7
l j
d f
D w
\194 B
7 k
Y E
C r
6 b
1 K
$ e
l N
X x
/ F
Q a
L o
0 t
8 S
A
p
s
_

Non-zero for 20.2% of words.

Filter 25 (bias = -0.41) #

Z p
9 t
F i
8 w
V o
7 O
X -
L y
Q a
b s
J f
6 m
R W
<BOS> ,
M z
j d
B I
0 g
4 '
Y T
( v
Q x
& p
O f
/ k
: b
? )
N j
" V
! i
r m
H J
A B
I g
. F
U 0
R n
Y e
y c
w
H b
1 x
i v
4 .
2 -
3 f
D '
5 r
, z
I k
M a
A q
y c
C p
t o
6 R
/ \195
Z B
T "
O \163
- F
Y t
b f
g y
l ,
G D
. c
V B
x C
z K
\194 N
' n
X P
J T
Q U
$ M
" e
m I
\195 k
2

Non-zero for 15.6% of words.

Filter 26 (bias = -0.52) #

C b
I J
U x
d v
c E
n e
D h
Q W
/ w
, B
' q
s M
t Y
P o
R -
A 4
z i
F m
r j
y X
J y
j h
X U
0 s
7 t
Z a
- u
I .
V f
2 x
P m
5 A
9 S
6 "
n c
g W
G ,
1 o
3 k
) B
W u
p D
K j
i .
B g
x c
X F
a d
, -
O C
w r
Y R
q L
f s
k M
" Z
6 n
V U
Q h
2 e
Q f
" J
X P
Y o
\194 i
Z -
$ I
. t
V w
W p
8 E
h l
c s
7 r
\195
j
B
e
u
z

Non-zero for 22.9% of words.

Filter 27 (bias = -0.51) #

W p
H P
X f
w d
4 j
Z l
Q -
A r
2 z
q R
^ c
/ s
Y v
" o
M x
J
D
G
0
b
g v
V d
G a
Y q
i N
Z u
S t
m D
j f
4 B
M .
H T
X c
3 x
5 \163
C U
) o
% e
I
\$
k -
V u
p L
C l
Q o
b .
x D
F m
9 w
8 d
" t
B U
r s
7 z
P E
c /
X J
R O
' M
q e
6 r
7 t
8 T
x o
S k
\194 w
4 A
5 y
Q n
F B
V m
X i
9 p
s H
" q
j u
d \195
$ N
G U
E a

Non-zero for 20.3% of words.

Filter 28 (bias = -0.47) #

<BOS> y
Q h
E d
w u
W m
X p
I c
N D
S L
2 C
K x
O g
e l
" n
^ U
5 P
1
a
v
H
g f
Y x
R L
T y
k K
I N
j F
- B
V n
; a
G .
C \$
Q o
r e
z ,
' m
& %
) w
i 5
\194 8
I u
Q M
l f
A m
X v
p y
7 c
O U
a o
2 -
S x
W B
t F
q n
s
Z
k
R
'
h
R y
V h
- D
s d
b p
k L
z t
w c
J ,
E F
Q q
' l
U H
G f
Z 1
Y o
9 x
$ T
\195 A
" n

Non-zero for 13.3% of words.

Filter 29 (bias = -0.48) #

B p
. i
b O
v P
<BOS> d
N y
q s
M E
V I
\194 G
Z 1
n U
x 2
9 ,
F -
h z
c 3
k S
X a
Q o
I f
i F
W x
Y .
1 L
T r
\194 e
2 y
C b
H m
z \$
& %
w h
k N
V j
X l
4 S
o
p
s
E n
S m
O C
Y d
h .
3 D
G v
o c
r t
" Z
R /
4 '
W U
J z
g P
9 f
N \194
x l
e F
8 I
Y f
V B
\194 y
$ c
g F
Q N
S K
7 r
X e
G a
4 P
" U
n
v
t
p
D
o
_
w

Non-zero for 25.6% of words.

Filter 30 (bias = -0.59) #

<BOS> t
X y
9 p
Z T
7 m
Q c
6 g
8 o
J z
N h
2 k
4 i
3 s
5 A
V O
F U
I a
j G
n l
^ S
F k
e -
\$ v
N Y
E z
2 u
f m
5 R
4 '
8 T
L g
3 C
S c
W i
6 )
K G
Q V
X U
, \195
( l
Y k
S B
j f
7 U
G w
h a
5 b
g r
4 m
l v
6 t
\194 K
3 n
0 q
1 P
8 N
$ z
O \195
L c
X .
Y f
\194 r
4 B
7 t
V K
6 A
g N
- F
1 a
$ p
Z P
X k
" o
H ,
G U
W l
8 e
3 b
0 _
O

Non-zero for 25.9% of words.

Filter 31 (bias = -0.47) #

<BOS> f
w h
W F
Q P
O y
z m
E u
I L
X x
" p
^ r
\194 H
2 n
G d
l
k
b
D
j
B
k D
V o
C d
; .
' E
Q -
P e
R L
b l
B v
Z 0
" t
F g
Y w
r u
f T
U j
) c
p h
, z
X f
L p
H o
Q S
7 c
q t
6 y
Z O
9 s
u m
8 i
a k
b '
\195 g
J w
2 M
D C
1 K
Y x
d ,
y B
d k
H v
1 b
u t
s q
4 T
- l
Z f
G r
3 N
" o
8 J
2 z
U K
6 x
$ w
L A
7 \195
D R

Non-zero for 15.5% of words.

Filter 32 (bias = -0.77) #

<BOS> t
L T
/ g
X k
Z h
Q i
<EOS> y
K p
l j
9 e
\194 E
z c
6 u
. r
8 H
7 \163
B d
b -
5 v
N F
W s
X f
V l
2 t
4 C
Y .
E o
6 n
q A
" c
H L
3 F
b ,
) D
Z U
w %
9 d
1 '
J r
7 z
f z
F .
B -
i U
h G
k g
t u
, d
S s
M E
p L
j Z
H a
4 \195
x b
n w
5 Q
W R
6 r
T A
W j
w F
z P
K H
o f
" k
O r
Q h
a i
. C
N n
X g
\194 u
v d
B l
c p
$ -
Y J
/ e
q s

Non-zero for 23.8% of words.

Filter 33 (bias = -0.54) #

N g
W -
B j
K m
Q p
, G
/ d
O v
q s
" l
X '
a V
H b
A k
2 c
3 z
I C
<BOS> x
8 i
9 J
W g
\194 U
" P
: C
o r
x k
X )
( A
Q F
v G
Y R
S n
N Z
6 u
O c
& p
/ s
q \195
D
z
Z f
g t
H d
V p
G v
Y P
A s
w ,
X F
4 x
1 o
3 S
7 '
2 O
L l
n T
5 -
M e
h k
0 I
f g
F u
x T
B G
N Y
9 H
e m
K h
Q y
6 D
8 U
X A
W c
5 i
, z
2 C
q -
7 1
b d
S l

Non-zero for 11.4% of words.

Filter 34 (bias = -0.51) #

P -
C .
p h
k u
U v
r l
K j
R M
c H
z m
G \194
, e
F q
Q W
I Y
O <BOS>
s L
B w
f