This page shows visualizations of some width-2 1-d convolutional filters from Google's lm_1b language model. Each column corresponds to one position in the filter, and shows the characters with the most positive weights. Use the checkbox in the bottom-right to also see the most negative weights (may be slow).
Below that are examples of words for which the filter emits the highest values. A filter's response is its maximum value over all substrings it sees in the word. So if a filter has high weights on 'c' in the first position, then 'a', then 't', it will assign equally high scores to 'cat', 'fatcat', 'concatenate', etc. The portion of the string in blue is the substring the filter is responding to.
'^' and '$' represent beginning and end of word markers, respectively. '_' is a padding character. Literal versions of those characters are escaped with a backslash.
Use the links at the top to see filters of other widths.
Check out my blog post here for a bit more context.
Filter 0 (bias = -0.62) #
-
A
<BOS>
y
v
U
j
a
J
L
\194
H
R
,
0
h
9
F
'
K
o
B
d
C
"
m
7
s
l
Z
X
t
6
c
Y
/
b
w
\195
i
D
x
T
f
U
-
z
h
&
b
X
p
K
s
G
n
Z
\$
0
'
M
F
/
.
O
S
)
a
1
k
C
r
Q
e
L
q
Y
i
I
g
Non-zero for 8.3% of words.
^3-D $____ (2.4) ^PRNewswire-U SNewswire$____ (1.8) ^10-K $____ (1.5) ^Secretary-G eneral$____ (1.5) ^non-G AAP$____ (1.5) ^'D onnell$____ (1.3) ^2-0 $____ (1.3) ^1-0 $____ (1.3) ^3-0 $____ (1.3) ^0-0 $____ (1.3) ^4-0 $____ (1.3) ^6-0 $____ (1.3) ^5-0 $____ (1.3) ^Wal-M art$____ (1.3) ^al-M aliki$____ (1.3) ^T-M obile$____ (1.3) ^MoD $____ (1.3) ^2-1 $____ (1.2) ^6-1 $____ (1.2) ^3-1 $____ (1.2) ^1-1 $____ (1.2) ^4-1 $____ (1.2) ^0-1 $____ (1.2) ^5-1 $____ (1.2) ^Coca-C ola$____ (1.2) ^D-C alif$____ (1.2) ^al-Q aida$____ (1.2) ^al-Q aeda$____ (1.2) ^Al-Q aeda$____ (1.2) ^DVD $____ (1.1) ^DVD s$____ (1.1) ^MD C$____ (1.1) ^so-c alled$____ (1.1) ^health-c are$____ (1.1) ^middle-c lass$____ (1.1) ^low-c ost$____ (1.1) ^D avid$____(1.1) ^D epartment$____(1.1) ^D ecember$____(1.1) ^D emocratic$____(1.1) Filter 1 (bias = -0.49) #
x
t
b
T
V
u
<BOS>
U
X
y
.
O
9
i
v
H
8
D
7
I
Q
,
Z
1
6
o
q
d
<EOS>
M
\194
C
B
P
5
A
F
s
0
E
U
p
E
x
W
-
&
r
A
f
t
o
4
b
S
l
Q
P
)
d
Z
n
(
q
M
\195
s
J
2
h
v
%
y
m
a
Non-zero for 12.2% of words.
^next $____ (1.6) ^ext ra$____ (1.6) ^ext ended$____ (1.6) ^sixt h$____ (1.6) ^debt $____ (1.5) ^doubt $____ (1.5) ^obt ained$____ (1.5) ^obt ain$____ (1.5) ^jobs $____ (1.4) ^webs ite$____ (1.4) ^clubs $____ (1.4) ^abs olutely$____ (1.4) ^subs tantial$____ (1.4) ^bombs $____ (1.4) ^Zimbabw e$____ (1.4) ^subw ay$____ (1.4) ^Zimbabw ean$____ (1.4) ^Mexi co$____ (1.3) ^exi sting$____ (1.3) ^approxi mately$____ (1.3) ^Mexi can$____ (1.3) ^maxi mum$____ (1.3) ^exi t$____ (1.3) ^exi st$____ (1.3) ^exc hange$____ (1.2) ^Exc hange$____ (1.2) ^exc ept$____ (1.2) ^exc ellent$____ (1.2) ^sexu al$____ (1.2) ^luxu ry$____ (1.2) ^sexu ally$____ (1.2) ^homosexu ality$____ (1.2) ^sexu ality$____ (1.2) ^luxu rious$____ (1.2) ^exe cutive$____ (1.2) ^taxe s$____ (1.2) ^exe cutives$____ (1.2) ^exe rcise$____ (1.2) ^bi llion$____ (1.1) ^bi g$____ (1.1) Filter 2 (bias = -0.74) #
H
c
U
j
i
F
u
D
a
.
W
g
Y
e
I
S
1
f
\195
C
B
G
k
0
A
M
3
o
J
x
2
r
4
p
P
N
w
t
R
'
Q
p
(
f
\194
x
X
y
&
c
Y
k
:
F
"
a
-
P
W
h
/
m
Z
B
b
r
%
A
s
K
U
t
Non-zero for 1.7% of words.
^semi- final$____ (1.1) ^semi- finals$____ (1.1) ^anti- government$____ (1.1) ^Ki- moon$____ (1.1) ^Port-au- Prince$____ (1.1) ^Blu- ray$____ (1.1) ^AZUZ $____ (1.0) ^HM RC$____ (0.9) ^WASHI NGTON$____ (0.8) ^HI V$____ (0.8) ^CHI CAGO$____ (0.8) ^PHI LADELPHIA$____ (0.8) ^TEHR AN$____ (0.8) ^SUV $____ (0.8) ^SOUR CE$____ (0.8) ^Coca- Cola$____ (0.7) ^Asia- Pacific$____ (0.7) ^Hu man$____ (0.6) ^Hu ghes$____ (0.6) ^Hu ckabee$____ (0.6) ^Hu rricane$____ (0.6) ^Hu ssein$____ (0.6) ^Hu ndreds$____ (0.6) ^Hu dson$____ (0.6) ^Stadiu m$____ (0.5) ^stadiu m$____ (0.5) ^premiu m$____ (0.5) ^uraniu m$____ (0.5) ^Suu $____ (0.5) ^vacuu m$____ (0.5) ^H1 N1$____ (0.5) ^UN $____ (0.5) ^Beij ing$____ (0.5) ^marij uana$____ (0.5) ^hij acked$____ (0.5) ^Azerbaij an$____ (0.5) ^H. $____ (0.5) ^U. S.$____ (0.4) ^U. N.$____ (0.4) ^U. S.-led$____ (0.4) Filter 3 (bias = -0.60) #
s
P
S
p
.
J
<BOS>
D
'
1
"
r
W
q
\194
n
Y
\195
Q
0
^
B
O
T
/
I
m
d
w
k
9
H
2
v
7
Q
B
\194
b
&
E
/
h
:
e
'
p
(
k
!
x
"
a
-
g
X
F
Y
v
r
A
c
T
J
f
0
q
Non-zero for 0.2% of words.
^cross- border$____ (0.3) ^US- led$____ (0.2) ^U.S.- led$____ (0.1) ^U.S.- backed$____ (0.1) ^N.Y .$____ (0.1) ^D-N.Y .$____ (0.1) ^\226\130\172 $____ (0.1) ^Q ueen$____(0.0) ^Q aeda$____(0.0) ^Q uote$____(0.0) ^Q $____(0.0) ^Q atar$____(0.0) ^Q ueens$____(0.0) ^Q C$____(0.0) Filter 4 (bias = -0.74) #
B
-
9
.
8
g
D
m
K
w
6
'
1
b
0
<BOS>
3
r
5
l
,
j
U
n
P
e
7
t
2
s
C
q
T
A
4
p
F
u
R
V
-
A
'
F
G
N
z
B
d
t
m
E
!
e
v
h
\194
r
V
H
p
\$
Y
q
C
a
)
T
i
S
o
L
s
I
J
f
Z
k
6
\163
Non-zero for 11.5% of words.
^19- year-old$____ (2.5) ^29- year-old$____ (2.5) ^39- year-old$____ (2.5) ^9- year-old$____ (2.5) ^18- year-old$____ (2.5) ^28- year-old$____ (2.5) ^38- year-old$____ (2.5) ^D- Calif$____ (2.3) ^D- N.Y.$____ (2.3) ^6- 3$____ (2.2) ^6- 4$____ (2.2) ^6- 2$____ (2.2) ^6- 1$____ (2.2) ^16- year-old$____ (2.2) ^1- 0$____ (2.2) ^1- 1$____ (2.2) ^21- year-old$____ (2.2) ^1- 2$____ (2.2) ^10- year$____ (2.1) ^0- 0$____ (2.1) ^20- year-old$____ (2.1) ^30- year-old$____ (2.1) ^0- 1$____ (2.1) ^30- year$____ (2.1) ^3- 0$____ (1.9) ^3- 1$____ (1.9) ^3- 2$____ (1.9) ^3- pointer$____ (1.9) ^15- year-old$____ (1.9) ^25- year-old$____ (1.9) ^5- 4$____ (1.9) ^5- 0$____ (1.9) ^5- 1$____ (1.9) ^35- year-old$____ (1.9) ^7- 6$____ (1.8) ^17- year-old$____ (1.8) ^7- 5$____ (1.8) ^27- year-old$____ (1.8) ^2- 1$____ (1.8) ^2- 0$____ (1.8) Filter 5 (bias = -0.51) #
T
s
q
C
W
F
v
n
X
'
H
f
Y
S
D
R
M
.
h
x
B
U
1
<EOS>
y
,
0
5
p
A
e
V
m
Z
O
Q
J
<BOS>
i
j
7
-
8
w
C
.
P
t
F
v
G
o
L
m
V
?
9
q
)
W
R
f
3
u
4
e
Z
'
5
!
6
n
Y
a
U
T
1
g
0
d
Non-zero for 20.8% of words.
^OTC $____ (2.8) ^ATP $____ (2.8) ^ATL ANTA$____ (2.6) ^SEATTL E$____ (2.6) ^TV $____ (2.6) ^ITV $____ (2.6) ^MTV $____ (2.6) ^CCTV $____ (2.6) ^DETR OIT$____ (2.5) ^CITY $____ (2.3) ^FTS E$____ (2.0) ^TS B$____ (2.0) ^TS A$____ (2.0) ^EBITD A$____ (1.9) ^TD $____ (1.9) ^BHP $____ (1.8) ^HP $____ (1.8) ^NYC $____ (1.8) ^TB $____ (1.7) ^TA RP$____ (1.7) ^ETA $____ (1.7) ^WTA $____ (1.7) ^CDC $____ (1.7) ^DC $____ (1.7) ^MDC $____ (1.7) ^GDP $____ (1.6) ^TH E$____ (1.6) ^WITH $____ (1.6) ^TH AT$____ (1.6) ^MP s$____ (1.6) ^MP $____ (1.6) ^MP 3$____ (1.6) ^MP C$____ (1.6) ^17 $____ (1.6) ^17 th$____ (1.6) ^17 -year-old$____ (1.6) ^17 0$____ (1.6) ^2007 $____ (1.6) ^2007 .$____ (1.6) ^07 $____ (1.6) Filter 6 (bias = -0.30) #
<BOS>
m
Q
f
\194
p
.
i
I
y
C
h
'
L
v
K
"
x
^
G
t
b
c
P
-
J
/
S
q
l
n
E
d
e
R
F
D
g
B
H
p
u
c
E
x
1
f
I
o
U
S
)
K
T
G
J
z
4
'
2
O
q
m
3
C
6
l
Z
s
R
.
7
y
(
g
9
,
Y
n
Non-zero for 7.9% of words.
^Qu een$____ (0.5) ^Qu ote$____ (0.5) ^Qu eens$____ (0.5) ^Qu inn$____ (0.5) ^guardian.co.u k$____ (0.5) ^CH ICAGO$____ (0.4) ^Cu p$____ (0.4) ^Cu ba$____ (0.4) ^Cu ban$____ (0.4) ^Cu bs$____ (0.4) ^Cu rrently$____ (0.4) ^Cu stoms$____ (0.4) ^Cu omo$____ (0.4) ^Cu lture$____ (0.4) ^vu lnerable$____ (0.3) ^vu lnerability$____ (0.3) ^H e$____(0.3) ^H ouse$____(0.3) ^H is$____(0.3) ^H owever$____(0.3) ^H ealth$____(0.3) ^H ow$____(0.3) ^H er$____(0.3) ^H illary$____(0.3) ^u p$____(0.3) ^u nder$____(0.3) ^u sed$____(0.3) ^u se$____(0.3) ^Satu rday$____ (0.3) ^futu re$____ (0.3) ^retu rn$____ (0.3) ^stu dy$____ (0.3) ^stu dents$____ (0.3) ^tu rned$____ (0.3) ^secu rity$____ (0.3) ^cu t$____ (0.3) ^cu rrent$____ (0.3) ^execu tive$____ (0.3) ^run-u p$____ (0.3) ^follow-u p$____ (0.3) Filter 7 (bias = -0.48) #
j
y
<BOS>
f
E
K
7
m
I
a
4
x
J
n
\194
o
S
p
6
c
-
B
g
U
e
r
D
N
X
b
0
w
2
k
H
.
5
,
T
A
b
y
Q
n
E
i
.
C
:
1
X
H
z
c
"
o
!
h
V
D
&
,
;
p
B
t
r
u
x
d
e
M
a
m
l
T
\194
f
Y
3
Non-zero for 9.0% of words.
^Ib rahim$____ (1.1) ^Maj. $____ (1.1) ^would-b e$____ (1.0) ^back-to-b ack$____ (1.0) ^cross-b order$____ (1.0) ^York-b ased$____ (1.0) ^rugb y$____ (1.0) ^Rugb y$____ (1.0) ^Drogb a$____ (1.0) ^Feb ruary$____ (1.0) ^deb t$____ (1.0) ^Web $____ (1.0) ^deb ate$____ (1.0) ^web site$____ (1.0) ^Xb ox$____ (1.0) ^Tb ilisi$____ (1.0) ^broadb and$____ (0.9) ^Cadb ury$____ (0.9) ^feedb ack$____ (0.9) ^goodb ye$____ (0.9) ^groundb reaking$____ (0.9) ^Diamondb acks$____ (0.9) ^cardb oard$____ (0.9) ^b y$____(0.9) ^b e$____(0.9) ^b ut$____(0.9) ^b een$____(0.9) ^alb um$____ (0.8) ^Alb ert$____ (0.8) ^Melb ourne$____ (0.8) ^alb eit$____ (0.8) ^alb ums$____ (0.8) ^Gilb ert$____ (0.8) ^elb ow$____ (0.8) ^1b n$____ (0.8) ^footb all$____ (0.8) ^outb reak$____ (0.8) ^Footb all$____ (0.8) ^setb ack$____ (0.8) ^possib le$____ (0.7) Filter 8 (bias = -0.41) #
L
k
Z
T
5
t
6
v
X
r
/
p
8
-
.
R
7
i
4
u
F
o
A
I
Q
q
K
O
V
c
3
'
G
\163
2
j
<EOS>
P
^
B
v
H
z
y
\194
r
0
h
x
F
J
A
-
n
T
?
9
\$
b
f
&
i
W
1
l
P
B
L
o
,
X
u
c
C
w
Z
6
N
"
3
Non-zero for 9.6% of words.
^LT TE$____ (1.2) ^Ll oyds$____ (1.2) ^Ll oyd$____ (1.2) ^Lo ndon$____ (1.2) ^Lo s$____ (1.2) ^Lo rd$____ (1.2) ^Lo uis$____ (1.2) ^LG $____ (1.1) ^Av enue$____ (1.1) ^Av iation$____ (1.1) ^Av erage$____ (1.1) ^Av atar$____ (1.1) ^Av iv$____ (1.1) ^Av ery$____ (1.1) ^ANGELE S$____ (1.1) ^JERUSALE M$____ (1.1) ^SEATTLE $____ (1.1) ^L. A.$____ (1.0) ^L. $____ (1.0) ^N.F.L. $____ (1.0) ^LS U$____ (0.9) ^MLS $____ (0.9) ^Lt d$____ (0.9) ^Lt .$____ (0.9) ^Lt d.$____ (0.9) ^v ery$____(0.9) ^v ote$____(0.9) ^v ictory$____(0.9) ^v isit$____(0.9) ^LO S$____ (0.9) ^LO NDON$____ (0.9) ^involv ed$____ (0.9) ^themselv es$____ (0.9) ^involv ing$____ (0.9) ^Pennsylv ania$____ (0.9) ^BERLI N$____ (0.9) ^La st$____ (0.9) ^La bour$____ (0.9) ^La $____ (0.9) ^La s$____ (0.9) Filter 9 (bias = -0.76) #
-
Z
x
D
p
9
f
K
.
Q
m
U
h
8
y
X
n
R
'
G
d
0
g
7
i
5
v
3
q
B
a
2
w
J
o
6
t
E
l
7
-
1
m
2
.
9
'
3
f
8
v
4
w
5
?
I
x
6
o
U
g
P
!
D
p
R
t
C
y
0
b
)
c
H
M
F
q
A
h
Non-zero for 21.4% of words.
^6-7 $____ (2.6) ^2-1 $____ (2.5) ^6-1 $____ (2.5) ^3-1 $____ (2.5) ^1-1 $____ (2.5) ^6-2 $____ (2.4) ^3-2 $____ (2.4) ^2-2 $____ (2.4) ^1-2 $____ (2.4) ^6-3 $____ (2.3) ^4-3 $____ (2.3) ^2-3 $____ (2.3) ^1-3 $____ (2.3) ^5-3 $____ (2.3) ^1.7 $____ (2.2) ^2.7 $____ (2.2) ^0.7 $____ (2.2) ^3.7 $____ (2.2) ^6-4 $____ (2.2) ^5-4 $____ (2.2) ^3-4 $____ (2.2) ^7-5 $____ (2.2) ^1.1 $____ (2.1) ^0.1 $____ (2.1) ^2.1 $____ (2.1) ^3.1 $____ (2.1) ^7-6 $____ (2.1) ^4-6 $____ (2.1) ^3-6 $____ (2.1) ^PRNewswire-U SNewswire$____ (2.0) ^1.2 $____ (2.0) ^0.2 $____ (2.0) ^2.2 $____ (2.0) ^3.2 $____ (2.0) ^1.9 $____ (2.0) ^2.9 $____ (2.0) ^0.9 $____ (2.0) ^3.9 $____ (2.0) ^1.3 $____ (2.0) ^0.3 $____ (2.0) Filter 10 (bias = -0.43) #
c
r
v
f
z
j
W
P
0
l
\194
F
"
m
G
H
8
p
x
e
9
J
w
M
o
L
U
i
a
n
2
I
1
b
.
<BOS>
s
\195
u
t
K
g
y
v
/
j
M
k
O
-
X
t
,
b
L
u
W
I
Z
h
"
E
8
q
Q
.
N
d
f
l
m
s
3
A
o
z
;
T
6
)
Non-zero for 10.0% of words.
^policy $____ (0.9) ^agency $____ (0.9) ^emergency $____ (0.9) ^Agency $____ (0.9) ^heavy $____ (0.9) ^Navy $____ (0.9) ^navy $____ (0.9) ^Levy $____ (0.9) ^Sarkozy $____ (0.7) ^crazy $____ (0.7) ^frenzy $____ (0.7) ^lazy $____ (0.7) ^Wy oming$____ (0.7) ^McL aren$____ (0.5) ^McL ean$____ (0.5) ^UK $____ (0.5) ^oxy gen$____ (0.5) ^proxy $____ (0.5) ^Galaxy $____ (0.5) ^sexy $____ (0.5) ^McQ ueen$____ (0.5) ^McN amee$____ (0.5) ^U.K .$____ (0.5) ^lawy er$____ (0.4) ^lawy ers$____ (0.4) ^Lawy ers$____ (0.4) ^employ ees$____ (0.4) ^Roy al$____ (0.4) ^boy $____ (0.4) ^unemploy ment$____ (0.4) ^Toy ota$____ (0.4) ^boy s$____ (0.4) ^destroy ed$____ (0.4) ^enjoy $____ (0.4) ^say s$____ (0.4) ^say $____ (0.4) ^may $____ (0.4) ^way $____ (0.4) ^co uld$____ (0.4) ^co mpany$____ (0.4) Filter 11 (bias = -0.54) #
.
T
g
H
x
U
c
Y
s
u
-
B
w
M
n
P
j
'
<BOS>
d
z
b
S
v
F
p
-
F
!
t
\195
c
:
S
J
f
X
k
Y
h
?
C
1
B
;
s
Q
j
R
A
9
T
P
M
Z
e
I
\$
2
v
3
D
&
)
7
y
Non-zero for 3.6% of words.
^U.S.- led$____ (1.9) ^U.S.- backed$____ (1.9) ^long- term$____ (1.9) ^long- standing$____ (1.9) ^long- range$____ (1.9) ^long- running$____ (1.9) ^six- month$____ (1.8) ^six- year$____ (1.8) ^ex- wife$____ (1.8) ^six- party$____ (1.8) ^cross- border$____ (1.8) ^-- $____ (1.8) ^-- -$____ (1.8) ^low- income$____ (1.7) ^follow- up$____ (1.7) ^low- cost$____ (1.7) ^low- key$____ (1.7) ^African- American$____ (1.7) ^run- up$____ (1.7) ^non- profit$____ (1.7) ^decision- making$____ (1.7) ^non- GAAP$____ (1.7) ^year-on- year$____ (1.7) ^run- off$____ (1.7) ^forward- looking$____ (1.7) ^third- quarter$____ (1.7) ^second- largest$____ (1.7) ^would- be$____ (1.7) ^sub- prime$____ (1.7) ^US- led$____ (1.7) ^hip- hop$____ (1.7) ^top- ranked$____ (1.7) ^e- mail$____ (1.7) ^PRNewswire- FirstCall$____ (1.7) ^PRNewswire- USNewswire$____ (1.7) ^five- year$____ (1.7) ^al- Qaida$____ (1.6) ^al- Qaeda$____ (1.6) ^Wal- Mart$____ (1.6) ^full- time$____ (1.6) Filter 12 (bias = -0.28) #
m
j
U
h
z
x
K
0
Z
7
/
F
y
e
M
q
w
5
L
9
s
g
u
S
<BOS>
N
'
4
Y
8
P
r
W
3
T
1
a
n
^
p
Q
p
Z
i
?
o
)
f
X
%
.
,
8
l
D
O
"
x
F
t
(
w
7
K
!
s
V
m
M
S
R
a
9
y
b
z
H
-
u
W
Non-zero for 5.7% of words.
^AZUZ $____ (0.7) ^p.m. $____ (0.5) ^a.m. $____ (0.5) ^Adm. $____ (0.5) ^annum. $____ (0.5) ^U. S.$____ (0.5) ^U. N.$____ (0.5) ^U. S.-led$____ (0.5) ^U. K.$____ (0.5) ^numb er$____ (0.4) ^memb ers$____ (0.4) ^Septemb er$____ (0.4) ^Decemb er$____ (0.4) ^Novemb er$____ (0.4) ^SUV $____ (0.4) ^SOUR CE$____ (0.4) ^mu ch$____ (0.4) ^mu st$____ (0.4) ^commu nity$____ (0.4) ^mu sic$____ (0.4) ^mu rder$____ (0.4) ^stimu lus$____ (0.4) ^commu nities$____ (0.4) ^mu ltiple$____ (0.4) ^Demj anjuk$____ (0.4) ^Ur ban$____ (0.3) ^Ur ibe$____ (0.3) ^UN $____ (0.3) ^UE FA$____ (0.3) ^Comc ast$____ (0.3) ^# $____(0.3) ^< $____(0.3) ^Ug anda$____ (0.3) ^time $____ (0.3) ^some $____ (0.3) ^governme nt$____ (0.3) ^home $____ (0.3) ^KABUL $____ (0.3) ^SEOUL $____ (0.3) ^UC LA$____ (0.2) Filter 13 (bias = -0.33) #
<BOS>
y
I
.
7
m
6
A
j
h
9
o
J
r
2
L
0
a
4
c
5
f
X
g
P
U
V
b
\194
x
3
w
8
u
1
N
v
t
Q
l
!
v
?
B
m
k
y
x
.
0
Z
R
Q
J
/
9
X
j
:
F
M
S
L
h
(
i
&
f
-
)
O
5
G
C
"
t
H
s
w
o
Non-zero for 10.4% of words.
^Im migration$____ (0.8) ^Im perial$____ (0.8) ^Im agine$____ (0.8) ^I. $____ (0.7) ^7. 5$____ (0.7) ^2007. $____ (0.7) ^7. 2$____ (0.7) ^7. 6$____ (0.7) ^6. 5$____ (0.7) ^6. 2$____ (0.7) ^6. 1$____ (0.7) ^6. 7$____ (0.7) ^6. 4$____ (0.7) ^6. 3$____ (0.7) ^2m $____ (0.7) ^Maj. $____ (0.7) ^2009. $____ (0.7) ^9. 5$____ (0.7) ^J. $____ (0.7) ^N.J. $____ (0.7) ^2. 5$____ (0.6) ^2. 2$____ (0.6) ^2. 3$____ (0.6) ^2. 4$____ (0.6) ^100m $____ (0.6) ^200m $____ (0.6) ^10m $____ (0.6) ^400m $____ (0.6) ^! $____(0.6) ^0. 5$____ (0.6) ^0. 2$____ (0.6) ^0. 3$____ (0.6) ^0. 1$____ (0.6) ^0. 4$____ (0.6) ^Py ongyang$____ (0.6) ^4. 5$____ (0.5) ^4. 2$____ (0.5) ^4. 3$____ (0.5) ^4. 4$____ (0.5) ^5. 5$____ (0.5) Filter 14 (bias = -0.41) #
<BOS>
D
.
0
'
J
Q
c
Y
1
W
P
"
2
S
G
t
Z
\194
j
l
5
a
9
m
8
-
F
^
6
b
M
3
e
K
E
V
.
9
u
S
y
5
t
7
m
G
?
0
U
J
d
4
a
x
H
6
!
8
A
Y
-
3
T
j
r
X
q
R
D
)
w
K
n
\194
L
Non-zero for 12.0% of words.
^1.9 $____ (1.6) ^2.9 $____ (1.6) ^0.9 $____ (1.6) ^3.9 $____ (1.6) ^U.S .$____ (1.5) ^U.S .-led$____ (1.5) ^U.S .-backed$____ (1.5) ^1.5 $____ (1.5) ^2.5 $____ (1.5) ^3.5 $____ (1.5) ^0.5 $____ (1.5) ^4.5 $____ (1.5) ^5.5 $____ (1.5) ^6.5 $____ (1.5) ^'S $____ (1.5) ^1.7 $____ (1.4) ^2.7 $____ (1.4) ^0.7 $____ (1.4) ^3.7 $____ (1.4) ^2.0 $____ (1.4) ^NYS E$____ (1.3) ^N.J .$____ (1.3) ^V irginia$____(1.3) ^V alley$____(1.3) ^V egas$____(1.3) ^V ice$____(1.3) ^USS $____ (1.2) ^1.4 $____ (1.2) ^2.4 $____ (1.2) ^0.4 $____ (1.2) ^3.4 $____ (1.2) ^4.4 $____ (1.2) ^5.4 $____ (1.2) ^6.4 $____ (1.2) ^1.6 $____ (1.2) ^0.6 $____ (1.2) ^2.6 $____ (1.2) ^3.6 $____ (1.2) ^1.8 $____ (1.1) ^2.8 $____ (1.1) Filter 15 (bias = -0.44) #
G
f
z
q
Q
h
<BOS>
u
C
e
S
B
s
v
Y
r
V
H
\194
x
^
N
/
y
X
a
Z
n
O
k
5
b
-
o
F
t
z
h
l
F
&
)
O
u
I
k
/
x
%
y
!
H
:
4
Q
M
G
f
A
v
K
8
L
e
X
B
.
?
-
q
t
9
o
\$
\194
c
Non-zero for 13.4% of words.
^Gl obal$____ (1.5) ^Gl asgow$____ (1.5) ^Gl obe$____ (1.5) ^Gl enn$____ (1.5) ^Buzz $____ (1.3) ^jazz $____ (1.3) ^Condoleezz a$____ (1.3) ^Jazz $____ (1.3) ^Fritzl $____ (1.3) ^Cz ech$____ (1.2) ^Cl inton$____ (1.2) ^Cl ub$____ (1.2) ^Cl eveland$____ (1.2) ^Cl ark$____ (1.2) ^Sl am$____ (1.1) ^Sl ovakia$____ (1.1) ^Sl ovenia$____ (1.1) ^legisl ation$____ (1.0) ^previousl y$____ (1.0) ^isl and$____ (1.0) ^Isl amic$____ (1.0) ^Musl im$____ (1.0) ^sl ightly$____ (1.0) ^sl ow$____ (1.0) ^Vl adimir$____ (1.0) ^z one$____(0.9) ^z ero$____(0.9) ^z ones$____(0.9) ^z oo$____(0.9) ^GO P$____ (0.9) ^CHICAGO $____ (0.9) ^DIEGO $____ (0.9) ^l ast$____(0.9) ^l ike$____(0.9) ^l eft$____(0.9) ^l ong$____(0.9) ^Ol ympic$____ (0.8) ^Ol ympics$____ (0.8) ^Ol d$____ (0.8) ^Ol mert$____ (0.8) Filter 16 (bias = -0.35) #
V
t
7
T
Q
D
8
u
9
m
X
o
6
.
x
c
4
w
"
g
3
-
W
r
<BOS>
y
Y
A
\194
z
5
U
^
e
Z
E
2
l
d
Q
f
W
s
X
U
Y
u
:
c
\194
%
"
F
q
m
(
D
7
y
;
L
V
o
!
n
)
j
z
M
P
-
J
Non-zero for 2.6% of words.
^VW $____ (1.2) ^Q ueen$____(0.8) ^Q aeda$____(0.8) ^Q uote$____(0.8) ^Q $____(0.8) ^W e$____(0.6) ^W ednesday$____(0.6) ^W ashington$____(0.6) ^W hen$____(0.6) ^X inhua$____(0.6) ^X $____(0.6) ^X VI$____(0.6) ^X box$____(0.6) ^X injiang$____(0.6) ^77 $____ (0.6) ^1977 $____ (0.6) ^1987 $____ (0.5) ^87 $____ (0.5) ^787 $____ (0.5) ^1997 $____ (0.5) ^197 0s$____ (0.5) ^197 9$____ (0.5) ^197 6$____ (0.5) ^197 2$____ (0.5) ^67 $____ (0.5) ^1967 $____ (0.5) ^Y ork$____(0.4) ^Y ou$____(0.4) ^Y ORK$____(0.4) ^Y et$____(0.4) ^Y oung$____(0.4) ^Y ahoo$____(0.4) ^Y ankees$____(0.4) ^Y ear$____(0.4) ^76 $____ (0.4) ^: $____(0.4) ^\194 \163$____(0.4) ^\194 \187$____(0.4) ^\194 \189$____(0.4) ^\194 \174$____(0.4) Filter 17 (bias = -0.47) #
y
v
,
b
O
J
/
<BOS>
H
j
C
B
1
z
Q
-
"
k
h
0
W
l
U
E
K
V
c
\195
p
w
8
R
d
T
3
9
L
g
f
q
X
-
,
u
l
s
5
k
D
b
K
R
O
'
6
?
L
r
W
)
1
U
p
w
A
g
/
v
T
.
7
f
0
m
\194
E
S
\195
2
j
Non-zero for 4.1% of words.
^styl e$____ (1.4) ^Tayl or$____ (1.4) ^Pennsyl vania$____ (1.4) ^Maryl and$____ (1.4) ^typ e$____ (1.3) ^Egyp t$____ (1.3) ^typ ically$____ (1.3) ^typ es$____ (1.3) ^MyS pace$____ (1.2) ^PlayS tation$____ (1.2) ^Twenty2 0$____ (1.2) ^anyt hing$____ (1.2) ^everyt hing$____ (1.2) ^Everyt hing$____ (1.2) ^rhyt hm$____ (1.2) ^yo u$____ (1.1) ^yo ur$____ (1.1) ^yo ung$____ (1.1) ^anyo ne$____ (1.1) ^sayi ng$____ (1.0) ^tryi ng$____ (1.0) ^playi ng$____ (1.0) ^payi ng$____ (1.0) ^buyi ng$____ (1.0) ^ya rds$____ (1.0) ^Roya l$____ (1.0) ^Rya n$____ (1.0) ^Kenya $____ (1.0) ^Syd ney$____ (1.0) ^Lloyd s$____ (1.0) ^everyd ay$____ (1.0) ^Lloyd $____ (1.0) ^Boyd $____ (1.0) ^Ryd er$____ (1.0) ^cyc le$____ (0.9) ^psyc hological$____ (0.9) ^boyc ott$____ (0.9) ^recyc ling$____ (0.9) ^ye ar$____ (0.9) ^ye ars$____ (0.9) Filter 18 (bias = -0.42) #
C
f
\194
-
0
y
V
p
X
o
Q
i
7
e
Y
O
Z
r
A
m
D
w
c
s
9
E
8
P
6
u
5
M
z
t
B
K
v
,
<BOS>
x
m
F
!
9
-
x
M
N
X
R
.
B
?
0
Y
5
:
8
Z
3
/
h
'
\$
;
S
y
4
l
C
V
7
g
2
G
E
w
1
b
n
Non-zero for 13.5% of words.
^100m $____ (1.7) ^200m $____ (1.7) ^10m $____ (1.7) ^400m $____ (1.7) ^Am erican$____ (1.6) ^Am erica$____ (1.6) ^Am ericans$____ (1.6) ^Am ong$____ (1.6) ^Dm itry$____ (1.5) ^m ore$____(1.2) ^m illion$____(1.2) ^m ost$____(1.2) ^m ade$____(1.2) ^m any$____(1.2) ^p.m .$____ (1.1) ^a.m .$____ (1.1) ^1m $____ (1.1) ^alm ost$____ (1.0) ^film $____ (1.0) ^film s$____ (1.0) ^calm $____ (1.0) ^Helm and$____ (1.0) ^Film $____ (1.0) ^Olm ert$____ (1.0) ^subm itted$____ (1.0) ^subm it$____ (1.0) ^subm arine$____ (1.0) ^subm ission$____ (1.0) ^judgm ent$____ (0.9) ^segm ent$____ (0.9) ^segm ents$____ (0.9) ^pragm atic$____ (0.9) ^judgm ents$____ (0.9) ^fragm ents$____ (0.9) ^2m $____ (0.9) ^governm ent$____ (0.9) ^Governm ent$____ (0.9) ^environm ent$____ (0.9) ^governm ents$____ (0.9) ^Im migration$____ (0.9) Filter 19 (bias = -0.33) #
x
m
v
u
9
U
8
H
0
y
5
g
6
M
B
i
7
-
q
r
\194
s
N
t
<BOS>
T
X
k
c
O
Q
P
W
A
2
j
a
G
4
E
Z
-
8
f
Q
p
X
t
9
l
&
j
4
d
)
v
3
m
?
e
2
i
U
o
5
x
K
r
7
k
A
T
V
'
(
P
L
;
G
%
Non-zero for 7.0% of words.
^1998 $____ (1.1) ^198 0s$____ (1.1) ^198 9$____ (1.1) ^198 8$____ (1.1) ^199 9$____ (1.0) ^199 0s$____ (1.0) ^199 7$____ (1.0) ^199 5$____ (1.0) ^exc hange$____ (1.0) ^Exc hange$____ (1.0) ^exc ept$____ (1.0) ^exc ellent$____ (1.0) ^exc lusive$____ (1.0) ^exc iting$____ (1.0) ^194 5$____ (1.0) ^94 $____ (1.0) ^194 8$____ (1.0) ^194 7$____ (1.0) ^88 $____ (1.0) ^193 0s$____ (0.9) ^93 $____ (0.9) ^193 3$____ (0.9) ^193 9$____ (0.9) ^193 4$____ (0.9) ^92 $____ (0.9) ^192 0s$____ (0.9) ^2008 $____ (0.9) ^2008 .$____ (0.9) ^08 $____ (0.9) ^108 $____ (0.9) ^95 $____ (0.9) ^195 0s$____ (0.9) ^195 9$____ (0.9) ^195 0$____ (0.9) ^197 0s$____ (0.9) ^197 9$____ (0.9) ^197 6$____ (0.9) ^197 2$____ (0.9) ^exa mple$____ (0.9) ^Texa s$____ (0.9) Filter 20 (bias = -0.57) #
7
t
V
y
X
o
8
m
Z
f
9
u
6
i
G
-
5
T
Q
k
J
'
<BOS>
p
b
,
E
O
4
n
0
h
2
c
L
w
3
M
F
r
f
g
B
D
F
G
S
?
x
c
,
.
K
Y
e
r
W
!
i
d
w
A
k
h
s
y
M
T
;
L
5
u
6
z
4
1
t
&
V
H
Non-zero for 15.9% of words.
^6f t$____ (1.4) ^5f t$____ (1.4) ^meaningf ul$____ (0.9) ^Springf ield$____ (0.9) ^bef ore$____ (0.9) ^lef t$____ (0.9) ^chief $____ (0.9) ^ef forts$____ (0.9) ^f or$____(0.9) ^f rom$____(0.9) ^f irst$____(0.9) ^f ound$____(0.9) ^f ormer$____(0.9) ^f our$____(0.9) ^Oxf ord$____ (0.8) ^Oxf ordshire$____ (0.8) ^Pf izer$____ (0.8) ^If $____ (0.8) ^GB $____ (0.7) ^Af ter$____ (0.7) ^Af ghanistan$____ (0.7) ^Af rica$____ (0.7) ^Af ghan$____ (0.7) ^Af rican$____ (0.7) ^7, 000$____ (0.7) ^17, 000$____ (0.7) ^half $____ (0.7) ^himself $____ (0.7) ^itself $____ (0.7) ^herself $____ (0.7) ^myself $____ (0.7) ^Gulf $____ (0.7) ^golf $____ (0.7) ^yourself $____ (0.7) ^EB ITDA$____ (0.7) ^UEF A$____ (0.6) ^Ve gas$____ (0.6) ^Ve nezuela$____ (0.6) ^Ve rizon$____ (0.6) ^Ve nezuelan$____ (0.6) Filter 21 (bias = -0.53) #
x
R
.
J
m
U
p
\195
d
r
t
9
y
u
h
N
e
B
F
Y
g
K
f
<EOS>
c
o
S
P
W
3
v
z
'
Z
I
T
n
Y
s
X
.
O
f
K
x
M
-
E
'
W
C
G
d
J
!
;
F
D
a
H
\$
B
c
0
?
"
p
3
k
1
I
L
u
6
w
Non-zero for 15.6% of words.
^FT SE$____ (2.1) ^FT $____ (2.1) ^OFT $____ (2.1) ^BST $____ (2.1) ^BOST ON$____ (2.1) ^HOUST ON$____ (2.1) ^EST $____ (2.1) ^WT O$____ (2.1) ^WT A$____ (2.1) ^iT unes$____ (2.0) ^T he$____(1.9) ^T his$____(1.9) ^T hey$____(1.9) ^T here$____(1.9) ^NAT O$____ (1.9) ^AT $____ (1.9) ^AT LANTA$____ (1.9) ^VAT $____ (1.9) ^LT TE$____ (1.9) ^EDT $____ (1.9) ^GMT $____ (1.9) ^MT V$____ (1.9) ^CCT V$____ (1.9) ^CT $____ (1.9) ^NOT $____ (1.8) ^OT C$____ (1.8) ^WASHINGT ON$____ (1.8) ^ET $____ (1.8) ^DET ROIT$____ (1.8) ^ET A$____ (1.8) ^IT $____ (1.7) ^IT V$____ (1.7) ^CIT Y$____ (1.7) ^EBIT DA$____ (1.7) ^BT $____ (1.7) ^N.Y .$____ (1.6) ^D-N.Y .$____ (1.6) ^YouT ube$____ (1.6) ^Y ork$____(1.3) ^Y ou$____(1.3) Filter 22 (bias = -0.56) #
2
-
5
.
K
m
3
b
1
g
6
'
4
r
8
u
9
<BOS>
,
v
0
l
7
k
B
t
W
j
D
h
U
f
P
q
J
x
X
d
I
s
Q
e
Y
J
"
n
'
j
\194
d
&
-
;
w
k
2
:
D
W
E
S
1
V
f
R
L
(
0
5
F
g
p
i
%
Non-zero for 5.1% of words.
^TOKY O$____ (2.1) ^2m $____ (1.0) ^12t h$____ (1.0) ^15t h$____ (1.0) ^25t h$____ (1.0) ^5t h$____ (1.0) ^1b n$____ (1.0) ^3m $____ (1.0) ^13t h$____ (1.0) ^2, 000$____ (1.0) ^2, 500$____ (1.0) ^12, 000$____ (1.0) ^22, 000$____ (1.0) ^5, 000$____ (1.0) ^25, 000$____ (1.0) ^15, 000$____ (1.0) ^35, 000$____ (1.0) ^1m $____ (0.9) ^11t h$____ (0.9) ^3, 000$____ (0.9) ^3, 500$____ (0.9) ^13, 000$____ (0.9) ^1, 000$____ (0.9) ^1, 500$____ (0.9) ^1, 200$____ (0.9) ^11, 000$____ (0.9) ^2. 5$____ (0.9) ^2. 2$____ (0.9) ^2. 3$____ (0.9) ^2. 4$____ (0.9) ^2. 7$____ (0.9) ^2. 6$____ (0.9) ^2. 1$____ (0.9) ^2. 8$____ (0.9) ^5. 5$____ (0.9) ^5. 7$____ (0.9) ^5. 2$____ (0.9) ^5. 4$____ (0.9) ^U.K. $____ (0.9) ^K. $____ (0.9) Filter 23 (bias = -0.81) #
9
t
3
m
J
.
2
k
6
'
1
r
8
T
5
A
7
c
4
y
0
f
Z
g
X
b
K
l
G
s
E
h
P
<BOS>
<EOS>
S
N
v
R
U
?
l
U
j
y
x
w
F
u
L
W
S
"
5
O
f
Z
h
r
7
!
0
k
6
M
J
R
\194
E
e
-
%
D
v
\$
b
Non-zero for 7.5% of words.
^Ju ne$____ (2.6) ^Ju ly$____ (2.6) ^Ju stice$____ (2.6) ^Ju st$____ (2.6) ^3r d$____ (2.5) ^23r d$____ (2.5) ^19- year-old$____ (2.5) ^29- year-old$____ (2.5) ^39- year-old$____ (2.5) ^9- year-old$____ (2.5) ^3- 0$____ (2.4) ^3- 1$____ (2.4) ^3- 2$____ (2.4) ^3- pointer$____ (2.4) ^1991 $____ (2.4) ^91 1$____ (2.4) ^91 $____ (2.4) ^1992 $____ (2.4) ^92 $____ (2.4) ^192 0s$____ (2.4) ^3G $____ (2.4) ^1993 $____ (2.4) ^193 0s$____ (2.4) ^93 $____ (2.4) ^193 3$____ (2.4) ^Jr $____ (2.4) ^Jr .$____ (2.4) ^31 $____ (2.4) ^31 -year-old$____ (2.4) ^32 $____ (2.3) ^32 -year-old$____ (2.3) ^33 $____ (2.3) ^JE RUSALEM$____ (2.3) ^3m $____ (2.3) ^2- 1$____ (2.2) ^2- 0$____ (2.2) ^22- year-old$____ (2.2) ^2- 2$____ (2.2) ^1998 $____ (2.2) ^198 0s$____ (2.2) Filter 24 (bias = -0.34) #
A
-
B
g
N
v
K
d
,
j
a
u
Q
m
L
M
/
'
S
G
W
T
5
J
F
p
I
D
U
c
8
e
3
i
9
\163
<EOS>
0
X
P
E
y
V
h
Q
o
I
u
X
d
w
D
z
n
S
c
2
m
s
H
)
p
Z
x
b
L
J
.
G
q
j
T
9
l
4
1
5
f
k
t
Non-zero for 9.4% of words.
^IAE A$____ (0.9) ^UAE $____ (0.9) ^BAE $____ (0.9) ^BE IJING$____ (0.8) ^BE RLIN$____ (0.8) ^NE W$____ (0.8) ^NASDAQ $____ (0.7) ^DENV ER$____ (0.6) ^AI G$____ (0.6) ^AI DS$____ (0.6) ^DAX $____ (0.6) ^Aw ards$____ (0.6) ^Aw ard$____ (0.6) ^Aw akening$____ (0.6) ^Az erbaijan$____ (0.5) ^Az iz$____ (0.5) ^WAS HINGTON$____ (0.5) ^NAS A$____ (0.5) ^NAS CAR$____ (0.5) ^LAS $____ (0.5) ^VEGAS $____ (0.5) ^AS $____ (0.5) ^DALLAS $____ (0.5) ^FBI $____ (0.5) ^RBI $____ (0.5) ^EBI TDA$____ (0.5) ^RBI s$____ (0.5) ^As $____ (0.5) ^As sociation$____ (0.5) ^As sociated$____ (0.5) ^As ia$____ (0.5) ^As ian$____ (0.5) ^As sembly$____ (0.5) ^As hley$____ (0.5) ^ANGELE S$____ (0.5) ^JERUSALE M$____ (0.5) ^SEATTLE $____ (0.5) ^AZ UZ$____ (0.5) ^Ab out$____ (0.5) ^Ab u$____ (0.5) Filter 25 (bias = -0.42) #
R
y
J
p
9
m
0
-
D
i
B
w
8
g
<BOS>
h
7
.
z
W
5
a
K
f
N
H
L
t
C
'
6
x
j
q
U
d
\195
e
T
n
J
t
K
h
0
f
G
s
X
F
9
k
z
y
Z
S
2
u
5
m
8
'
\195
H
6
\$
3
.
7
i
1
d
D
x
o
A
&
j
N
r
Non-zero for 3.2% of words.
^YORK $____ (0.5) ^DJ $____ (0.4) ^90 $____ (0.4) ^1990 s$____ (0.4) ^1990 $____ (0.4) ^90 0$____ (0.4) ^200 8$____ (0.4) ^200 9$____ (0.4) ^200 7$____ (0.4) ^200 6$____ (0.4) ^100 $____ (0.4) ^200 5$____ (0.4) ^200 4$____ (0.4) ^200 3$____ (0.4) ^199 9$____ (0.3) ^199 7$____ (0.3) ^199 8$____ (0.3) ^199 5$____ (0.3) ^09 $____ (0.3) ^92 $____ (0.3) ^192 0s$____ (0.3) ^Ro bert$____ (0.2) ^Ro yal$____ (0.2) ^Ro ad$____ (0.2) ^Ro ck$____ (0.2) ^95 $____ (0.2) ^195 0s$____ (0.2) ^195 9$____ (0.2) ^195 0$____ (0.2) ^198 0s$____ (0.2) ^198 9$____ (0.2) ^198 8$____ (0.2) ^198 0$____ (0.2) ^198 4$____ (0.2) ^202 0$____ (0.2) ^02 $____ (0.2) ^102 $____ (0.2) ^PRN ewswire$____ (0.2) ^PRN ewswire-FirstCall$____ (0.2) ^PRN ewswire-USNewswire$____ (0.2) Filter 26 (bias = -0.45) #
<BOS>
h
Q
g
X
y
P
x
\194
A
I
c
R
i
/
e
^
H
9
a
'
o
"
E
z
.
V
u
J
t
7
w
p
S
m
F
'
E
C
T
n
e
V
D
!
2
Q
U
.
O
k
u
\194
1
x
y
R
%
/
L
:
J
?
H
-
\163
f
K
Z
W
s
a
b
0
w
Non-zero for 9.5% of words.
^QC $____ (1.5) ^' s$____(1.4) ^' t$____(1.4) ^' $____(1.4) ^' re$____(1.4) ^PC $____ (1.2) ^IPC C$____ (1.2) ^PC s$____ (1.2) ^MPC $____ (1.2) ^CHIC AGO$____ (1.2) ^FDIC $____ (1.2) ^IC E$____ (1.2) ^IC C$____ (1.2) ^FARC $____ (1.1) ^SOURC E$____ (1.1) ^HMRC $____ (1.1) ^In $____ (1.1) ^In ternational$____ (1.1) ^In dia$____ (1.1) ^In c$____ (1.1) ^In ternet$____ (1.1) ^In dian$____ (1.1) ^In stitute$____ (1.1) ^In stead$____ (1.1) ^C hina$____(1.0) ^C ity$____(1.0) ^C linton$____(1.0) ^C ourt$____(1.0) ^XV I$____ (1.0) ^n ot$____(0.9) ^n ew$____(0.9) ^n o$____(0.9) ^n ow$____(0.9) ^n ext$____(0.9) ^Kuzn etsova$____ (0.9) ^HIV $____ (0.8) ^IV $____ (0.8) ^Q. $____ (0.8) ^FCC $____ (0.8) ^Kn ight$____ (0.8) Filter 27 (bias = -0.30) #
Z
p
.
f
/
x
A
e
Q
o
L
i
U
P
Y
S
H
O
X
v
V
E
^
t
u
j
\194
k
C
F
<BOS>
r
<EOS>
\163
K
T
,
l
h
X
y
/
k
\194
u
&
g
:
c
Q
r
L
H
K
E
J
U
6
?
5
)
z
T
!
i
\163
a
F
s
1
p
Non-zero for 21.1% of words.
^Al l$____ (1.5) ^Al though$____ (1.5) ^Al $____ (1.5) ^Al so$____ (1.5) ^Ll oyds$____ (1.5) ^Ll oyd$____ (1.5) ^Ul ster$____ (1.4) ^Ul timately$____ (1.4) ^Vl adimir$____ (1.2) ^DAX $____ (1.2) ^l ast$____(1.2) ^l ike$____(1.2) ^l eft$____(1.2) ^l ong$____(1.2) ^woul d$____ (1.1) ^coul d$____ (1.1) ^shoul d$____ (1.1) ^resul ts$____ (1.1) ^Cl inton$____ (1.1) ^Cl ub$____ (1.1) ^Cl eveland$____ (1.1) ^Cl ark$____ (1.1) ^Cl ick$____ (1.1) ^Cl imate$____ (1.1) ^N.F.L .$____ (1.0) ^U.K .$____ (1.0) ^Kreml in$____ (1.0) ^firml y$____ (1.0) ^Toml inson$____ (1.0) ^Daiml er$____ (1.0) ^farml and$____ (1.0) ^randoml y$____ (1.0) ^N.J .$____ (1.0) ^1.6 $____ (0.9) ^0.6 $____ (0.9) ^2.6 $____ (0.9) ^3.6 $____ (0.9) ^1.5 $____ (0.9) ^2.5 $____ (0.9) ^3.5 $____ (0.9) Filter 28 (bias = -0.51) #
-
c
u
F
i
D
a
j
W
C
Y
M
H
g
I
0
\195
e
U
S
<BOS>
G
R
t
q
5
"
A
'
T
w
K
o
L
Z
E
B
Q
p
X
-
Y
f
&
x
"
v
(
m
7
g
8
n
Z
d
\194
.
6
c
4
o
/
w
9
b
3
y
W
a
H
h
2
k
V
r
t
Non-zero for 0.9% of words.
^al-Q aida$____ (2.3) ^al-Q aeda$____ (2.3) ^Al-Q aeda$____ (2.3) ^6-7 $____ (1.5) ^7-6 $____ (1.4) ^4-6 $____ (1.4) ^3-6 $____ (1.4) ^6-4 $____ (1.4) ^5-4 $____ (1.4) ^3-4 $____ (1.4) ^6-3 $____ (1.4) ^4-3 $____ (1.4) ^2-3 $____ (1.4) ^1-3 $____ (1.4) ^6-2 $____ (1.3) ^3-2 $____ (1.3) ^2-2 $____ (1.3) ^1-2 $____ (1.3) ^7-5 $____ (1.2) ^10-K $____ (1.2) ^PRNewswire-U SNewswire$____ (1.2) ^Wal-M art$____ (1.1) ^al-M aliki$____ (1.1) ^T-M obile$____ (1.1) ^2-1 $____ (1.1) ^6-1 $____ (1.1) ^3-1 $____ (1.1) ^1-1 $____ (1.1) ^D-N .Y.$____ (1.1) ^All-S tar$____ (1.0) ^al-S adr$____ (1.0) ^3-D $____ (0.9) ^Secretary-G eneral$____ (0.9) ^non-G AAP$____ (0.9) ^African-A merican$____ (0.8) ^African-A mericans$____ (0.8) ^anti-A merican$____ (0.8) ^2-0 $____ (0.8) ^1-0 $____ (0.8) ^3-0 $____ (0.8) Filter 29 (bias = -0.48) #
P
o
V
u
C
v
p
-
F
t
Z
T
G
w
Q
N
7
q
X
.
8
E
L
W
5
h
6
e
4
M
S
B
K
O
,
J
3
<BOS>
A
D
V
y
:
c
'
T
\194
p
/
d
Q
D
Z
\163
s
h
S
1
&
g
l
r
J
P
(
O
X
G
n
0
b
a
j
q
w
v
5
u
t
Non-zero for 5.8% of words.
^MPs $____ (1.2) ^GPs $____ (1.2) ^GPS $____ (1.2) ^TVs $____ (1.1) ^PCs $____ (1.1) ^BCS $____ (1.1) ^Pl ease$____ (1.1) ^Pl ace$____ (1.1) ^Pl us$____ (1.1) ^Pl an$____ (1.1) ^Pl ans$____ (1.1) ^Pl ymouth$____ (1.1) ^Pl ayers$____ (1.1) ^Pl ayer$____ (1.1) ^Vl adimir$____ (1.1) ^XV I$____ (1.1) ^Cl inton$____ (1.1) ^Cl ub$____ (1.1) ^Cl eveland$____ (1.1) ^Cl ark$____ (1.1) ^Cl ick$____ (1.1) ^Cl imate$____ (1.1) ^Cl arke$____ (1.1) ^Cl emens$____ (1.1) ^PB S$____ (1.0) ^JPM organ$____ (0.9) ^PM $____ (0.9) ^groups $____ (0.9) ^troops $____ (0.9) ^perhaps $____ (0.9) ^steps $____ (0.9) ^collaps e$____ (0.9) ^helps $____ (0.9) ^collaps ed$____ (0.9) ^CB S$____ (0.9) ^ECB $____ (0.9) ^CB I$____ (0.9) ^Pf izer$____ (0.9) ^PR Newswire$____ (0.9) ^PR Newswire-FirstCall$____ (0.9) Filter 30 (bias = -0.31) #
h
m
q
<BOS>
1
f
H
-
N
s
A
'
7
z
4
P
8
U
3
M
0
b
2
K
9
V
5
l
a
w
W
G
6
k
Y
p
x
Z
D
v
Q
-
A
v
&
j
(
J
!
u
/
f
C
e
Z
d
X
m
N
i
U
o
,
g
"
M
a
T
?
p
:
x
K
l
8
0
W
E
Y
t
Non-zero for 9.2% of words.
^NASDAQ $____ (0.9) ^THA T$____ (0.8) ^NA TO$____ (0.8) ^NA SA$____ (0.8) ^DNA $____ (0.8) ^NA SCAR$____ (0.8) ^NCAA $____ (0.7) ^FAA $____ (0.7) ^GAA P$____ (0.7) ^AA A$____ (0.7) ^non-GAA P$____ (0.7) ^BAA $____ (0.7) ^AA $____ (0.7) ^tha t$____ (0.7) ^ha ve$____ (0.7) ^ha s$____ (0.7) ^ha d$____ (0.7) ^McQ ueen$____ (0.6) ^WA SHINGTON$____ (0.6) ^WA M$____ (0.6) ^Q ueen$____(0.5) ^Q aeda$____(0.5) ^Q uote$____(0.5) ^Q $____(0.5) ^FDA $____ (0.5) ^BAGHDA D$____ (0.5) ^EBITDA $____ (0.5) ^DA X$____ (0.5) ^NBA $____ (0.5) ^BA $____ (0.5) ^ISLAMABA D$____ (0.5) ^BA E$____ (0.5) ^thr ee$____ (0.5) ^thr ough$____ (0.5) ^thr eat$____ (0.5) ^thr oughout$____ (0.5) ^FRANC ISCO$____ (0.4) ^ANC $____ (0.4) ^CIA $____ (0.4) ^IA EA$____ (0.4) Filter 31 (bias = -0.47) #
O
v
G
B
E
x
3
q
2
b
K
.
g
k
S
h
1
F
i
f
s
t
o
n
P
\194
z
a
I
u
-
m
Y
c
J
T
y
'
5
l
y
v
!
J
?
B
Q
k
O
R
\$
z
"
b
:
j
W
0
(
T
H
-
/
l
L
u
8
)
,
n
F
\195
X
V
S
9
d
o
3
t
Non-zero for 9.6% of words.
^Ey e$____ (1.3) ^GO P$____ (1.3) ^CHICAGO $____ (1.3) ^DIEGO $____ (1.3) ^MOSCOW $____ (1.1) ^Ky i$____ (1.1) ^Ky oto$____ (1.1) ^Ky le$____ (1.1) ^Ky $____ (1.1) ^energy $____ (1.1) ^technology $____ (1.1) ^strategy $____ (1.1) ^Energy $____ (1.1) ^Egy pt$____ (1.1) ^BAGH DAD$____ (1.0) ^AOL $____ (1.0) ^Sy ria$____ (1.0) ^Sy stems$____ (1.0) ^Sy dney$____ (1.0) ^Sy stem$____ (1.0) ^Sy rian$____ (1.0) ^Sy racuse$____ (1.0) ^Sy mphony$____ (1.0) ^G8 $____ (1.0) ^OF $____ (1.0) ^OF T$____ (1.0) ^FOX $____ (1.0) ^FOX News.com$____ (1.0) ^Diy ala$____ (1.0) ^sy stem$____ (1.0) ^easy $____ (1.0) ^sy stems$____ (1.0) ^Pennsy lvania$____ (1.0) ^busy $____ (1.0) ^LOS $____ (1.0) ^HBOS $____ (1.0) ^BOS TON$____ (1.0) ^OS $____ (1.0) ^Od inga$____ (1.0) ^employ ees$____ (1.0)