Topic Model Everything¶
In this notebook, which is more of an exploration that proof of a conclusion, I try topic modeling "everything" (all 800+ novels in the Muncie Gutenberg corpus, plus a few other things, like True as Steel, which we've added), in total, 885 novels.
I'm expecially interested in five novels (Red Rock, Uncle Tom's Cabin, True as Steel, The house behind the cedars, and The villa on the Rhine), so I tend to single them out whenever it's convenient to do so. I'm also flagging Jane Eyre because there ends up being something interesting with it . . .
The next eight cells . . .¶
. . . are the code necessary to ingest texts, find "stopwords", topic model, etc.
In [1]:
PATH_TO_CORPUS = '/home/spenteco/0/corpora/muncie_public_library_corpus/'
CORPUS_SUBFOLDERS = ['PG_no_backmatter_fiction/']
In [2]:
import glob, codecs, re
def load_corpus(stopwords):
split_re = re.compile(r'\s|\,|\.|\/|\<|\>|\?|\;|\'|\:|\"|\[|\]|\{|\}|\`|\~|\!|\@|\#|\$|\%|\^|\&|\*|\(|\)|\-|\_|\=|\+|\“|\”|\‘|\’|\‹|\›|\«|\»|\*'.decode('utf-8'),
re.UNICODE)
labels = []
texts = []
n_loaded = 0
for subfolder in CORPUS_SUBFOLDERS:
for p in glob.glob(PATH_TO_CORPUS + subfolder + '*.txt'):
label = p.split('/')[-1]
labels.append(label)
tokens = []
for t in re.split(split_re, codecs.open(p, 'r', encoding='utf-8').read()):
if t > '' and t.lower() not in stopwords:
tokens.append(t.lower())
texts.append(tokens)
n_loaded += 1
if n_loaded % 100 == 0:
print n_loaded, 'loaded'
print 'len(labels)', len(labels)
print 'len(texts)', len(texts)
return labels, texts
In [3]:
labels, texts = load_corpus(set([]))
100 loaded 200 loaded 300 loaded 400 loaded 500 loaded 600 loaded 700 loaded 800 loaded len(labels) 885 len(texts) 885
In [4]:
from gensim import corpora, models, similarities
gensim_dictionary = corpora.Dictionary(texts)
gensim_corpus = [gensim_dictionary.doc2bow(text) for text in texts]
tfidf_model = models.TfidfModel(gensim_corpus)
document_frequencies = dict([(gensim_dictionary[word], (float(document_count) / len(texts)))
for word, document_count in tfidf_model.dfs.iteritems()])
/home/spenteco/anaconda2/envs/py2/lib/python2.7/site-packages/requests/__init__.py:80: RequestsDependencyWarning: urllib3 (1.22) or chardet (2.3.0) doesn't match a supported version! RequestsDependencyWarning)
The "stopword" process¶
What I'm calling "stopwords" are any words which appear in 95% or more of the novels, or in 5% or less. Topic modeling tends to not handle these words especially well.
Note: The 5% lower bound may be too low. I need to think more about this, and about how it might me influencing some of the similarities I find below.
In [5]:
stopwords = []
for word, df in document_frequencies.iteritems():
if df <= 0.05 or df >= 0.95:
stopwords.append(word)
print 'len(document_frequencies)', len(document_frequencies)
print 'len(stopwords)', len(stopwords)
len(document_frequencies) 213767 len(stopwords) 189962
Reload the texts . . .¶
. . . now that we know our stopwords, then topic model. Note that I'm asking for 25 topics.
In [6]:
labels, texts = load_corpus(set(stopwords))
100 loaded 200 loaded 300 loaded 400 loaded 500 loaded 600 loaded 700 loaded 800 loaded len(labels) 885 len(texts) 885
In [7]:
from gensim import corpora, models, similarities
from gensim.models.wrappers import LdaMallet
N_TOPICS = 25
gensim_dictionary = corpora.Dictionary(texts)
gensim_corpus = [gensim_dictionary.doc2bow(text) for text in texts]
print 'len(gensim_dictionary)', len(gensim_dictionary)
print 'len(gensim_corpus)', len(gensim_corpus)
lda_model = LdaMallet('/home/spenteco/0/mallet-2.0.8/bin/mallet',
corpus=gensim_corpus,
id2word=gensim_dictionary,
optimize_interval=10,
num_topics=N_TOPICS)
gensim_lda_corpus = lda_model[gensim_corpus]
print
print 'len(gensim_lda_corpus)', len(gensim_lda_corpus)
len(gensim_dictionary) 23805 len(gensim_corpus) 885 len(gensim_lda_corpus) 885
In [8]:
from collections import defaultdict, Counter
topic_word_counts = defaultdict(lambda: defaultdict(int))
word_topics = lda_model.load_word_topics()
for topic_n, word_counts in enumerate(word_topics):
for word_n, word_count in enumerate(word_counts):
topic_word_counts[topic_n][gensim_dictionary[word_n]] = word_count
What are the results?¶
These results change with every run (more about that later).
I'm only listing topic words for topics which occur > 10% of my 6 novels of interest. I especially want to note two things: 1) the similar percentages for topics 6 and 7 for True as Steel and Jane Eyre; 2) most of Villa Eden is in one topic (4), which seems to be a very German topic, perhaps just because of the presence of words like "herr", "von", and "frau".
In [9]:
import textwrap
for topic_n in range(N_TOPICS):
has_one = False
for a, doc in enumerate(gensim_lda_corpus):
for t in doc:
if t[0] == topic_n and t[1] > 0.1:
if 'Uncle_Tom' in labels[a] or 'Red_Rock' in labels[a] or 'Villa_Eden' in labels[a] or \
'House_Behind' in labels[a] or 'True_as_Steel' in labels[a] or \
'Jane_Eyre' in labels[a]:
has_one = True
if has_one == True:
print
print 'TOPIC', topic_n
print
for a, doc in enumerate(gensim_lda_corpus):
for t in doc:
if t[0] == topic_n and t[1] > 0.1:
if 'Uncle_Tom' in labels[a] or 'Red_Rock' in labels[a] or 'Villa_Eden' in labels[a] or \
'House_Behind' in labels[a] or 'True_as_Steel' in labels[a] or \
'Jane_Eyre' in labels[a]:
print '%.02f' % t[1], labels[a]
printed_words = []
for w in Counter(topic_word_counts[topic_n]).most_common(100):
printed_words.append(w[0] + ' ' + str(int(w[1])))
print '\n\t' + '\n\t'.join(textwrap.wrap('; '.join(printed_words), 80))
TOPIC 2 0.17 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.26 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.26 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt ll 11550; ve 7561; ye 7340; ain 6858; em 6547; de 5834; didn 4332; jim 3379; dat 3241; goin 3066; ter 2754; yer 2690; git 2603; big 2553; wouldn 2493; jest 2454; reckon 2388; judge 2342; mrs 2237; fer 2189; couldn 2140; folks 2096; uncle 2042; billy 2027; ef 1994; joe 1939; war 1936; thar 1864; fur 1782; er 1732; en 1709; nothin 1690; guess 1542; kin 1476; mighty 1453; miss 1445; doctor 1432; bout 1363; lot 1349; dey 1318; sez 1249; agin 1222; ole 1193; im 1192; hat 1189; wid 1124; judith 1122; yo 1103; exclaimed 1083; woods 1018; law 1017; feller 1006; lord 1005; wagon 995; bill 976; hadn 938; bein 915; brother 915; knowed 914; warn 911; dollars 885; hev 883; aunt 881; negro 879; george 876; nigger 874; comin 870; cabin 863; dis 860; hain 849; gal 840; wall 832; wasn 830; remarked 809; pose 804; gwine 793; wa 785; dog 766; lookin 762; sam 755; mornin 748; seed 744; tom 742; store 727; doin 723; hoss 722; fool 718; charlotte 717; virginian 715; county 708; fust 705; finally 697; miller 679; bud 678; se 674; office 671; burr 670; horses 664; arter 661; fence 658 TOPIC 4 0.56 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt herr 5101; von 4482; roland 3181; frau 3076; anna 2093; uncle 1830; baron 1821; princess 1743; brother 1682; doctor 1617; castle 1588; garden 1517; forest 1477; ah 1382; husband 1320; countess 1290; daughter 1244; court 1244; carriage 1227; beneath 1175; baroness 1170; prince 1110; manna 1105; elizabeth 1087; aunt 1082; german 1057; glance 1045; count 1008; sister 993; hans 943; letter 897; bella 893; chapter 882; exclaimed 880; hall 863; glass 829; soul 824; maid 824; interrupted 822; figure 806; highness 783; ladies 747; hastily 740; path 739; lovely 735; future 734; evidently 727; scarcely 722; servant 715; terrible 699; trees 698; obliged 687; position 665; quickly 664; angry 659; flowers 651; windows 641; hat 639; pray 639; perfectly 638; immediately 636; servants 633; heaven 632; duchess 631; law 626; creature 624; whispered 615; kitty 613; physician 612; wall 607; professor 607; heavens 606; noble 593; allowed 593; declared 593; villa 587; major 586; cheeks 584; yard 583; rooms 582; flora 582; charming 581; writing 579; paper 564; madame 563; picture 562; grandmother 559; gertrude 551; brow 551; entire 547; human 547; proud 545; breast 542; yesterday 542; mistress 539; president 537; dog 537; smiled 530; gazed 529; delicate 528 TOPIC 6 0.21 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.22 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt 0.11 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt character 5527; exclaimed 4901; countenance 4619; appearance 4208; feelings 3854; party 3758; object 3681; companion 3623; observed 3269; stranger 3102; circumstances 3079; occasion 2970; secret 2945; youth 2697; justice 2684; features 2681; proceeded 2665; instant 2484; situation 2386; influence 2337; opinion 2309; formed 2293; immediately 2282; apartment 2245; respect 2176; heaven 2175; degree 2153; glance 2139; conduct 2094; daughter 2019; human 2008; scarcely 1991; interrupted 1985; rendered 1979; succeeded 1968; period 1941; judge 1935; resumed 1929; confidence 1913; chapter 1902; worthy 1899; fate 1893; occupied 1885; regard 1868; notwithstanding 1830; sufficient 1791; supposed 1787; direction 1786; language 1766; approached 1762; determined 1755; opportunity 1748; law 1744; blood 1738; sister 1734; attempt 1720; possession 1719; escape 1717; persons 1701; cast 1699; advantage 1692; advanced 1689; condition 1663; success 1660; command 1654; seated 1649; disposed 1647; distant 1632; peculiar 1631; slight 1620; bosom 1606; expressed 1602; affection 1578; grave 1565; uttered 1563; prisoner 1561; intended 1559; vain 1556; husband 1554; brother 1552; presented 1550; possessed 1546; circumstance 1546; events 1541; receive 1538; approach 1536; ordinary 1532; necessity 1531; render 1526; melancholy 1526; fortune 1524; honest 1500; pause 1496; ear 1489; greater 1474; instantly 1463; produced 1462; hopes 1462; effort 1460; required 1456 TOPIC 7 0.28 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.14 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.12 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.23 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt soul 7707; sweet 5192; beauty 4644; loved 4312; heaven 3739; flowers 3506; soft 3373; human 3303; shadow 3301; faith 3273; figure 3178; grave 2838; sea 2751; beneath 2738; music 2714; sky 2587; dream 2568; lifted 2549; golden 2518; gold 2380; tender 2356; passion 2344; calm 2330; youth 2311; gentle 2310; joy 2292; blood 2207; wind 2206; trees 2196; women 2191; gray 2188; fingers 2167; lovely 2162; scarcely 2139; sunshine 2138; cheek 2135; picture 2108; chapter 2098; bent 2089; bosom 2051; sad 2038; features 2022; angel 1971; pure 1966; proud 1963; pain 1960; delicate 1959; leaves 1937; darkness 1891; ah 1868; garden 1867; faint 1863; storm 1849; memory 1844; peace 1839; solemn 1838; noble 1822; gaze 1807; glance 1793; lover 1778; sorrow 1769; marble 1769; creature 1767; smiled 1761; touched 1760; gently 1722; terrible 1716; grey 1715; dim 1703; tall 1702; husband 1699; shadows 1695; forehead 1685; glory 1655; stone 1648; silver 1637; brow 1637; minister 1636; chamber 1635; moon 1623; stars 1622; happiness 1610; brain 1600; softly 1595; dreams 1586; walls 1581; cloud 1578; paused 1570; forever 1567; shining 1566; countenance 1541; brown 1501; hall 1493; summer 1490; daughter 1479; shone 1476; bitter 1472; breast 1470; path 1462; gathered 1452 TOPIC 15 0.13 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt mr 17103; mrs 15019; mary 12960; miss 7521; ellen 6487; aunt 5108; lucy 4406; sister 4391; fanny 3786; guy 3326; brother 3249; elizabeth 3207; uncle 3163; robert 2397; arthur 2358; louis 2336; hamilton 2289; jane 2205; mamma 2188; harold 2154; letter 1979; catherine 1836; gilbert 1824; amy 1814; dr 1726; husband 1688; cousin 1634; pain 1491; comfort 1486; charles 1416; edward 1396; papa 1377; squire 1371; feelings 1329; tea 1314; julia 1275; laura 1275; daughter 1259; school 1238; caroline 1232; maria 1216; fortune 1164; garden 1143; happiness 1128; chapter 1114; loved 1111; smiling 1082; olive 1030; kindness 1026; charlotte 1016; affection 1007; valentine 983; handsome 976; dinner 976; sweet 976; obliged 962; fond 956; ll 955; write 939; angry 934; sad 902; sorrow 884; stairs 861; exclaimed 859; alfred 854; spite 851; girls 849; temper 849; fred 846; married 841; ladies 837; talked 835; sisters 828; hall 822; books 808; opinion 808; marriage 800; fancy 800; doctor 799; joy 798; dare 796; promise 791; sally 788; breakfast 783; captain 782; grave 782; letters 781; hyde 778; carriage 763; spirits 752; perfectly 751; gentle 748; hoped 748; william 743; vicar 743; party 738; reading 733; nurse 730; fault 726; beauty 721 TOPIC 17 0.27 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt colonel 8732; captain 8436; major 5462; war 4706; officer 4014; army 3303; lieutenant 3295; soldier 3152; officers 2825; soldiers 2703; sergeant 2572; ll 2450; camp 2376; enemy 2334; battle 2245; virginia 2153; fight 2094; river 2057; regiment 1950; fort 1912; gray 1888; rebel 1869; british 1868; command 1867; shot 1858; troops 1795; jack 1786; washington 1773; horses 1695; field 1595; march 1593; rebels 1569; wounded 1569; union 1559; mr 1531; orders 1496; guard 1486; south 1453; military 1414; commander 1410; flag 1381; rode 1324; prisoner 1303; party 1269; quarters 1266; american 1246; woods 1233; prisoners 1220; guns 1201; north 1196; news 1155; cavalry 1122; butler 1121; lines 1120; government 1108; gun 1091; rear 1083; governor 1049; de 1023; ride 1008; chief 995; instant 984; brave 976; report 974; fighting 965; honor 962; ordered 956; saddle 950; uniform 938; york 930; indian 929; miles 926; city 921; post 920; hill 916; negro 889; ray 888; walter 870; ladies 861; shouted 852; corporal 842; americans 840; lee 828; stephen 809; sword 795; riding 794; boys 791; leech 786; letter 780; force 777; confederate 774; troop 774; corps 767; states 752; fired 749; yankee 727; blood 715; fought 712; garrison 709; exclaimed 705 TOPIC 21 0.12 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt ve 6267; letter 5145; women 4740; marry 4023; husband 3959; ll 3696; position 3618; smiled 3410; loved 3407; married 3267; quickly 2758; marriage 2647; paused 2239; london 2189; didn 2186; figure 2183; mere 2148; remembered 2126; understood 2091; miss 2083; write 2075; beatrice 2054; secret 2048; brother 1975; isn 1909; presently 1894; note 1885; suggested 1829; news 1822; ah 1814; doesn 1805; instant 1799; street 1775; noticed 1774; big 1772; simply 1757; glanced 1755; glass 1749; paper 1736; daughter 1735; letters 1716; surprised 1716; glance 1714; exclaimed 1712; jack 1710; doctor 1691; talked 1687; dinner 1679; wondered 1675; count 1674; sister 1638; bit 1635; conscious 1629; perfectly 1627; believed 1625; future 1624; hat 1609; pause 1594; laura 1568; brown 1555; wrote 1545; train 1537; companion 1531; angry 1524; effort 1518; clock 1511; altogether 1501; spite 1494; writing 1482; fingers 1482; simple 1460; hurt 1460; san 1446; speech 1438; carriage 1432; evidently 1407; nodded 1405; observed 1403; smiling 1399; softly 1391; hesitated 1389; explained 1376; touched 1368; nervous 1365; station 1361; hall 1346; situation 1345; promise 1339; expect 1331; remarked 1326; society 1320; relief 1316; servant 1313; matters 1312; wondering 1298; dull 1287; fancy 1286; circumstances 1282; law 1281; apparently 1279 TOPIC 22 0.28 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.13 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.16 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt mrs 23683; mr 21761; miss 20403; dr 4833; helen 4566; ll 3842; doctor 3407; chapter 2977; ruth 2914; letter 2904; annie 2602; husband 2568; ve 2286; emily 1937; daughter 1855; aunt 1799; parlor 1677; van 1657; scarcely 1634; girls 1628; school 1567; hazel 1547; regard 1545; future 1537; meeting 1519; graham 1491; promise 1480; respect 1461; character 1420; color 1412; sympathy 1411; experience 1381; honor 1362; exclaimed 1360; gentleman 1360; grace 1340; york 1321; expect 1320; city 1313; position 1298; jane 1296; faith 1290; effort 1253; sister 1232; marion 1231; influence 1200; believed 1195; glance 1168; society 1152; simply 1130; evidently 1128; dinner 1111; favor 1102; cousin 1092; note 1092; patient 1089; christian 1086; honest 1065; women 1062; church 1059; comfort 1057; isn 1052; circumstances 1049; dare 1043; moments 1040; pain 1035; decided 1030; pardon 1029; brother 1029; soul 1017; deeply 1017; gregory 1015; feelings 1015; sick 1004; result 1004; paper 991; forgive 990; simple 988; sad 988; roger 988; weak 986; heaven 981; hoped 980; recognized 973; confidence 970; quickly 969; kindly 968; greatly 962; conscious 957; prove 951; nurse 949; dale 947; kindness 946; opinion 945; growing 945; spite 933; impression 933; remarked 913; de 901; write 896 TOPIC 24 0.11 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.10 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.18 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt church 4816; human 4136; public 3752; society 3711; women 3660; soul 2890; art 2539; social 2317; books 2312; class 2164; system 2136; st 2116; english 1986; history 1937; christian 1926; school 1900; moral 1876; religion 1865; law 1856; experience 1780; mere 1775; modern 1721; doctor 1718; character 1702; religious 1644; music 1641; century 1597; science 1594; genius 1579; personal 1575; study 1562; private 1516; poet 1512; race 1496; divine 1480; england 1435; working 1377; political 1375; simple 1367; government 1359; ideas 1359; spiritual 1345; existence 1308; beauty 1305; wealth 1275; simply 1255; influence 1255; nation 1253; higher 1250; education 1244; condition 1208; minister 1207; position 1201; daily 1188; generally 1177; persons 1173; perfect 1153; special 1145; property 1141; imagination 1138; reading 1130; city 1121; practical 1121; force 1117; works 1099; picture 1098; literary 1097; noble 1096; write 1086; youth 1080; american 1077; highest 1074; principle 1072; laws 1070; faith 1065; future 1058; result 1055; houses 1050; fancy 1049; wholly 1023; sunday 1019; poetry 1006; style 1001; vast 992; opinion 987; ways 972; labor 971; humanity 971; literature 969; ancient 964; chapter 957; equal 952; individual 942; forms 940; physical 938; language 929; relation 928; author 923; facts 923; rate 915
PCA scatter plot . . .¶
. . . perhaps not all that useful, since the first two principle components capture < 20% of the variation in the data.
In [10]:
%matplotlib inline
import matplotlib.pyplot as plt
from gensim.matutils import corpus2dense
import numpy as np
from sklearn.decomposition import PCA
lda_matrix = corpus2dense(gensim_lda_corpus, N_TOPICS)
print 'lda_matrix.shape', lda_matrix.shape
lda_matrix = lda_matrix.T
print 'lda_matrix.shape', lda_matrix.shape
pca = PCA(n_components=2)
results = pca.fit_transform(lda_matrix)
print
print len(results)
print
print 'explained_variance_ratio_', pca.explained_variance_ratio_
x = []
y = []
for r in results:
x.append(r[0])
y.append(r[1])
plt.figure(figsize=(12,12))
plt.title('MUNCIE FICTION -- PCA -- LDA 25 TOPICS')
plt.xlabel('principal component 1')
plt.ylabel('principal component 2')
#plt.ylim(-0.35, 0.45)
#plt.xlim(-0.55, 0.65)
#range(N_TOPICS):
plt.scatter(x, y, s=50, alpha=.5)
for i, m in enumerate(labels):
if 'Uncle_Tom' in labels[i] or 'Red_Rock' in labels[i] or 'Villa_Eden' in labels[i] or \
'House_Behind' in labels[i] or 'True_as_Steel' in labels[i] or 'Jane_Eyre' in labels[i]:
plt.annotate(labels[i], (x[i], y[i]))
lda_matrix.shape (25, 885) lda_matrix.shape (885, 25) 885 explained_variance_ratio_ [0.09305672 0.08949132]
Hierarchical clustering of the topic modeling results¶
In [11]:
%matplotlib inline
import numpy as np
from matplotlib import pyplot as plt
import seaborn as sns
from scipy.cluster.hierarchy import dendrogram, linkage
from scipy.spatial.distance import pdist
# I DON'T NEED TO DO THIS UNLESS I WANT A DISTANCE METRIC OTHER THAN 'euclidean'.
# I.E., THIS IS DEMO CODE . . .
distances = pdist(lda_matrix, 'euclidean')
print 'distances.shape', distances.shape
# THESE ARE EQUIVALENT
#linkage_matrix = linkage(lda_matrix, 'complete')
linkage_matrix = linkage(distances, 'complete')
print 'linkage_matrix.shape', linkage_matrix.shape
#linkage_matrix = linkage(lda_matrix, 'ward')
#linkage_matrix = linkage(lda_matrix, 'single')
#linkage_matrix = linkage(lda_matrix, 'average')
#linkage_matrix = linkage(lda_matrix, 'weighted')
#linkage_matrix = linkage(lda_matrix, 'centroid')
#linkage_matrix = linkage(lda_matrix, 'median')
sns.set_style("white")
marked_labels = []
for l in labels:
if 'Uncle_Tom' in l or 'Red_Rock' in l or 'Villa_Eden' in l or \
'House_Behind' in l or 'True_as_Steel' in l or 'Jane_Eyre' in l:
marked_labels.append('**** ' + l)
else:
marked_labels.append(' ' + l)
plt.figure(figsize=(8, 200))
plt.title('Novels -- Topic Modeling')
plt.ylabel('')
plt.xlabel('distance')
dendrogram(
linkage_matrix,
orientation='left',
labels=marked_labels,
leaf_font_size=10,
color_threshold=0.6
)
plt.show()
distances.shape (391170,) linkage_matrix.shape (884, 4)
What texts have dialect?¶
A rough check for dialog. I'm looking for "dey", "dat", "de", "den" and "dem". Out of 885, all but 113 have at least one of these tokens; 121 (13%) have four or five. Please note that I'm not looking for frequency; instead, I'm just looking for the presence or absense of these tokens.
In [12]:
from collections import defaultdict, Counter
n_words_hash = defaultdict(int)
books_with_words = []
for a in range(0, len(labels)):
n_words = 0
v = set(texts[a])
if 'dey' in v:
n_words += 1
if 'dat' in v:
n_words += 1
if 'de' in v:
n_words += 1
if 'den' in v:
n_words += 1
if 'dem' in v:
n_words += 1
n_words_hash[n_words] += 1
books_with_words.append([labels[a], n_words])
print
for k, v in n_words_hash.iteritems():
print k, v
books_with_words.sort()
print
for b in books_with_words:
if b[1] >= 4:
if 'Uncle_Tom' in b[0] or 'Red_Rock' in b[0] or 'Villa_Eden' in b[0] or \
'House_Behind' in b[0] or 'True_as_Steel' in b[0] or 'Jane_Eyre' in b[0]:
print '****', b[0], b[1]
else:
print ' ', b[0], b[1]
print
for b in books_with_words:
if 'Uncle_Tom' in b[0] or 'Red_Rock' in b[0] or 'Villa_Eden' in b[0] or \
'House_Behind' in b[0] or 'True_as_Steel' in b[0] or 'Jane_Eyre' in b[0]:
print '****', b[0], b[1]
0 113
1 330
2 260
3 61
4 50
5 71
Alcott_Louisa_May_Little_Women_PG_514_8.txt 4
Alger_Horatio_Frank_s_Campaign_Or_The_Farm_and_the_Camp_PG_1573.txt 4
Ballantyne_R_M_Robert_Michael_The_Dog_Crusoe_and_his_Master_PG_21728.txt 5
Ballantyne_R_M_Robert_Michael_The_Red_Eric_PG_21714.txt 5
Ballantyne_R_M_Robert_Michael_Ungava_PG_21707.txt 5
Bates_Arlo_Love_in_a_Cloud_A_Comedy_in_Filigree_PG_42831.txt 4
Blackmore_R_D_Richard_Doddridge_Erema_Or_My_Father_s_Sin_PG_7112.txt 4
Brady_Cyrus_Townsend_For_Love_of_Country_A_Story_of_Land_and_Sea_in_th_PG_20791.txt 5
Bullen_Frank_Thomas_The_Cruise_of_the_Cachalot_Round_the_World_After_Sperm_Whales_PG_1356.txt 5
Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 5
Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 5
Cable_George_Washington_The_Cavalier_PG_9839.txt 5
Caine_Hall_Sir_The_Christian_A_Story_PG_8407_8.txt 5
Castlemon_Harry_Frank_on_a_Gun_Boat_PG_12808.txt 4
Castlemon_Harry_Marcy_The_Blockade_Runner_PG_29387.txt 5
Castlemon_Harry_Marcy_the_Refugee_PG_31831.txt 5
Castlemon_Harry_Rodney_The_Partisan_PG_29300.txt 4
Castlemon_Harry_True_To_His_Colors_PG_28391.txt 5
Chambers_Robert_W_Robert_William_The_Maid_At_Arms_A_Novel_PG_12279.txt 5
Champney_Elizabeth_W_Elizabeth_Williams_Witch_Winnie_The_Story_of_a_King_s_Daughter_PG_34551_8.txt 5
**** Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 5
Churchill_Winston_The_Crisis_Complete_PG_5396.txt 4
Coffin_Charles_Carleton_The_Boys_of_or_Four_Years_of_Fighting_Personal_PG_34843.txt 5
Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 4
Cooper_James_Fenimore_Jack_Tier_Or_The_Florida_Reef_PG_4796_8.txt 5
Cooper_James_Fenimore_Miles_Wallingford_Sequel_to_Afloat_and_Ashore_PG_11243_8.txt 5
Cooper_James_Fenimore_The_Pioneers_Or_The_Sources_of_the_Susquehanna_PG_2275_8.txt 4
Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 5
Doyle_Arthur_Conan_The_Firm_of_Girdlestone_PG_13152.txt 5
Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 5
Edgeworth_Maria_Tales_and_Novels_Volume_Moral_Tales_PG_8826_8.txt 4
Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 5
Eggleston_George_Cary_Captain_Sam_The_Boy_Scouts_of_PG_18622_8.txt 4
Ellis_Edward_Sylvester_Footprints_in_the_Forest_PG_25980.txt 4
Ellis_Edward_Sylvester_Ned_in_the_Block_House_A_Tale_of_Early_Days_in_the_West_PG_43675_8.txt 5
Ellis_Edward_Sylvester_Wyoming_PG_41784_8.txt 5
Finley_Martha_Christmas_with_Grandma_Elsie_PG_14534.txt 5
Finley_Martha_Elsie_Dinsmore_PG_6440.txt 4
Finley_Martha_Elsie_at_Ion_PG_48356_0.txt 4
Finley_Martha_Elsie_s_Kith_and_Kin_PG_14488.txt 4
Finley_Martha_Elsie_s_Motherhood_PG_14566.txt 5
Finley_Martha_Elsie_s_New_Relations_What_They_Did_and_How_They_Fared_a_PG_14909.txt 4
Finley_Martha_Elsie_s_children_PG_14875.txt 4
Finley_Martha_Grandmother_Elsie_PG_14883.txt 4
Finley_Martha_The_Two_Elsies_A_Sequel_to_Elsie_at_Nantucket_PG_13379.txt 5
Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 5
Ford_Paul_Leicester_The_Honorable_Peter_Stirling_and_What_People_Thought_of_Him_PG_14532_8.txt 4
Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 5
Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 4
Goulding_F_R_The_Young_Marooners_on_the_Florida_Coast_PG_42066_0.txt 5
Habberton_John_Helen_s_Babies_PG_4281.txt 4
Haliburton_Thomas_Chandler_Nature_and_Human_Nature_PG_6112.txt 5
Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 4
Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 5
**** Harland_Marion_True_as_Steel_hvd.hn1bpl.txt 5
Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 5
Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 4
Henty_G_A_George_Alfred_The_Young_Buglers_PG_9613.txt 5
Henty_G_A_George_Alfred_True_to_the_Old_Flag_A_Tale_of_the_American_War_of_Independence_PG_8859.txt 5
Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 4
Isham_Frederic_Stewart_The_Strollers_PG_29726.txt 4
Jackson_Helen_Hunt_Between_Whiles_PG_10756.txt 5
Jackson_Helen_Hunt_Nelly_s_Silver_Mine_A_Story_of_Colorado_Life_PG_34430.txt 5
Keenan_Henry_F_Henry_Francis_The_Iron_Game_A_Tale_of_the_War_PG_10062.txt 5
Kingston_William_Henry_Giles_On_the_Banks_of_the_Amazon_PG_21385.txt 5
Kingston_William_Henry_Giles_True_Blue_PG_21481.txt 5
Kipling_Rudyard_Soldiers_Three_PG_6120.txt 4
Lincoln_Jeanie_Gould_An_Unwilling_Maid_Being_the_History_of_Certain_Ep_PG_10958_8.txt 5
Lover_Samuel_Handy_Andy_Volume_a_Tale_of_Irish_Life_PG_7180_8.txt 4
Lynde_Francis_The_Helpers_PG_45133.txt 5
Lynde_Francis_The_Master_of_Appleby_A_Novel_Tale_Concerning_Itself_in__PG_17690.txt 4
Lytton_Edward_Bulwer_Lytton_Baron_The_Caxtons_A_Family_Picture_Complete_PG_7605.txt 4
Marryat_Frederick_Olla_Podrida_PG_23139_8.txt 4
Marryat_Frederick_Peter_Simple_PG_21577.txt 5
Marryat_Frederick_Snarleyyow_or_The_Dog_Fiend_PG_21579.txt 4
Melville_Herman_White_Jacket_Or_The_World_on_a_Man_of_War_PG_10712.txt 4
Morris_Clara_A_Pasteboard_Crown_A_Story_of_the_New_York_Stage_PG_35055.txt 5
Munroe_Kirk_Raftmates_A_Story_of_the_Great_River_PG_19303.txt 5
Musick_John_R_John_Roy_A_Century_Too_Soon_The_Age_of_Tyranny_PG_10387_8.txt 4
Musick_John_R_John_Roy_The_Witch_of_Salem_or_Credulity_Run_Mad_PG_26282.txt 5
Optic_Oliver_Fighting_for_the_Right_PG_18803_8.txt 5
Optic_Oliver_Stand_By_The_Union_PG_18816.txt 5
Optic_Oliver_Within_The_Enemy_s_Lines_PG_18264.txt 4
**** Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 5
Page_Thomas_Nelson_Two_Little_Confederates_PG_26725.txt 5
Parker_Gilbert_The_Battle_of_the_Strong_A_Romance_of_Two_Kingdoms_Complete_PG_6236.txt 5
Parker_Gilbert_The_Lane_That_Had_No_Turning_Complete_PG_6241.txt 5
Read_Opie_Percival_The_Starbucks_PG_18984.txt 4
Reid_Mayne_The_Death_Shot_A_Story_Retold_PG_23140.txt 5
Reid_Mayne_The_Desert_Home_The_Adventures_of_a_Lost_Family_in_the_Wilderness_PG_24268.txt 4
Robins_Elizabeth_The_Open_Question_A_Tale_of_Two_Temperaments_PG_37827.txt 5
Roe_Edward_Payson_His_Sombre_Rivals_PG_6128.txt 5
Roe_Edward_Payson_Miss_Lou_PG_5309.txt 5
Roe_Edward_Payson_Opening_a_Chestnut_Burr_PG_6028.txt 4
Roe_Edward_Payson_Taken_Alive_PG_5320.txt 5
Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 5
Roe_Edward_Payson_Without_a_Home_PG_5433.txt 5
Russell_William_Clark_The_Frozen_Pirate_PG_22215.txt 4
Russell_William_Clark_The_Wreck_of_the_Grosvenor_Volume_of_An_account__PG_44497_8.txt 4
Ryan_Marah_Ellis_Told_in_the_Hills_A_Novel_PG_36246_8.txt 4
Saunders_Marshall_Beautiful_Joe_PG_2818.txt 4
Scott_Walter_The_Antiquary_Complete_PG_7005.txt 5
Seawell_Molly_Elliot_Throckmorton_A_Novel_PG_36829.txt 5
Sidney_Margaret_Five_Little_Peppers_Midway_PG_5632.txt 4
Smith_Francis_Hopkinson_Caleb_West_Master_Diver_PG_42362.txt 4
Smith_Francis_Hopkinson_The_Fortunes_of_Oliver_Horn_PG_3417.txt 5
Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 5
Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 4
Stephens_C_A_Charles_Asbury_Left_on_Labrador_or_The_cruise_of_the_Scho_PG_20242_8.txt 5
Stockton_Frank_Richard_The_House_of_Martha_PG_18822.txt 4
**** Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 5
Stowe_Harriet_Beecher_We_and_Our_Neighbors_or_The_Records_of_an_Unfashionable_Street_PG_48603_8.txt 4
Stratemeyer_Edward_Fighting_in_Cuban_Waters_Or_Under_Schley_on_the_Brooklyn_PG_34306_8.txt 4
Tarkington_Booth_The_Gentleman_from_Indiana_PG_9659.txt 4
Tarkington_Booth_The_Two_Vanrevels_PG_3428.txt 5
Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 5
Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 5
Twain_Mark_The_American_Claimant_PG_3179.txt 5
Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 5
Van_Dyke_Henry_The_Ruling_Passion_Tales_of_Nature_and_Human_Nature_PG_1048.txt 4
Watts_Dunton_Theodore_Aylwin_PG_13454_8.txt 4
**** Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt 2
**** Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 3
**** Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 5
**** Harland_Marion_True_as_Steel_hvd.hn1bpl.txt 5
**** Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 5
**** Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 5
This is where it gets interesting!¶
Here, usin the topic modeling results, I'm examining the similarities between my six novels of interest and the rest of the corpus. For each of the six novels, I list the 20 most similar novels. The format is like:
Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt
Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.9178674
Harland_Marion_Alone_PG_46505.txt 0.9086185
Bront_Charlotte_Villette_PG_9182.txt 0.87435615
Bront_Charlotte_Shirley_PG_30486.txt 0.8689619
Where Jane Eyre is the novel I'm looking at, followed by the indented names of the the 20 most similar novels (in this example, Jane Inez, Alone, Villette, and Shirley). The number after each of the most similar novels is a similarity score. 1.0 means "identical"; 0.91 (the score of Jane Inez) is very similar (why have we never noticed this novel?).
Keep in mind that "similarity" here is the similarity between topic percentages.
A couple of things to note in the results:
- Villa Eden's similar novels are all German novels in translation.
- Jane Eyre appears in the list of similar novels for True as Steel (and vice versa).
In [13]:
from gensim import corpora, models, similarities
index = similarities.MatrixSimilarity(gensim_lda_corpus)
for a, doc in enumerate(gensim_lda_corpus):
if 'Uncle_Tom' in labels[a] or 'Red_Rock' in labels[a] or 'Villa_Eden' in labels[a] or \
'House_Behind' in labels[a] or 'True_as_Steel' in labels[a] or 'Jane_Eyre' in labels[a]:
topic_pcts = {}
for n in range(0, N_TOPICS):
topic_pcts[n] = '0.00'
for topic in doc:
topic_pcts[topic[0]] = '{0:.2f}'.format(topic[1])
out_topic_pcts = []
for n in sorted(topic_pcts.keys()):
out_topic_pcts.append(topic_pcts[n])
print
print labels[a]
sims = index[doc]
sims = sorted(enumerate(sims), key=lambda item: -item[1])
print
for s in sims[1:21]:
print '\t', labels[s[0]], s[1]
#topic_pcts = {}
#for n in range(0, N_TOPICS):
# topic_pcts[n] = '0.00'
#for topic in gensim_lda_corpus[s[0]]:
# topic_pcts[topic[0]] = '{0:.2f}'.format(topic[1])
#out_topic_pcts = []
#for n in sorted(topic_pcts.keys()):
# out_topic_pcts.append(topic_pcts[n])
#print '\t', ' '.join(out_topic_pcts), labels[s[0]][:40], s[1]
Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.9178674 Harland_Marion_Alone_PG_46505.txt 0.9086185 Bront_Charlotte_Villette_PG_9182.txt 0.87435615 Bront_Charlotte_Shirley_PG_30486.txt 0.8689619 Hawthorne_Nathaniel_Twice_Told_Tales_PG_13707.txt 0.85831577 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.84981793 Chamisso_Adelbert_von_Peter_Schlemihl_PG_5339_0.txt 0.83657825 Hawthorne_Nathaniel_The_House_of_the_Seven_Gables_PG_77.txt 0.832669 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.8296939 Alcott_Louisa_May_Moods_PG_28203.txt 0.82840014 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.82800114 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt 0.8242028 Hawthorne_Nathaniel_The_Scarlet_Letter_PG_33.txt 0.8219881 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.81820524 Stephens_Ann_S_Ann_Sophia_The_Old_Homestead_PG_8078.txt 0.81030375 Stephens_Ann_S_Ann_Sophia_Fashion_and_Famine_PG_40114_8.txt 0.8023395 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.80020624 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.7973531 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.797154 Bront_Charlotte_The_Professor_PG_1028.txt 0.796761 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8514626 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.84947 King_Charles_Under_Fire_PG_20101.txt 0.8367666 King_Charles_A_War_Time_Wooing_A_Story_PG_22906.txt 0.8117944 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.8090246 Roe_Edward_Payson_His_Sombre_Rivals_PG_6128.txt 0.79605013 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.7838874 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.7764553 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.74831265 Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 0.7458591 Altsheler_Joseph_A_Joseph_Alexander_In_Hostile_Red_PG_41050_8.txt 0.72171444 Keenan_Henry_F_Henry_Francis_The_Iron_Game_A_Tale_of_the_War_PG_10062.txt 0.72161627 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.71966475 Roe_Edward_Payson_He_Fell_in_Love_with_His_Wife_PG_2271.txt 0.7070098 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.700464 Barr_Robert_In_the_Midst_of_Alarms_PG_9263_8.txt 0.6933955 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.6860167 Cable_George_Washington_The_Cavalier_PG_9839.txt 0.67914 Roe_Edward_Payson_A_Knight_of_the_Nineteenth_Century_PG_6311.txt 0.6702746 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.6690921 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8921873 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.88280004 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8693235 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.8641302 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8635267 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.858979 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.8518374 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.83670247 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.8309724 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.8188169 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.815582 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8108758 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.8055878 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7956807 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.78871495 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.78705263 Billings_Josh_Josh_Billings_on_Ice_and_Other_Things_PG_41025.txt 0.7834922 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.77992684 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.7677246 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.767689 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9009017 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.86925477 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.8641302 Seawell_Molly_Elliot_Throckmorton_A_Novel_PG_36829.txt 0.8624604 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8560355 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8485924 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.83920854 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.8286111 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.8234571 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.8215446 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8053512 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7971624 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.79608476 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.77888316 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.77539593 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.76836634 Greene_Homer_Burnham_Breaker_PG_10449.txt 0.76780725 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7641959 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7606664 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.75871384 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.8944435 Harland_Marion_Alone_PG_46505.txt 0.8461908 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.838717 Alcott_Louisa_May_Moods_PG_28203.txt 0.8384687 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.82420284 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.8230511 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.822421 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.81711954 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.805618 Bront_Charlotte_Villette_PG_9182.txt 0.8041413 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.7916908 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.78264177 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.7761542 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.77606004 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.7755129 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.7726159 Hawthorne_Nathaniel_Twice_Told_Tales_PG_13707.txt 0.7684568 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.7650107 Chamisso_Adelbert_von_Peter_Schlemihl_PG_5339_0.txt 0.7640266 Jackson_Helen_Hunt_Hetty_s_Strange_History_PG_9311.txt 0.7602063 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9546405 Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.95302695 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9505033 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.94464284 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9421931 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.9404598 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.94029564 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.93020654 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.929025 Marlitt_Wister_Baliff.txt 0.9281304 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.9253328 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9229962 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.92177284 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.92037064 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.91718346 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.9125995 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.8988636 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.8872339 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.88695586 Auerbach_Berthold_Christian_Gellert_s_Last_Christmas_From_German_Tales_PG_22665_8.txt 0.8166179
Test the Jane Eyre--True as Steel similarity¶
How much of the Jane Eyre--True as Steel similarity is the result of the initial state of the topic model (i.e., how much is do to randomness)?
To test this, I simply reran topic modeling 10 times, reporting the similarities each time. Out of ten runs, Jane Eyre turned up in True as Steel's list of similar novels 7 times.
In [14]:
from gensim import corpora, models, similarities
from gensim.models.wrappers import LdaMallet
def test_jane_eyre_observation(N_TOPICS):
lda_model = LdaMallet('/home/spenteco/0/mallet-2.0.8/bin/mallet',
corpus=gensim_corpus,
id2word=gensim_dictionary,
optimize_interval=10,
num_topics=N_TOPICS)
gensim_lda_corpus = lda_model[gensim_corpus]
from gensim import corpora, models, similarities
index = similarities.MatrixSimilarity(gensim_lda_corpus)
for a, doc in enumerate(gensim_lda_corpus):
if 'Uncle_Tom' in labels[a] or 'Red_Rock' in labels[a] or 'Villa_Eden' in labels[a] or \
'House_Behind' in labels[a] or 'True_as_Steel' in labels[a]:
print
print labels[a]
sims = index[doc]
sims = sorted(enumerate(sims), key=lambda item: -item[1])
print
for s in sims[1:21]:
print '\t', labels[s[0]], s[1]
# --------------------------------------------------------------------------------------------------------
N_TOPICS = 25
for a in range(0, 10):
print '--------------------------------------------------------'
print 'RUN', (a + 1)
print '--------------------------------------------------------'
test_jane_eyre_observation(N_TOPICS)
-------------------------------------------------------- RUN 1 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.89590096 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.83820593 Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 0.81335825 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.80960894 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.79062676 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.7872878 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.7782912 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.75762546 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.75417084 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.7383835 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.7374727 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.73385113 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.7337329 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.725883 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7192975 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.71763825 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.7167775 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.71356714 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.71353227 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7129199 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8648504 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.85865545 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8583733 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.83356655 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.82678664 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.7960137 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7820811 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.78111213 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.7801777 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.7757454 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7752788 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.7745398 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.769719 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.76677155 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.762595 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.76009995 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.75844866 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7577978 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.75489515 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.73794883 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8764621 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8603411 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8450141 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.83820593 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.8297415 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.82846296 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.80553484 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.80147856 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.79245347 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.78202224 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.7752788 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.76926017 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.7667984 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.7658538 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.76074016 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.74746346 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.74664426 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.74660224 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.74516976 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.74463874 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Harland_Marion_Alone_PG_46505.txt 0.8338438 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.83361804 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.8069332 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.76537347 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.75256926 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.74785244 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.74579126 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.7358816 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.7316344 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.72544 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.7248831 Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 0.7232031 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.7224014 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.7156043 Green_Anna_Katharine_Hand_and_Ring_PG_31681_8.txt 0.7150754 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.7131973 Alcott_Louisa_May_Moods_PG_28203.txt 0.70585895 Sand_George_Mauprat_PG_2194.txt 0.68746835 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.68557805 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.68348676 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.9421294 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.9330295 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.93118787 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.9274072 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.926071 Marlitt_Wister_The_Second_Wife_corrected.txt 0.92155546 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.92148125 Marlitt_Wister_Baliff.txt 0.91471153 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.9131081 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.91174084 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.91131175 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.908936 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.90766025 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.90600663 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.8971594 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.8936132 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.8661264 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.8573804 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.7485373 Fothergill_Jessie_The_First_Violin_A_Novel_PG_29219_8.txt 0.6650597 -------------------------------------------------------- RUN 2 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Warman_Cy_Snow_on_the_Headlight_A_Story_of_the_Great_Burlington_Strike_PG_30447_8.txt 0.8614819 Barr_Robert_In_the_Midst_of_Alarms_PG_9263_8.txt 0.84675616 Davis_Richard_Harding_Ranson_s_Folly_PG_5643.txt 0.82246906 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.80810237 Ford_Paul_Leicester_The_Honorable_Peter_Stirling_and_What_People_Thought_of_Him_PG_14532_8.txt 0.80761 Pidgin_Charles_Felton_Quincy_Adams_Sawyer_and_Mason_s_Corner_Folks_A_P_PG_16414.txt 0.80698663 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.8054842 Harte_Bret_The_Story_of_a_Mine_PG_2661.txt 0.8039072 Churchill_Winston_The_Celebrity_Complete_PG_5387.txt 0.7975908 Bates_Arlo_Love_in_a_Cloud_A_Comedy_in_Filigree_PG_42831.txt 0.79720294 Wells_David_Dwight_Her_Ladyship_s_Elephant_PG_28149.txt 0.7882143 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.7875713 Herrick_Robert_The_Web_of_Life_PG_7828.txt 0.7867379 Wells_David_Dwight_Parlous_Times_A_Novel_of_Modern_Diplomacy_PG_34925.txt 0.78638995 Tarkington_Booth_The_Gentleman_from_Indiana_PG_9659.txt 0.7834411 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.7824722 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.78006047 Howells_William_Dean_A_Hazard_of_New_Fortunes_Complete_PG_4600.txt 0.7739569 Harte_Bret_The_Three_Partners_PG_2560.txt 0.7731473 Fuller_Henry_Blake_With_the_Procession_PG_8891_8.txt 0.7699347 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.89911145 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.88667774 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.87598664 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.87230307 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8591165 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8556175 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8476298 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.84071296 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.82006323 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.8005935 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.79473966 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.79100037 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.7704154 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.77021337 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7692101 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7651235 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7622084 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.7615727 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7458801 Seawell_Molly_Elliot_Throckmorton_A_Novel_PG_36829.txt 0.7450595 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Seawell_Molly_Elliot_Throckmorton_A_Novel_PG_36829.txt 0.9098558 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.90101606 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.87598664 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.85003555 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8493893 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8453123 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.8267798 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.82085335 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.8138417 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.79946214 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.7772111 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.77476245 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.76182866 Taylor_Bayard_The_Story_of_Kennett_PG_8680.txt 0.76158303 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.7486271 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.74697983 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.74505943 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.732051 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7313285 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.73012185 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Harland_Marion_Alone_PG_46505.txt 0.8758078 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.84353757 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.8164247 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.80337965 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.78263134 Alexander_Mrs_Ralph_Wilton_s_weird_PG_41740.txt 0.78116 Jackson_Helen_Hunt_Hetty_s_Strange_History_PG_9311.txt 0.7803048 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.7644854 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.7558656 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.74842024 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.74382234 Bront_Charlotte_Villette_PG_9182.txt 0.743718 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.7377593 Alcott_Louisa_May_Moods_PG_28203.txt 0.73365945 Burnett_Frances_Hodgson_Vagabondia_PG_25727_8.txt 0.72615725 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.7250241 Phillpotts_Eden_Sons_of_the_Morning_PG_46857_8.txt 0.72079635 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.710522 Sand_George_Mauprat_PG_2194.txt 0.7096375 Evans_Augusta_J_Augusta_Jane_St_Elmo_PG_4553.txt 0.7054914 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.95968616 Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.95537615 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9493282 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.940349 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.93742794 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.93582135 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.935653 Marlitt_Wister_Baliff.txt 0.9306762 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.9289562 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.92722297 Marlitt_Wister_The_Second_Wife_corrected.txt 0.92509377 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.92274207 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.9222762 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9189939 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.91825354 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.897379 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.8758191 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.86472875 Auerbach_Berthold_Christian_Gellert_s_Last_Christmas_From_German_Tales_PG_22665_8.txt 0.80700135 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.7952599 -------------------------------------------------------- RUN 3 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.85178137 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.83521605 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8060944 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7894428 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.7852503 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.7797385 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7690466 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.7642924 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.76427317 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.7583879 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.7509053 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.748756 Kipling_Rudyard_Soldiers_Three_PG_6120.txt 0.74480224 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.7441374 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7381508 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.737194 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.73706317 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.7344174 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.7338004 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.72884953 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.91424024 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8789804 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.87798464 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8642783 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8573385 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.84134686 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.81582177 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.7941434 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.79236794 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7913955 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7902221 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.783556 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7783861 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.76701736 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.76070493 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.75610685 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.7559251 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.7514919 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.74750286 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.74556583 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9231446 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8711976 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8694515 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8633797 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.8562565 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.85338664 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.8333471 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.8176838 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8072494 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8061558 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.79824 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.7963407 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.79139555 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.7894428 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7818825 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7762488 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.76613975 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.751521 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.75118583 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.74787396 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.8669385 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.8662519 Harland_Marion_Alone_PG_46505.txt 0.86411685 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.842392 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.8396092 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.8392798 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.8239374 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.8206916 Alcott_Louisa_May_Moods_PG_28203.txt 0.8195988 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.8107564 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.8075065 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.80627 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.7964748 Evans_Augusta_J_Augusta_Jane_St_Elmo_PG_4553.txt 0.7850054 Aguilar_Grace_The_Vale_of_Cedars_Or_The_Martyr_PG_12725_8.txt 0.7685109 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.7636543 Stephens_Ann_S_Ann_Sophia_Fashion_and_Famine_PG_40114_8.txt 0.76090854 Stephens_Ann_S_Ann_Sophia_The_Old_Homestead_PG_8078.txt 0.758301 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.7534761 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.7531126 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.96941084 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.95787686 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.9537703 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.9496038 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9475868 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9421932 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.93951315 Marlitt_Wister_Baliff.txt 0.9387586 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.9387556 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.93703675 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.9349146 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.9332826 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.93270004 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9321618 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.92408395 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.89724797 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.87964284 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.8716679 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.86756516 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.7777306 -------------------------------------------------------- RUN 4 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.8507979 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.8244174 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.8147477 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.79187393 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.7800529 Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 0.77925587 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.775768 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.77320135 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.7603129 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.753174 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7521622 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.72743285 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.72648495 King_Charles_Under_Fire_PG_20101.txt 0.7244582 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.72327894 Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 0.72121406 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7211596 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.71830666 Munn_Charles_Clark_Uncle_Terry_A_Story_of_the_Maine_Coast_PG_28446.txt 0.7175039 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.7089319 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9199039 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.8779757 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8702705 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8490966 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.84541947 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.83806354 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.81606585 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.78973687 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.788573 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.7860941 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.77851886 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.76690775 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.75857586 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.75451493 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.74581116 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7405039 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7343667 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.73370427 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.72758013 Billings_Josh_Josh_Billings_on_Ice_and_Other_Things_PG_41025.txt 0.72269636 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.93177056 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.8779757 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8720133 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8605092 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.84480137 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8175442 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7905542 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.79025054 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.78384954 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7812881 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.7772114 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.77305967 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7702914 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7696632 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.7683736 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.7674356 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.7521622 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.7438817 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.7378472 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.73726094 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.9066268 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.8994434 Harland_Marion_Alone_PG_46505.txt 0.87332845 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.86233544 Bront_Charlotte_Villette_PG_9182.txt 0.8501193 Alcott_Louisa_May_Moods_PG_28203.txt 0.83928484 Brame_Charlotte_M_Dora_Thorne_PG_2374.txt 0.82682765 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.8168252 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.81079066 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.7962402 Duchess_Airy_Fairy_Lilian_PG_35228.txt 0.79321396 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.77623534 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.77062434 Evans_Augusta_J_Augusta_Jane_A_Speckled_Bird_PG_36029.txt 0.7676648 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.7657608 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.7639637 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.76187676 Evans_Augusta_J_Augusta_Jane_St_Elmo_PG_4553.txt 0.76074696 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.75843024 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.75776446 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.95945436 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9476112 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.94589096 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.94198906 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.9380132 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9375916 Marlitt_Wister_Baliff.txt 0.9361978 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.93253785 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.9322437 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.9305775 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.9304283 Marlitt_Wister_The_Second_Wife_corrected.txt 0.93024814 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9289888 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.92597127 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.9052323 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.887677 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.88732815 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.8623302 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.86077946 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.79965675 -------------------------------------------------------- RUN 5 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.91857743 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.91280186 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.90599215 Stephens_Robert_Neilson_The_Continental_Dragoon_A_Love_Story_of_Philipse_Manor_House_in_PG_30589.txt 0.8737126 King_Charles_Under_Fire_PG_20101.txt 0.87100047 King_Charles_A_War_Time_Wooing_A_Story_PG_22906.txt 0.87089664 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.8695173 Keenan_Henry_F_Henry_Francis_The_Iron_Game_A_Tale_of_the_War_PG_10062.txt 0.8669279 Altsheler_Joseph_A_Joseph_Alexander_In_Hostile_Red_PG_41050_8.txt 0.86488247 Cable_George_Washington_The_Cavalier_PG_9839.txt 0.83749914 Davis_Richard_Harding_Captain_Macklin_His_Memoirs_PG_6015.txt 0.8220899 Coffin_Charles_Carleton_The_Boys_of_or_Four_Years_of_Fighting_Personal_PG_34843.txt 0.77173173 Otis_James_Corporal_Lige_s_Recruit_A_Story_of_Crown_Point_and_Ticonderoga_PG_33110.txt 0.76953226 Castlemon_Harry_True_To_His_Colors_PG_28391.txt 0.75530624 Optic_Oliver_The_Soldier_Boy_or_Tom_Somers_in_the_Army_A_Story_of_the_Great_Rebellion_PG_14595_8.txt 0.7488732 Stephens_Robert_Neilson_Philip_Winwood_A_Sketch_of_the_Domestic_Histor_PG_15506_8.txt 0.74551064 Castlemon_Harry_Rodney_The_Partisan_PG_29300.txt 0.7454555 Castlemon_Harry_Marcy_the_Refugee_PG_31831.txt 0.7342707 King_Charles_Trumpeter_Fred_A_Story_of_the_Plains_PG_37415_8.txt 0.7320119 Coffin_Charles_Carleton_Daughters_of_the_Revolution_and_Their_Times_A__PG_29849_8.txt 0.71849775 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.90575933 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8996285 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8780459 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8533872 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8511256 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.84969723 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.84759074 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.84358984 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8243445 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.8063483 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.801514 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7949411 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.78960776 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.78471917 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.77947754 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.7744374 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.77218884 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.77153796 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.7678982 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.76572657 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.92501104 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8490421 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8174622 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.8063649 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.80198646 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.7794296 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.7792468 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.77169204 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.76572657 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.75695914 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.75435305 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7499314 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.74375635 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.7398735 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.7373906 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.73642147 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.7359184 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.73549396 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.73313737 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.73291016 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Harland_Marion_Alone_PG_46505.txt 0.86391246 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.8490671 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.8331745 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.829309 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.8291864 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.8255723 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.821651 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.8205475 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.81886 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.81801045 Evans_Augusta_J_Augusta_Jane_A_Speckled_Bird_PG_36029.txt 0.81516445 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.8137529 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.81274736 Alcott_Louisa_May_Moods_PG_28203.txt 0.8091197 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.807167 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.79623044 Roe_Edward_Payson_From_Jest_to_Earnest_PG_6102.txt 0.7956865 Roe_Edward_Payson_A_Face_Illumined_PG_2501.txt 0.7946352 Roe_Edward_Payson_A_Knight_of_the_Nineteenth_Century_PG_6311.txt 0.7900095 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.7873462 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.9599326 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.94638145 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.9439375 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9371937 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.93694216 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.9368929 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.93632495 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9310482 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.9306927 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.93056786 Marlitt_Wister_Baliff.txt 0.92980844 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.9282185 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.92806506 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.916477 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.8974619 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.88496345 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.88157797 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.8804332 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.8317457 Auerbach_Berthold_Christian_Gellert_s_Last_Christmas_From_German_Tales_PG_22665_8.txt 0.76946515 -------------------------------------------------------- RUN 6 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.78965676 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7761107 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.75920445 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.75612646 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.75146526 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.75010276 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7496863 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.73481596 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.73444027 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7264395 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.724628 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.7199275 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.70719826 Smith_Francis_Hopkinson_Caleb_West_Master_Diver_PG_42362.txt 0.7064059 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.7048509 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.7024765 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.70183545 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.69644654 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.696396 Kipling_Rudyard_Soldiers_Three_PG_6120.txt 0.6959449 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.89900243 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8941971 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.88859946 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8831879 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.87617683 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.87321734 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8380251 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.8328307 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.83099324 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.8236991 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.81568485 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.81437296 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.8036514 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.80228806 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.79091763 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.7852557 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.78418505 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.7835087 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.77845895 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.77758884 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.88252795 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.8677473 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.8627611 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8487735 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.84664357 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8387494 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.8269546 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.8236991 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.79102945 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.7873382 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.7761106 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.76850516 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.76206714 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.760803 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7584584 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.74263436 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7412602 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7371656 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7298627 Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 0.72464603 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.87881035 Harland_Marion_Alone_PG_46505.txt 0.87447333 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.85241914 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.83776146 Bront_Charlotte_Villette_PG_9182.txt 0.80964565 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.80917954 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.7982218 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.79612213 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.7917203 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.78882897 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.78433037 Alcott_Louisa_May_Moods_PG_28203.txt 0.7834001 Bront_Charlotte_Shirley_PG_30486.txt 0.77988505 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.76756257 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.7670804 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.7668167 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.76245344 Hawthorne_Nathaniel_The_House_of_the_Seven_Gables_PG_77.txt 0.75632584 Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 0.7544 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.748011 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.953667 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.947756 Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.9437227 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.94018525 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.93940365 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.93532336 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.93430877 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9284931 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.92843074 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9260199 Marlitt_Wister_Baliff.txt 0.92591137 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.924478 Marlitt_Wister_The_Second_Wife_corrected.txt 0.92425025 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.92423236 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.92216474 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.903226 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.87913966 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.8757843 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.8665573 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.85437524 -------------------------------------------------------- RUN 7 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.9094168 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.8492602 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.83981377 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.83175784 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.81363535 Roe_Edward_Payson_He_Fell_in_Love_with_His_Wife_PG_2271.txt 0.7731736 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.760918 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.75247914 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.75180954 Roe_Edward_Payson_His_Sombre_Rivals_PG_6128.txt 0.7458094 Smith_Francis_Hopkinson_Caleb_West_Master_Diver_PG_42362.txt 0.7399185 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.7354722 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.73281634 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.72657704 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.725103 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.72456825 McCutcheon_George_Barr_Castle_Craneycrow_PG_5349.txt 0.71622694 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.7150475 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.7053015 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.70479697 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8962456 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8568369 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.84080946 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.82645786 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8242474 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8140031 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.7939449 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7618049 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.75544995 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.7504232 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.74720514 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7466122 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.7458201 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.74030226 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.73838496 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.73683167 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.7359236 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.73262525 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7289609 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7287367 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.937866 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.87327504 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8400083 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.83914894 Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt 0.81363535 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8079418 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.7900635 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.78809243 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.77204454 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.7720127 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.77123535 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.7618048 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.76107466 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.7564121 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.75539744 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.7451894 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.74400795 Smith_Francis_Hopkinson_Caleb_West_Master_Diver_PG_42362.txt 0.73821324 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7361854 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.73536086 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Harland_Marion_Alone_PG_46505.txt 0.8522284 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.8375912 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.8272647 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.8207612 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.8120411 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.7835423 Alcott_Louisa_May_Moods_PG_28203.txt 0.76907635 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.7438268 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.73959017 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.723417 Bront_Emily_Wuthering_Heights_PG_768.txt 0.7233778 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.7111862 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.7101292 Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 0.70982647 Bront_Charlotte_Shirley_PG_30486.txt 0.70890874 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.7049976 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.6971991 Evans_Augusta_J_Augusta_Jane_St_Elmo_PG_4553.txt 0.6953089 Bront_Charlotte_Villette_PG_9182.txt 0.6938505 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.6937099 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9485221 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.939903 Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.93964297 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.9354941 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9319414 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.9301847 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.92557734 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9240892 Marlitt_Wister_Baliff.txt 0.91800505 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.917459 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.91664696 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9164237 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.91481125 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.9122496 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.88995063 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.88365364 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.87469935 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.84831756 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.8005243 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.78910094 -------------------------------------------------------- RUN 8 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8368199 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.76634914 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.7609179 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.7506635 Ryan_Marah_Ellis_The_Bondwoman_PG_29581.txt 0.7442761 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.7432686 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7388522 Connor_Ralph_The_Man_from_Glengarry_A_Tale_of_the_Ottawa_PG_3287.txt 0.7372714 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.7355124 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.7313595 Cable_George_Washington_The_Cavalier_PG_9839.txt 0.730747 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.72191757 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.71693534 Stephens_Robert_Neilson_The_Continental_Dragoon_A_Love_Story_of_Philipse_Manor_House_in_PG_30589.txt 0.71412283 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.7120874 King_Charles_Under_Fire_PG_20101.txt 0.7051761 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.7038033 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.694875 Barr_Robert_In_the_Midst_of_Alarms_PG_9263_8.txt 0.6943742 King_Charles_A_War_Time_Wooing_A_Story_PG_22906.txt 0.69346666 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8975495 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.84712815 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.84034836 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.83949053 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8335925 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8301376 Freeman_Mary_Eleanor_Wilkins_Pembroke_A_Novel_PG_17428.txt 0.7987047 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7881606 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7823128 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.77639216 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.7741032 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.7733092 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7705507 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.7587852 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.74854153 Field_Eugene_A_Little_Book_of_Profitable_Tales_PG_9485_8.txt 0.74763083 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.7470174 Freeman_Mary_Eleanor_Wilkins_Jerome_A_Poor_Man_A_Novel_PG_17886.txt 0.74664646 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.7461504 Twain_Mark_The_Adventures_of_Tom_Sawyer_PG_74.txt 0.7444845 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9075842 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.852972 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8477201 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8437569 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.83576345 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8315701 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.8260029 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.80885375 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.80670965 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.79250103 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7866842 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.7825395 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.78160805 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.7814234 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.78140414 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.77700263 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.77639216 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.77529293 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.77466583 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.7683938 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.8834885 Harland_Marion_Alone_PG_46505.txt 0.8576831 Hentz_Caroline_Lee_Helen_and_Arthur_or_Miss_Thusa_s_Spinning_Wheel_PG_23106_8.txt 0.85697955 Crawford_F_Marion_Francis_Marion_The_Witch_of_Prague_A_Fantastic_Tale_PG_3816.txt 0.8486906 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.83666414 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.8339834 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.81957096 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.8172527 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.8169058 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.8155863 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.80968076 Evans_Augusta_J_Augusta_Jane_At_the_Mercy_of_Tiberius_PG_4209.txt 0.8030493 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.7993005 Alcott_Louisa_May_Moods_PG_28203.txt 0.79925144 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.7788961 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.77564126 Evans_Augusta_J_Augusta_Jane_St_Elmo_PG_4553.txt 0.7756115 Ward_Humphry_Mrs_Helbeck_of_Bannisdale_Volume_II_PG_9442_8.txt 0.7622123 Stephens_Ann_S_Ann_Sophia_Fashion_and_Famine_PG_40114_8.txt 0.7519022 Evans_Augusta_J_Augusta_Jane_A_Speckled_Bird_PG_36029.txt 0.7496912 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.9653036 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.95968586 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.95491964 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9545756 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.94841707 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9408344 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9401626 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.9386314 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.9383715 Marlitt_Wister_Baliff.txt 0.9382954 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.93344283 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.9334162 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.92824924 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.92128444 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.92002237 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9187568 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.9175128 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.8897178 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.81851894 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.7996647 -------------------------------------------------------- RUN 9 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.8067286 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.7955253 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.7739923 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.76396245 Smith_Francis_Hopkinson_Tom_Grogan_PG_850.txt 0.758239 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.7511206 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.74893904 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.7433367 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.73954237 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.736454 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.73504204 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7290211 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7273895 Castlemon_Harry_True_To_His_Colors_PG_28391.txt 0.72465646 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.7226822 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.7223573 Taylor_Bayard_The_Story_of_Kennett_PG_8680.txt 0.72062 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.718312 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.7164457 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.71595407 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.90639085 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8938413 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.8937455 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.88350403 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.88015 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.85632414 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.8523361 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.8491174 Wiggin_Kate_Douglas_Smith_The_Story_of_Patsy_PG_13506.txt 0.8444521 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8200838 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.8200157 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.8193795 Twain_Mark_Adventures_of_Huckleberry_Finn_PG_76.txt 0.81754273 Taylor_Bayard_The_Story_of_Kennett_PG_8680.txt 0.8061864 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7902889 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.78812104 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7850665 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.783568 Billings_Josh_Josh_Billings_on_Ice_and_Other_Things_PG_41025.txt 0.7831443 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.78232735 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9200178 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.8799629 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8715594 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.8688071 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.85287666 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.85108286 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.84875685 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.8193795 Taylor_Bayard_The_Story_of_Kennett_PG_8680.txt 0.81843996 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.8068483 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7925154 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.79085207 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.7897598 Hough_Emerson_The_Girl_at_the_Halfway_House_A_Story_of_the_Plains_PG_14948.txt 0.7890308 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.788502 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.78604484 Roe_Edward_Payson_He_Fell_in_Love_with_His_Wife_PG_2271.txt 0.7789096 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.7775577 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.7749598 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.77174115 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.9146656 Alcott_Louisa_May_Moods_PG_28203.txt 0.8704091 Crawford_F_Marion_Francis_Marion_The_Witch_of_Prague_A_Fantastic_Tale_PG_3816.txt 0.8666656 Harland_Marion_Alone_PG_46505.txt 0.86168265 Phelps_Elizabeth_Stuart_The_Gates_Between_PG_30540.txt 0.85367966 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.8493221 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.84700745 Roe_Edward_Payson_A_Face_Illumined_PG_2501.txt 0.84102875 Corelli_Marie_A_Romance_of_Two_Worlds_A_Novel_PG_4394.txt 0.84017885 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.8377787 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.8374004 Craik_Dinah_Maria_Mulock_Olive_A_Novel_PG_22121_8.txt 0.8361967 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.8331611 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.82896996 Roe_Edward_Payson_From_Jest_to_Earnest_PG_6102.txt 0.8261997 Roe_Edward_Payson_His_Sombre_Rivals_PG_6128.txt 0.8203894 Goss_Charles_Frederic_The_Redemption_of_David_Corson_PG_14730.txt 0.8189472 Roe_Edward_Payson_Without_a_Home_PG_5433.txt 0.8169069 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.81561077 Lytton_Edward_Bulwer_Lytton_Baron_A_Strange_Story_Complete_PG_7701.txt 0.81257945 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.953951 Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.9436245 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9219707 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.91962326 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.91960716 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9148864 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.9140953 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.9108291 Marlitt_Wister_Baliff.txt 0.90393066 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9038274 Marlitt_Wister_The_Second_Wife_corrected.txt 0.8985898 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.89296514 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.8918397 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.88826513 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.8869784 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.88289964 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.8803557 Heimburg_W_Gertrude_s_Marriage_PG_32442.txt 0.85686266 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.8562332 Auerbach_Berthold_Edelweiss_A_Story_PG_33007_8.txt 0.7906761 -------------------------------------------------------- RUN 10 -------------------------------------------------------- Page_Thomas_Nelson_Red_Rock_A_Chronicle_of_Reconstruction_PG_49648_0.txt Stephens_Robert_Neilson_The_Continental_Dragoon_A_Love_Story_of_Philipse_Manor_House_in_PG_30589.txt 0.86340654 King_Charles_A_War_Time_Wooing_A_Story_PG_22906.txt 0.8477039 Ford_Paul_Leicester_Janice_Meredith_A_Story_of_the_American_Revolution_PG_5719.txt 0.8456469 Cable_George_Washington_The_Cavalier_PG_9839.txt 0.8226187 King_Charles_Marion_s_Faith_PG_20305_8.txt 0.82206595 King_Charles_Under_Fire_PG_20101.txt 0.82027894 Connor_Ralph_The_Sky_Pilot_in_No_Man_s_Land_PG_3288.txt 0.79867345 Altsheler_Joseph_A_Joseph_Alexander_In_Hostile_Red_PG_41050_8.txt 0.79083663 Churchill_Winston_The_Crisis_Complete_PG_5396.txt 0.78826815 Keenan_Henry_F_Henry_Francis_The_Iron_Game_A_Tale_of_the_War_PG_10062.txt 0.7882273 Davis_Richard_Harding_Captain_Macklin_His_Memoirs_PG_6015.txt 0.7661858 Davis_Richard_Harding_Ranson_s_Folly_PG_5643.txt 0.7440882 Dickinson_Anna_E_Anna_Elizabeth_What_Answer_PG_15402.txt 0.72409636 King_Charles_Trumpeter_Fred_A_Story_of_the_Plains_PG_37415_8.txt 0.70913994 Page_Thomas_Nelson_Two_Little_Confederates_PG_26725.txt 0.7066411 Coffin_Charles_Carleton_The_Boys_of_or_Four_Years_of_Fighting_Personal_PG_34843.txt 0.6908549 Cable_George_Washington_John_March_Southerner_PG_31470_8.txt 0.6800144 Otis_James_Corporal_Lige_s_Recruit_A_Story_of_Crown_Point_and_Ticonderoga_PG_33110.txt 0.674927 Chambers_Robert_W_Robert_William_The_Maid_At_Arms_A_Novel_PG_12279.txt 0.6505734 Aldrich_Thomas_Bailey_The_Queen_of_Sheba_and_My_Cousin_the_Colonel_PG_5705.txt 0.6492001 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.8649086 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8591875 Holley_Marietta_Samantha_at_Saratoga_PG_3425.txt 0.83082974 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.81904256 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.8189267 Eggleston_Edward_The_Hoosier_Schoolmaster_A_Story_of_Backwoods_Life_in_Indiana_PG_15099.txt 0.812589 Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.7999264 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.7904277 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt 0.78768736 Wiggin_Kate_Douglas_Smith_Timothy_s_Quest_A_Story_for_Anybody_Young_or_PG_18531_8.txt 0.78061646 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.77971065 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.7768198 Smith_Francis_Hopkinson_The_Other_Fellow_PG_37148_8.txt 0.7752985 Read_Opie_Percival_The_Starbucks_PG_18984.txt 0.77362865 Westcott_Edward_Noyes_David_Harum_A_Story_of_American_Life_PG_17617.txt 0.77295625 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7576752 Harben_Will_N_Will_Nathaniel_Northern_Georgia_Sketches_PG_50896_8.txt 0.7563914 Harris_Joel_Chandler_On_the_Plantation_A_Story_of_a_Georgia_Boy_s_Adve_PG_50701.txt 0.7557915 Wiggin_Kate_Douglas_Smith_The_Story_of_Patsy_PG_13506.txt 0.752529 Harben_Will_N_Will_Nathaniel_Westerfelt_PG_17178.txt 0.738691 Chesnutt_Charles_W_Charles_Waddell_The_House_Behind_the_Cedars_PG_472.txt Burnett_Frances_Hodgson_In_Connection_with_the_De_Willoughby_Claim_PG_25810_8.txt 0.9531613 Roe_Edward_Payson_Miss_Lou_PG_5309.txt 0.8757891 Munn_Charles_Clark_Rockhaven_PG_33787.txt 0.8730851 Twain_Mark_The_Tragedy_of_Pudd_nhead_Wilson_PG_102.txt 0.8552984 Holland_J_G_Josiah_Gilbert_Sevenoaks_A_Story_of_Today_PG_15214.txt 0.85065806 Burnett_Frances_Hodgson_Louisiana_PG_35300_8.txt 0.84858805 Dunbar_Paul_Laurence_The_Strength_of_Gideon_and_Other_Stories_PG_15886.txt 0.8475219 Roe_Edward_Payson_The_Earth_Trembled_PG_6719.txt 0.82319224 Howells_William_Dean_The_Landlord_at_Lion_s_Head_Complete_PG_4645.txt 0.8041955 Read_Opie_Percival_The_Jucklins_A_Novel_PG_26499.txt 0.8016051 Stowe_Harriet_Beecher_Uncle_Tom_s_Cabin_PG_203.txt 0.78768724 Seawell_Molly_Elliot_Throckmorton_A_Novel_PG_36829.txt 0.7873588 Wilson_Harry_Leon_The_Spenders_A_Tale_of_the_Third_Generation_PG_9981.txt 0.7869621 Harben_Will_N_Will_Nathaniel_Abner_Daniel_A_Novel_PG_50494_8.txt 0.78616047 Eggleston_Edward_The_End_of_the_World_A_Love_Story_PG_14051_8.txt 0.78409195 Townsend_George_Alfred_The_Entailed_Hat_Or_Patty_Cannon_s_Times_PG_19146.txt 0.7832346 Murfree_Mary_Noailles_The_Prophet_of_the_Great_Smoky_Mountains_PG_35619.txt 0.7785181 Wister_Owen_The_Virginian_A_Horseman_of_the_Plains_PG_1298.txt 0.7767169 Roe_Edward_Payson_Taken_Alive_PG_5320.txt 0.774117 Glasgow_Ellen_Anderson_Gholson_The_Voice_of_the_People_PG_16505_8.txt 0.767609 Harland_Marion_True_as_Steel_hvd.hn1bpl.txt Harland_Marion_Alone_PG_46505.txt 0.8656091 Bront_Anne_The_Tenant_of_Wildfell_Hall_PG_969_0.txt 0.84821475 Lawrence_George_A_George_Alfred_Guy_Livingstone_or_Thorough_PG_17084.txt 0.8053286 Evans_Augusta_J_Augusta_Jane_Macaria_PG_27811_8.txt 0.79851705 Bront_Emily_Wuthering_Heights_PG_768.txt 0.7946731 Lawrence_George_A_George_Alfred_Sword_and_Gown_A_Novel_PG_19121_8.txt 0.7911815 Bront_Charlotte_Villette_PG_9182.txt 0.781497 Bront_Charlotte_Shirley_PG_30486.txt 0.7775775 Green_Anna_Katharine_Lost_Man_s_Lane_A_Second_Episode_in_the_Life_of_Amelia_Butterworth_PG_33305.txt 0.76908493 Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt 0.7515803 Evans_Augusta_J_Augusta_Jane_Inez_A_Tale_of_the_Alamo_PG_15470.txt 0.7507665 Bront_Charlotte_The_Professor_PG_1028.txt 0.74940026 Castle_Egerton_The_Light_of_Scarthey_A_Romance_PG_26045_8.txt 0.7436438 Alexander_Mrs_At_Bay_PG_49714_8.txt 0.7312358 Evans_Augusta_J_Augusta_Jane_Vashti_Or_Until_Death_Us_Do_Part_PG_31620.txt 0.7186457 Hay_John_The_Bread_winners_A_Social_Study_PG_16321.txt 0.7151764 Crawford_F_Marion_Francis_Marion_The_Witch_of_Prague_A_Fantastic_Tale_PG_3816.txt 0.71506953 Alcott_Louisa_May_Moods_PG_28203.txt 0.70648545 Grahame_Kenneth_The_Golden_Age_PG_291.txt 0.7057309 Evans_Augusta_J_Augusta_Jane_Infelice_PG_17718_8.txt 0.7050412 Auerbach_Berthold_Villa_Eden_The_Country_House_on_the_Rhine_PG_32902_8.txt Werner_E_The_Alpine_Fay_A_Romance_PG_35229_8.txt 0.96825457 Streckfuss_Adolf_Castle_Hohenwald_A_Romance_PG_34892.txt 0.95981073 Hillern_Wilhelmine_von_Only_a_Girl_or_A_Physician_for_the_Soul_PG_36709_8.txt 0.9578911 Bethusy_Huc_Valeska_Grfin_von_The_Eichhofs_A_Romance_PG_35311_8.txt 0.9544043 Marlitt_Wister_Gold_Elsie_PG_42426.txt 0.94954664 Marlitt_Wister_OMS_translation_cleaned_110617.txt 0.94483775 Marlitt_Wister_At_the_Councillor_s_or_A_Nameless_History_PG_43393_0.txt 0.9436745 Spielhagen_Friedrich_What_the_Swallow_Sang_A_Novel_PG_34599.txt 0.9382931 Marlitt_Wister_The_Second_Wife_corrected.txt 0.9369943 Marlitt_Wister_Countess_Gisela_corrected_4_10_2018.txt 0.93688995 Schubin_Ossip_O_Thou_My_Austria_PG_35454.txt 0.9355498 Marlitt_Wister_Baliff.txt 0.93291855 Spielhagen_Friedrich_Hammer_and_Anvil_A_Novel_PG_34868_8.txt 0.931223 Marlitt_Wister_Lady_with_the_Rubies_corrected_3_13_208.txt 0.9292397 Marlitt_Wister_Owls_Nest_corrected_4_21_2018.txt 0.92798346 Marlitt_Wister_Little_Moorland_Princess_cleaned_121817.txt 0.927881 Marlitt_Wister_Im Schillingshof_4_26_2018.txt 0.92720526 Von_Arnim_Elizabeth_The_Benefactress_PG_30302_8.txt 0.86058176 Crawford_F_Marion_Francis_Marion_Saracinesca_PG_13757_8.txt 0.78307176 Crawford_F_Marion_Francis_Marion_Sant_Ilario_PG_5227.txt 0.77781045
What words are driving the True as Steel--*Jane Eyre** similarity?¶
I.e., what words do they have in common?
In [24]:
jane_eyre_a = -1
true_as_steel_a = -1
for a in range(0, len(labels)):
if 'Jane_Eyre' in labels[a]:
print labels[a]
jane_eyre_a = a
if 'True_as_Steel' in labels[a]:
print labels[a]
true_as_steel_a = a
common_lexicon = set(texts[jane_eyre_a]).intersection(texts[true_as_steel_a])
print
print 'len(common_lexicon)', len(common_lexicon)
print 'jane eyre types', len(set(texts[jane_eyre_a]))
print 'true as steel types', len(set(texts[true_as_steel_a]))
Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt Harland_Marion_True_as_Steel_hvd.hn1bpl.txt len(common_lexicon) 5485 jane eyre types 10381 true as steel types 8241
Find some sentences to read . . .¶
I'm going to parse Jane Eyre and True as Steel, and score each sentences based on the percentage of its words which occur in the common_lexicon I derived in the previous cell.
In [16]:
import spacy
nlp = spacy.load('en')
nlp.max_length = 1050000
In [17]:
PATH_TO_CORPUS
CORPUS_SUBFOLDERS = ['PG_no_backmatter_fiction/']
def get_sentence_lexicon_scores(file_name, common_lexicon):
sentence_scores = []
sentences = []
doc = nlp(unicode(codecs.open(file_name, 'r', encoding='utf-8').read()))
sentence_n = 0
for s in doc.sents:
tokens = []
for t in s:
tokens.append(t.text)
n_in_lexicon = 0
for t in tokens:
if t.lower() in common_lexicon:
n_in_lexicon += 1
sentence_scores.append((float(n_in_lexicon) / len(tokens)))
sentences.append(re.sub('\s+', ' ', s.text.strip()))
#print re.sub('\s+', ' ', unicode(s).strip()), n_in_lexicon, (float(n_in_lexicon) / len(tokens))
#sentence_n += 1
#if sentence_n > 500:
# break
return sentence_scores, sentences
# ----------------------------------------------------------
jane_eyre_scores, jane_eyre_sentences = get_sentence_lexicon_scores(PATH_TO_CORPUS + \
CORPUS_SUBFOLDERS[0] + \
'Bront_Charlotte_Jane_Eyre_An_Autobiography_PG_1260.txt', common_lexicon)
print 'Jane Eyre done!'
true_as_steel_scores, true_as_steel_sentences = get_sentence_lexicon_scores(PATH_TO_CORPUS + \
CORPUS_SUBFOLDERS[0] + \
'Harland_Marion_True_as_Steel_hvd.hn1bpl.txt', common_lexicon)
print 'True as Steel done!'
Jane Eyre done! True as Steel done!
In [18]:
print jane_eyre_scores[:20]
[0.0, 0.0, 0.0, 0.5, 0.0, 0.1111111111111111, 0.0, 0.14285714285714285, 0.14285714285714285, 0.07692307692307693, 0.18181818181818182, 0.3333333333333333, 0.2857142857142857, 0.2, 0.1724137931034483, 0.11904761904761904, 0.109375, 0.14285714285714285, 0.0, 0.375]
Plot the sentence scores.¶
I'm not sure what the range of possible scores is, so I want to plot them so I can estimate a value for "high".
In [19]:
%matplotlib inline
import numpy as np
import pandas as pd
import seaborn as sns
import matplotlib.pyplot as plt
from scipy import stats
sns.set(color_codes=True)
plt.figure(figsize=(10, 5))
sns.distplot(jane_eyre_scores + true_as_steel_scores)
/home/spenteco/anaconda2/envs/py2/lib/python2.7/site-packages/matplotlib/axes/_axes.py:6462: UserWarning: The 'normed' kwarg is deprecated, and has been replaced by the 'density' kwarg.
warnings.warn("The 'normed' kwarg is deprecated, and has been "
Out[19]:
<matplotlib.axes._subplots.AxesSubplot at 0x7fcc04db1b50>
Print out some Jane-Eyre-ish sentences from True as Steel¶
In [25]:
#n = 0
#for a, score in enumerate(jane_eyre_scores):
# if score > 0.3 and len(jane_eyre_sentences[a].split(' ')) > 10:
# print
# print jane_eyre_sentences[a]
# n += 1
#print
#print n
n = 0
for a, score in enumerate(true_as_steel_scores):
if score > 0.3 and len(true_as_steel_sentences[a].split(' ')) > 10:
print
print true_as_steel_sentences[a]
n += 1
print
print n
Seven children were the fruit of what the clique royal invariably styled "poor Octavia's unfortunate marriage." Host and hostess treated their cousin's child the more kindly that they too found her willing, active, and industrious, and therefore useful in many ways, and the servants were more respectful than a poor relation had a right to expect. The lashes were long and curling; her eyebrows were arched; her nose straight Grecian; her upper lip a bow, wreathed with scarlet; her lower, twin cherries deftly joined, and hsr complexion was unexceptionable as the rest of the picture. He enjoyed the uugrndged possession of the highest honors the district of which his native county formed a part could bestow upon him. a low, stifled exclamation betraying a greater depth of alarm, that stayed his prosing consolation, and Hadassah started violently, then shrank closely to his side. TODD, a gaunt matron with an undue allowfance of neck, and an aristocratic nose— Naturally jealous in disposition, she demanded respect and devotion the more importunately as she ceased to exert herself to win these. The parlor floor was covered with straw matting; the atmosphere was cool, and fragrant with flower-scent from the antique china bowl of lilies and roses that crowned the centre-table, and the tiny glass of mignonette, renewed every morning, which stood on the mantel directly beneath the crayon picture. With a smothered exclamation she receded a step within the obscurity of the room, and apparently divining the cause of the movement, the intruder advanced to an open space where the moon shone most clearly, and removed his hat with a gesture of courteous appeal. Youthful appetite is seldom totally destroyed or cheated long by misery. One arm was flung above his head on the pillow, and the loose sleeve of the dressing-gown had slipped down, exposing a slender wrist with sharply developed muscles, tough as whip-cord, elastic as tempered steel. Constant study of such must produce mental dyspepsia, THRICE - WARNED. and by overheating the imagination render everyday life stale and distasteful." There were sorrowful depths in his honest gray eyes, and for an instant stern lines about his chin. she cried, in a gush of unaccountable fond THRICE - WASHED. At the height of his astonishment at the audacious attack, the elder brother did not change countenance. Her heart was swelling with wrath and pity, but Hadassah smiled significantly at the telling random speech of the servant, as she patted the huge head and released her grasp of the collar. His forbearance and generosity are lessons any Christian might copy, although the dear fellow makes no profession of piety. The dewdrops of wounded affection suffused the matchless eyes and emphasized the loving reproach. Maxwell has powerful friends at the North, who will prove his innocence triumphantly. "Lepapier est le plus perfide confidante du monde J" quoted Hadassah. Hadassah's rapid utterances swept him along as a feather on a rushing stream. The spinster was scrupulously neat in her personal belongings, ready in emergencies, and a marvel of self-possession among women. echoed the emphatic housekeeper; and at her stride toward them, the group in the background disappeared into the outer room, where the jets of fresh blood dotted the floor between the double row of laden tables. She often expressed her regret, that custom forbade her appearing thus apparelled before her gentlemen admirers. Creeping noiselessly up to it in the dense shade of the trees, she peeped in. The pulse bounded high and hurriedly, then sank almost into stillness. Their depths were cloudy, and vaguely troubled, but her gaze was intent, and seemingly intelligent, and the dry lips fluttered in the effort at articulation. Terrified by her increasing agitation, Mr. Todd tried to pacify her by producing a couple from former school fellows, which had arrived during her sickness. Her hair was plainly arranged, and the fashion of her attire simple as a nun's. The stained stone at the upper end guarded the fugitive from intrusion. But the deed that overshadows my path has darkened yours also. All this, while the cool, plump hand rested upon her former lover's wrist. They had walked and talked together ever since, apparently upon excel WEDDING-HASTE. lent terms with one another, their looks and gestures expressive of mutual esteem and sincere good-will. On the contrary, I enjoy a rousing winter tempest when one is snugly housed." the Humphreys nose in the air, the Humphreys neck curved, languishing and smiling, rustling her new silk trimmed with crape, and rebuking with lofty nods and frowns her husband's serious mien. Fifteen minutes later, the travelling carriage destined for the use of the newly-wedded pair drew up to the door, and The drowsy lids lifted as the winter sunshine played upon the white coverlet through a gap between the curtains; the fingers dallied feebly with the clothes. Her heart sank like a stone into bottomless depths, a mist floated over her eyes as Popular applause drowned for the hour the ceaseless murmurs of conscience. It was a smaller apartment than the original building; fire-proof, wellventilated and warmed, and had latticed panes that looked picturesque, and were an iron net-work. He stooped to kiss her again, silently, but in exceeding tenderness. They are awfully troublesome, and the responsibility of raising them is fearful. With a larger capacity for grief had been bestowed extraordinary elasticity and strength. The partiality had grown upon him with other customs consequent upon their constant companionship. These were the heavy tidings brought by the reluctant messenger, who nevertheless pleaded the cause of the delinquent with zealous eloquence and with fraternal affection, the more marvellous since the favorite younger son had ever scorned the modest virtues of his less brilliant senior. When the festivities were at their height, the hero of the ball stole from the throng to seek rest and coolness in the garden walks. who rate physical life a curse when the fire of intellect is quenched! the prisoner at the bar guilty or not guilty of the crime with which he stands charged The blow had fallen, the shock dashed aside the screen that had hidden the hideous secret of his existence. His composure was not hardihood, as many believed, but the calm of one utterly hopeless and desperate. Heads were shaken sadly, and lips compressed in unuttered sagacity, as the assembly broke up. He is willing to abide patiently the legal punishment of his crime. I was sensible, practical, accustomed to deny myself the pleasures other young ladies considered their right. Her head sank lower and lower with the burden of her confession. The rain hissed against the windows; the wind roared furiously through the naked branches of the grove; and wandering, halting steps echoed and re-echoed in the corridor. They heeded naught of this—the pair crouching before the dying blaze. The funeral procession of thoughtspectres thronging their souls left no room for the indulgence of superstitious fancies. The curtains of three large windows were in flames, and the tableau illuminated by the glare was enough to drive one mad with horror. Columns of stifling smoke were rolling along the ceiling of chamber and entry, and beneath their folds knelt Hadassah— Alarmed by the stony immobility of her she addressed, she would have lifted her by main force. She was familiar with Scripture figures; believed in charming away sickness of mind and body. Advertisements had gone far and near; princely rewards been offered for his apprehension or for any definite information respecting his fate, but in vain. 62