Web上のプレインテキストを大量にスクレイピングするときに形式が異なる文書をどのように処理するべきか
#
`Plain Text UTF-8``html`
json
{
"QUEEN":"Good Hamlet, cast thy nighted colour off, And let thine eye look
like a friend on Denmark. Do not for ever with thy vailed lids Seek for
thy noble father in the dust. Thou know’st ’tis common, all that lives
must die, Passing through nature to eternity.",
"HAMLET":"Ay, madam, it is common."
}
#
`json`
##
Anne of Green GablesChronicles of Avonlea
Hamlet`Dramatis Personæ`
#
“I’m not expecting a girl,” said Matthew blankly. “It’s a boy I’ve come
for. He should be here. Mrs. Alexander Spencer was to bring him over
from Nova Scotia for me.”
#
MARCELLUS. My good lord.
HAMLET. I am very glad to see you.—Good even, sir.— But what, in faith,
make you from Wittenberg?