NLP之WE之Skip-Gram:基於TF利用Skip-Gram模型實現詞嵌入並進行視覺化、過程全記錄
阿新 • • 發佈:2018-11-11
NLP之WE之Skip-Gram:基於TF利用Skip-Gram模型實現詞嵌入並進行視覺化
輸出結果
程式碼設計思路
程式碼執行過程全記錄
3081 originated -> 12 as 3081 originated -> 5234 anarchism 12 as -> 3081 originated 12 as -> 6 a 6 a -> 12 as 6 a -> 195 term 195 term -> 2 of 195 term -> 6 a Initialized Average loss at step 0 : 299.51260376 Nearest to was: guelleh, joaquim, phylum, distributive, rotating, rebounds, stance, admirer, Nearest to which: isomerism, kim, reminiscent, sos, wishful, bounce, lengthening, scranton, Nearest to into: antigens, longtime, lambs, spake, royals, tius, macrophages, canova, Nearest to these: teutoburg, fly, pranksters, october, atemi, slayton, ffff, achievable, Nearest to and: contests, compromising, gunpowder, stripping, tuple, coyne, undocumented, attains, Nearest to has: stimuli, widens, discos, obelisk, interrupting, crts, showa, fraenkel, Nearest to time: doesn, deformities, hardback, brod, biathletes, artistic, graphene, doubtful, Nearest to are: lining, grappelli, nsfnet, machado, genie, semicolon, sink, nongovernmental, Nearest to with: wilbur, participation, nuisance, repetitive, chases, intersect, reformer, trout, Nearest to their: disregard, ant, jerk, dire, computerized, madeleine, unrwa, herbrand, Nearest to there: reset, gms, takeover, wizardry, stressed, cohn, diagram, intrigued, Nearest to b: abbahu, mariano, ellipsis, unleashing, ideally, message, changeable, devil, Nearest to will: grad, banna, lockwood, occurrence, sprague, dispersing, wai, dictated, Nearest to many: nontrinitarian, tolvaj, ifn, supers, offspring, targ, minos, sacrificing, Nearest to first: blas, satirizing, xenosaga, juice, fora, woes, hancock, wark, Nearest to be: dethroned, women, lamia, taxonomic, irate, amu, woodrow, agnesi, Average loss at step 2000 : 113.632992456 Average loss at step 4000 : 53.2114667625 Average loss at step 6000 : 32.964022455 Average loss at step 8000 : 23.6010678512 Average loss at step 10000 : 17.7899276738 Nearest to was: is, stance, in, has, fertile, had, engine, archive, Nearest to which: boroughs, pleas, impressed, one, grouped, reminiscent, kim, and, Nearest to into: in, for, oklahoma, would, otto, was, antigens, might, Nearest to these: october, atemi, algebraically, fly, our, illustrations, edmonton, centers, Nearest to and: in, of, or, as, the, with, zero, UNK, Nearest to has: is, protons, was, captain, heavy, have, trivia, sadler, Nearest to time: doesn, artistic, molinari, real, particulars, designation, privately, reproduction, Nearest to are: is, were, and, for, sink, does, sigma, electric, Nearest to with: in, and, for, of, as, significant, repetitive, pleas, Nearest to their: the, ant, expected, disregard, overview, up, southeast, gothic, Nearest to there: above, now, sanction, bckgr, stock, diagram, gods, professional, Nearest to b: message, deaf, ford, UNK, devil, suspense, typical, career, Nearest to will: occurrence, agave, fricatives, additional, wherein, aikido, yeast, heir, Nearest to many: ambients, function, polemical, evidence, decades, capitalization, seward, gb, Nearest to first: archie, juice, overview, hancock, vast, services, poll, active, Nearest to be: have, crime, woodrow, women, need, lied, books, intense, Average loss at step 12000 : 14.0033162159 Average loss at step 14000 : 11.7605496879 Average loss at step 16000 : 9.81052753329 Average loss at step 18000 : 8.56377221251 Average loss at step 20000 : 8.00662653184 Nearest to was: is, has, had, by, were, agouti, operatorname, are, Nearest to which: that, and, this, acacia, also, agouti, UNK, boroughs, Nearest to into: for, in, on, by, antigens, operatorname, and, amazonas, Nearest to these: the, october, his, atemi, our, gollancz, algebraically, truetype, Nearest to and: in, or, agouti, operatorname, of, apatosaurus, for, circ, Nearest to has: was, is, had, have, agouti, were, by, are, Nearest to time: doesn, artistic, privately, molinari, real, particulars, designation, verbal, Nearest to are: were, is, was, and, but, for, operatorname, dimension, Nearest to with: in, for, and, as, by, of, from, when, Nearest to their: the, his, ant, gaul, ulyanov, circ, agouti, its, Nearest to there: now, above, it, truetype, avant, this, takeover, sanction, Nearest to b: d, deaf, and, message, american, derive, ford, builder, Nearest to will: occurrence, fricatives, operatorname, grad, agouti, agave, seasonally, heir, Nearest to many: some, ambients, polemical, offspring, these, epistles, function, decades, Nearest to first: vast, hancock, juice, poll, and, active, integer, archie, Nearest to be: have, was, is, not, cimmerian, lied, by, as, Average loss at step 22000 : 7.10389018786 Average loss at step 24000 : 6.86780297577 Average loss at step 26000 : 6.71077035868 Average loss at step 28000 : 6.38663281119 Average loss at step 30000 : 5.8886589371 Nearest to was: is, had, has, were, agouti, by, became, operatorname, Nearest to which: that, this, also, and, it, agouti, acacia, arin, Nearest to into: by, for, from, on, in, amazonas, to, operatorname, Nearest to these: many, october, atemi, the, his, our, some, algebraically, Nearest to and: or, in, operatorname, agouti, apatosaurus, circ, one, for, Nearest to has: was, had, is, have, agouti, by, were, trois, Nearest to time: doesn, privately, artistic, molinari, particulars, hardback, verbal, hydrogen, Nearest to are: were, is, was, but, have, be, dimension, operatorname, Nearest to with: in, for, and, by, from, as, when, six, Nearest to their: the, his, its, ant, ulyanov, gaul, circ, agouti, Nearest to there: it, now, above, this, they, which, truetype, he, Nearest to b: d, deaf, message, and, derive, american, builder, one, Nearest to will: can, would, to, could, fricatives, seasonally, occurrence, heir, Nearest to many: some, these, the, polemical, ambients, minos, offspring, spatially, Nearest to first: vast, hancock, integer, enver, archie, active, present, poll, Nearest to be: have, was, is, by, not, were, are, as, Average loss at step 32000 : 5.94304618776 Average loss at step 34000 : 5.68958163345 Average loss at step 36000 : 5.80174588549 Average loss at step 38000 : 5.49352391732 Average loss at step 40000 : 5.27859743583 Nearest to was: is, has, had, were, by, became, agouti, be, Nearest to which: that, this, also, it, and, one, agouti, who, Nearest to into: from, on, by, in, amazonas, cue, zero, for, Nearest to these: many, some, such, atemi, october, their, our, all, Nearest to and: or, apatosaurus, in, agouti, operatorname, but, zero, dasyprocta, Nearest to has: had, was, have, is, were, agouti, in, handwriting, Nearest to time: privately, doesn, artistic, particulars, ciprofloxacin, verbal, inflected, truetype, Nearest to are: were, is, have, was, but, senex, operatorname, sophocles, Nearest to with: in, and, for, when, from, between, by, as, Nearest to their: his, its, the, ulyanov, circ, these, gaul, agouti, Nearest to there: now, it, they, which, this, he, above, also, Nearest to b: d, deaf, message, UNK, builder, and, derive, seven, Nearest to will: can, would, could, to, fricatives, seasonally, modules, agouti, Nearest to many: some, these, polemical, ambients, those, several, minos, spatially, Nearest to first: vast, rang, catania, hancock, active, present, second, republic, Nearest to be: have, was, were, by, is, bali, not, been, Average loss at step 42000 : 5.37903095126 Average loss at step 44000 : 5.25252643383 Average loss at step 46000 : 5.25466829693 Average loss at step 48000 : 5.22855424786 Average loss at step 50000 : 4.98294925487 Nearest to was: is, were, had, has, became, by, agouti, be, Nearest to which: this, that, also, it, and, arin, dasyprocta, acacia, Nearest to into: from, on, cue, by, in, operatorname, amazonas, to, Nearest to these: some, many, such, atemi, all, the, their, braking, Nearest to and: or, but, agouti, operatorname, apatosaurus, dasyprocta, four, six, Nearest to has: had, was, have, is, agouti, were, in, vampire, Nearest to time: privately, artistic, doesn, inflected, verbal, ciprofloxacin, truetype, agouti, Nearest to are: were, is, have, was, be, sophocles, seven, semicolon, Nearest to with: in, and, when, for, by, from, six, eight, Nearest to their: his, its, the, yoannis, ulyanov, her, these, circ, Nearest to there: it, now, they, which, this, also, he, above, Nearest to b: d, message, deaf, UNK, builder, derive, circ, one, Nearest to will: can, would, could, to, yoannis, seasonally, fricatives, and, Nearest to many: some, these, several, those, polemical, ambients, two, spatially, Nearest to first: second, rang, vast, catania, enver, bey, present, hancock, Nearest to be: have, was, were, is, bali, by, been, are, Average loss at step 52000 : 5.04070786262 Average loss at step 54000 : 5.16535256505 Average loss at step 56000 : 5.05901861382 Average loss at step 58000 : 5.06915320337 Average loss at step 60000 : 4.95321713698 Nearest to was: is, had, were, has, became, by, agouti, be, Nearest to which: this, that, also, it, arin, acacia, dasyprocta, but, Nearest to into: from, on, cue, eight, by, over, under, in, Nearest to these: some, many, such, all, their, atemi, other, braking, Nearest to and: or, but, apatosaurus, agouti, operatorname, circ, in, albury, Nearest to has: had, have, was, is, agouti, in, vampire, eight, Nearest to time: privately, michelob, doesn, artistic, ciprofloxacin, inflected, agouti, verbal, Nearest to are: were, is, have, be, was, semicolon, pulau, six, Nearest to with: in, and, between, when, for, by, six, repetitive, Nearest to their: his, its, the, her, yoannis, ulyanov, michelob, these, Nearest to there: it, they, now, this, which, he, also, above, Nearest to b: d, message, derive, deaf, builder, walter, typical, ursus, Nearest to will: can, would, could, yoannis, may, to, must, seasonally, Nearest to many: some, these, several, those, ambients, polemical, three, two, Nearest to first: second, rang, bey, catania, last, vast, present, enver, Nearest to be: have, been, were, was, bali, pulau, by, are, Average loss at step 62000 : 5.00975782585 Average loss at step 64000 : 4.84033363408 Average loss at step 66000 : 4.60538381827 Average loss at step 68000 : 4.96697095311 Average loss at step 70000 : 4.89936179054 Nearest to was: is, were, had, has, became, by, agouti, be, Nearest to which: that, this, also, it, microcebus, arin, but, who, Nearest to into: from, on, cue, through, over, under, eight, amazonas, Nearest to these: some, many, such, all, their, other, which, they, Nearest to and: or, but, agouti, mitral, microcebus, operatorname, apatosaurus, circ, Nearest to has: had, have, was, is, agouti, eight, reparations, michelob, Nearest to time: privately, michelob, artistic, ciprofloxacin, doesn, cebus, verbal, agouti, Nearest to are: were, is, have, be, was, semicolon, but, upanija, Nearest to with: when, between, in, and, repetitive, thaler, by, for, Nearest to their: its, his, the, her, thaler, yoannis, michelob, some, Nearest to there: they, it, now, which, he, this, still, usually, Nearest to b: d, seven, UNK, message, derive, ursus, builder, circ, Nearest to will: can, would, could, may, to, must, yoannis, thaler, Nearest to many: some, these, several, various, those, ambients, polemical, thaler, Nearest to first: second, last, bey, rang, catania, present, under, vast, Nearest to be: been, have, were, was, bali, by, pulau, is, Average loss at step 72000 : 4.76643716341 Average loss at step 74000 : 4.80032113028 Average loss at step 76000 : 4.72049832308 Average loss at step 78000 : 4.81389507228 Average loss at step 80000 : 4.81387408137 Nearest to was: is, had, were, has, became, by, agouti, be, Nearest to which: this, that, also, it, microcebus, arin, but, dasyprocta, Nearest to into: from, through, on, cue, under, to, over, amazonas, Nearest to these: some, many, such, all, which, their, they, other, Nearest to and: or, but, microcebus, operatorname, mitral, agouti, upanija, apatosaurus, Nearest to has: had, have, was, is, agouti, in, reparations, vampire, Nearest to time: privately, michelob, doesn, escuela, artistic, ciprofloxacin, cebus, emulation, Nearest to are: were, is, have, be, was, pulau, semicolon, upanija, Nearest to with: in, between, when, repetitive, thaler, and, make, by, Nearest to their: its, his, the, her, thaler, yoannis, some, michelob, Nearest to there: it, they, now, which, he, this, still, usually, Nearest to b: d, UNK, message, seven, circ, ursus, agouti, derive, Nearest to will: can, would, could, may, must, czes, to, yoannis, Nearest to many: some, these, several, various, those, all, ambients, polemical, Nearest to first: second, last, bey, catania, rang, during, present, under, Nearest to be: been, have, were, by, was, bali, pulau, is, Average loss at step 82000 : 4.76806989324 Average loss at step 84000 : 4.76034037805 Average loss at step 86000 : 4.78169750309 Average loss at step 88000 : 4.75147537124 Average loss at step 90000 : 4.72619627428 Nearest to was: is, had, has, were, became, by, been, agouti, Nearest to which: that, this, also, microcebus, it, but, arin, who, Nearest to into: from, through, on, under, cue, by, amazonas, over, Nearest to these: some, many, such, all, which, several, they, their, Nearest to and: or, but, microcebus, mitral, apatosaurus, agouti, operatorname, while, Nearest to has: had, have, was, is, reparations, agouti, uses, unable, Nearest to time: privately, michelob, doesn, escuela, days, artistic, ciprofloxacin, condorcet, Nearest to are: were, have, is, be, pulau, those, include, upanija, Nearest to with: between, in, when, repetitive, thaler, and, for, six, Nearest to their: its, his, the, her, yoannis, thaler, our, michelob, Nearest to there: they, it, now, he, which, this, usually, still, Nearest to b: d, UNK, message, six, derive, seven, ursus, builder, Nearest to will: can, would, could, may, must, czes, to, yoannis, Nearest to many: some, several, these, various, those, all, groups, ambients, Nearest to first: second, last, bey, jati, under, rang, catania, present, Nearest to be: been, have, were, are, by, is, bali, pulau, Average loss at step 92000 : 4.66262474084 Average loss at step 94000 : 4.70650331116 Average loss at step 96000 : 4.68686405849 Average loss at step 98000 : 4.59285849941 Average loss at step 100000 : 4.71168959773 Nearest to was: is, had, has, were, became, been, by, be, Nearest to which: that, this, also, but, microcebus, it, arin, what, Nearest to into: from, through, under, cue, on, amazonas, over, by, Nearest to these: many, some, such, several, all, their, they, both, Nearest to and: or, but, microcebus, operatorname, mitral, apatosaurus, agouti, circ, Nearest to has: had, have, was, is, reparations, agouti, unable, vampire, Nearest to time: michelob, escuela, privately, doesn, agouti, thaler, artistic, cebus, Nearest to are: were, is, have, larch, be, include, semicolon, these, Nearest to with: between, in, when, repetitive, by, thaler, for, mitral, Nearest to their: its, his, the, her, thaler, our, yoannis, some, Nearest to there: they, it, now, he, which, this, usually, still, Nearest to b: d, derive, UNK, message, seven, deaf, circ, six, Nearest to will: can, would, could, may, must, czes, to, should, Nearest to many: some, several, these, various, those, all, groups, such, Nearest to first: second, last, bey, rang, under, jati, third, catania, Nearest to be: been, have, is, were, by, was, bali, pulau,