OpenAI ChatGPT-4开发笔记2024-06：最简Embedding

Embedding

embedding直译是：嵌入。和实际意思有些差距。其实就是把文本转换为向量表示的过程。用“向量化”更直接，但这又和tensor有点儿混。它是变成向量的一个过程。

embedding 的应用领域：

文本分类： 将文本嵌入转换为向量后，可以用于训练文本分类模型。这在垃圾邮件检测、情感分析等任务中非常有用。

语义相似度： ChatGPT embedding 可用于衡量文本之间的语义相似度。这对于搜索引擎、信息检索以及推荐系统等领域非常重要。

对话系统： ChatGPT embedding 可以用于对话系统，将用户的输入和系统生成的响应嵌入为向量，从而更好地理解上下文并生成更有针对性的回复。

实体识别： 嵌入可以用于实体识别任务，帮助模型理解文本中提到的具体实体（如人名、地点、组织等）。

命名实体识别（NER）： ChatGPT embedding 在 NER 任务中有广泛应用，用于从文本中识别和分类命名实体。

信息检索： ChatGPT embedding 可以用于改进信息检索系统，使其更能理解用户查询，并找到相关的文档或信息。

聚类分析： 将文本嵌入用于聚类分析，可以帮助发现文本数据中的模式和关联。

语言生成任务： ChatGPT embedding 可以作为输入，帮助生成连贯、相关性更强的文本，适用于自然语言生成任务。

文本摘要： 在文本摘要任务中，将输入文本嵌入为向量有助于模型理解文本的重要信息，从而更好地生成摘要。

语境理解： ChatGPT embedding 可以用于改进模型对上下文的理解，这对于在对话中保持一致性和上下文敏感性非常重要。

实际运行一个embedding如下：

import openai

response = openai.embeddings.create(
    input = "Quantum entanglement impact on future computing.",
    model="text-embedding-ada-002"
)

print(response.data[0].embedding)

运行结果：

[-0.015421177260577679, -0.017880413681268692, 0.020692910999059677, -0.011304334737360477, 
0.014986395835876465, 0.012513572350144386, -0.037309739738702774, -0.012282594107091427, 
-0.026304317638278008, -0.015230960212647915, 0.017173893749713898, 0.026141274720430374, 
0.013240473344922066, 0.0149728087708354, 0.008688848465681076, 0.0032761511392891407, 
0.014021722599864006, -0.01936138980090618, 0.016385849565267563, -0.013845092616975307, 
-0.011868192814290524, 0.020149432122707367, 0.01421193964779377, -0.008294827304780483, 
-0.019551606848835945, 0.013043463230133057, 0.03051626868546009, -0.028233662247657776, 
-0.008960586972534657, -0.010373629629611969, 0.02999996580183506, 0.018885847181081772, 
-0.031222790479660034, -0.010577433742582798, -0.02235051803290844, -0.006430019624531269, 
0.03149452805519104, 0.005366841331124306, 0.012717376463115215, -0.02076084539294243, 
0.029103226959705353, 0.011460584588348866, 0.008980968035757542, 0.006239802576601505, 
-0.0259646438062191, 0.014565200544893742, 0.019143998622894287, -0.012894006446003914, 
-0.010251346975564957, 0.005886542145162821, 0.02697007730603218, 0.019143998622894287, 
-0.03358691558241844, -0.007010861299932003, -0.028152141720056534, -0.022173887118697166, 
-0.027703771367669106, -0.006555698812007904, 0.013491831719875336, 0.006131106987595558, 
0.0228939950466156, 0.005074722226709127, -6.968614616198465e-05, 0.009307054802775383, 
-0.023057037964463234, -0.00130519550293684, -0.02076084539294243, 0.0010164730483666062, 
0.009096456691622734, -0.0009570301044732332, 0.034782569855451584, 0.02438855916261673, 
-0.012330148369073868, 0.010611400939524174, 0.009592380374670029, -0.0162635687738657, 
-0.008158957585692406, 0.0007829474634490907, -0.0038824682123959064, 0.008743196725845337, 
0.007187491748481989, -0.009116836823523045, 0.013953788205981255, 0.011501344852149487, 
0.01243205089122057, 0.01063857413828373, -0.009442923590540886, 0.012547539547085762, 
-0.0014172877417877316, -0.0044157556258141994, 0.015978241339325905, 0.0265217088162899, 
0.014646722003817558, 0.024184754118323326, -0.013661668635904789, 0.03315213695168495, 
-0.006576079409569502, 0.020570628345012665, -0.017880413681268692, -0.020067911595106125, 
-0.014701069332659245, 0.008824718184769154, -0.03451082855463028, -0.018002696335315704, 
-0.010081510059535503, -0.013369549997150898, 0.024130405858159065, 0.005380428396165371, 
0.029347792267799377, -0.0059680636040866375, -0.025081492960453033, 0.003967386670410633, 
0.005689531564712524, -0.0026392631698399782, 0.01501356903463602, -0.007785317022353411, 
0.004089669324457645, -0.0009188168332912028, 0.006035998463630676, 0.0004933757591061294, 
0.04105973616242409, -0.00310121919028461, 0.0031182027887552977, -0.00634170463308692, 
0.009211945347487926, 0.018043456599116325, -0.020149432122707367, -0.0050271679647266865, 
-0.0008012048783712089, -0.01572008989751339, -0.00021739104704465717, 0.008539392612874508, 
-0.00737091526389122, 0.011297540739178658, -0.003665077267214656, 0.03146735578775406, 
-0.02141301892697811, -0.01630432903766632, -0.004093065857887268, -0.026168446987867355, 
-0.005913715809583664, 0.027201054617762566, -0.024021711200475693, -0.008722815662622452, 
-0.01777171902358532, 0.04505429416894913, -0.002532266080379486, 0.035869523882865906, 
0.007866838946938515, -0.005618200171738863, -0.00942933652549982, 0.00762227363884449, 
0.006779883522540331, 0.032771699130535126, 0.02599181793630123, 0.006076759193092585, 
-0.004266299307346344, 0.020244542509317398, 0.004599179606884718, -0.02740485966205597, 
-0.009103250689804554, -0.019130412489175797, -0.01986410655081272, 0.0007944114622659981, 
0.02748638018965721, 0.01735052280128002, 0.02902170456945896, -0.017948348075151443, 
0.029266269877552986, -0.016032589599490166, -0.02237769216299057, 0.021480953320860863, 
-0.027730945497751236, 0.003462971420958638, 0.01400813553482294, 0.002917795442044735, 
0.0010266632307320833, -0.0018682043300941586, -0.01883149892091751, -0.023274429142475128, 
-0.009735043160617352, -0.007982327602803707, 0.022622255608439445, 0.015652155503630638, 
-0.01671193726360798, -0.007187491748481989, 0.02940213866531849, 0.0003203545929864049, 
0.0033203086350113153, -0.010407596826553345, 0.0024116819258779287, 0.0015947672072798014, 
-0.008899446576833725, -0.016019003465771675, -0.6573905348777771, -0.0046501304022967815, 
-0.004378391429781914, -0.028070619329810143, 0.002649453468620777, 0.012336942367255688, 
0.021168453618884087, 0.009483684785664082, 0.007785317022353411, 0.01933421567082405, 
-0.0003275726339779794, 0.016956502571702003, -0.0024405543226748705, -0.011256780475378036, 
-0.019062478095293045, -0.00787363201379776, 0.0017442235257476568, -0.013906233943998814, 
0.020040737465023994, 0.00890623964369297, -0.004120239522308111, 0.03456517681479454, 
-0.005906922277063131, 0.009748630225658417, 0.014293461106717587, 0.00963314063847065, 
0.0077241756953299046, -0.0055842325091362, -0.044999945908784866, -0.0032116130460053682, 
0.0018834896618500352, 0.01718747988343239, 0.006902165710926056, 0.02031247690320015, 
0.041929297149181366, 0.0036005391739308834, 0.007798904087394476, 0.009150804951786995, 
0.002133149653673172, 0.029809746891260147, -0.01569291576743126, -0.012635855004191399, 
0.015040743164718151, 0.00018904954777099192, -0.023518994450569153, 0.012873626314103603, 
0.019171172752976418, -0.015394004061818123, -0.017010848969221115, -0.033315178006887436, 
-0.007961947470903397, 0.015638569369912148, -0.020081497728824615, 0.022214647382497787, 
-0.005774449557065964, -0.0008385690161958337, 0.03972821310162544, 0.004595782607793808, 
0.01240487676113844, 0.02194290980696678, 0.016970088705420494, 0.003906245343387127, 
-0.0388043038547039, -0.03046192042529583, -0.029103226959705353, 0.001959916204214096, 
-0.013980962336063385, 0.009877705946564674, -0.01929345540702343, -0.014402156695723534, 
0.015108677558600903, 0.014959221705794334, 0.01721465401351452, 0.006572682410478592, 
-0.003733011893928051, 0.031086919829249382, 0.019932042807340622, -0.014809764921665192, 
-0.015380416996777058, 0.01580161228775978, -0.014089657925069332, -0.023002689704298973, 
-0.027146708220243454, 7.048225234029815e-05, 0.03698365390300751, -0.0004492182342801243, 
-0.0167526975274086, -0.020176606252789497, 0.013423897325992584, -0.004374994896352291, 
0.0024269672576338053, 0.0074456436559557915, -0.014836939051747322, -0.04182060435414314, 
0.022038018330931664, 0.027255402877926826, -0.015135851688683033, -0.006165074184536934, 
0.011236400343477726, 0.0021297528874129057, -0.004626353271305561, -0.021032584831118584, 
0.020108671858906746, -0.009211945347487926, 0.030380399897694588, 0.003794153220951557, 
0.024008125066757202, -0.0012330148601904511, 0.036331478506326675, -0.03551626205444336, 
-0.00887906551361084, -0.011209226213395596, -0.010244552977383137, 0.0032642625737935305, 
-0.004123636521399021, -0.04154886305332184, 0.015285308472812176, 0.012826072052121162, 
-0.013152158819139004, -0.01677987165749073, 0.04505429416894913, 0.012194279581308365, 
0.0039130388759076595, -0.014361396431922913, -0.004059098660945892, -0.0020991822239011526, 
0.0027207848615944386, -0.01873639039695263, -0.046929292380809784, 0.005122276488691568, 
-0.010869552381336689, -0.003695647930726409, 0.017907587811350822, -0.002336953766644001, 
0.008749989792704582, -0.00817933864891529, 0.014864113181829453, -0.015991829335689545, 
-0.011861398816108704, -0.0016771380323916674, -0.03165757283568382, -0.0080978162586689, 
0.00961276050657034, 0.0037567890249192715, -0.036766260862350464, -0.01989128068089485, 
-0.033315178006887436, 0.00672893226146698, 0.0051868148148059845, -0.01936138980090618, 
0.001706859446130693, 0.02138584479689598, -0.006565888877958059, 0.01986410655081272, 
0.0021314513869583607, -0.0004386034270282835, -0.014660309068858624, -0.02241845242679119, 
-0.01728258840739727, -0.023464646190404892, 0.0020040736999362707, 0.03247278928756714, 
-0.00374320219270885, 0.002073706826195121, -8.741286001168191e-05, -0.011012215167284012, 
-0.011786671355366707, 0.009354609064757824, -0.006399448961019516, -0.006107329856604338, 
0.0069565135054290295, -0.043559730052948, 0.013804331421852112, 0.01682063192129135, 
-0.027622250840067863, 0.02842387929558754, 0.0064571937546133995, 0.007139937486499548, 
0.009198359213769436, 0.002190894214436412, 0.007581512909382582, -0.014388570562005043, 
-0.005288716871291399, -0.015543459914624691, 0.021997256204485893, 0.027690185233950615, 
0.028777141124010086, 0.008845098316669464, -0.0019565194379538298, -0.008247273042798042, 
0.01582878641784191, 0.04861407354474068, -0.007588306441903114, -0.0024524428881704807, 
-0.002396396594122052, -0.016480958089232445, 0.02182062715291977, -0.008817924186587334, 
0.0038756749127060175, 0.025801600888371468, 0.02548910118639469, 0.0048233638517558575, 
0.021589647978544235, 0.00961276050657034, -0.00047384455683641136, -0.013913027010858059, 
.017146719619631767, -0.01783965341746807, -0.0004551625170279294, 0.009510858915746212, 
0.0006296697538346052, -0.01686139404773712, -0.003255770541727543, -0.017146719619631767, 
0.005098499357700348, 0.046005379408597946, -0.03624995797872543, 0.007248632609844208, 
-0.006694965064525604, 0.003634506603702903, -0.005122276488691568, 0.006460590288043022, 
0.015489112585783005, 0.008165751583874226, -0.005682738032191992, 0.02035323716700077, 
0.004079478792846203, 0.011263573542237282, 0.00723504601046443, -0.022554321214556694, 
-0.0021586252842098475, -0.012024442665278912, 0.007167111150920391, 0.014497265219688416, 
0.02081519365310669, 0.0268749687820673, 0.0046501304022967815, -0.002705499529838562, 
0.04432060196995735, 0.01872280426323414, -0.006328117568045855, 0.013845092616975307, 
0.013953788205981255, -0.006688171532005072, 0.005754069425165653, 0.01934780366718769, 
0.0364401750266552, 0.02543475292623043, -0.0009816564852371812, -0.0016610034508630633, 
-0.03138583153486252, 0.011521725915372372, -0.025149427354335785, 0.0006007975316606462, 
0.0161956325173378, -0.018084218725562096, 0.016032589599490166, -0.012105964124202728, 
0.02332877740263939, 0.009042109362781048, -0.009082869626581669, 0.01447009202092886, 0.00658966600894928, 0.0018665059469640255, -0.003919832408428192, -0.0239401888102293, -0.0023794129956513643, -0.003057061694562435, -0.021086931228637695, 0.008070643059909344, -0.019157586619257927, -0.014809764921665192, -0.00942933652549982, -0.025652144104242325, 0.013586940243840218, 0.01823367364704609, 0.005546868313103914, 0.008817924186587334, 0.019157586619257927, 0.0010962962405756116, -0.0223369300365448, -0.018586935475468636, -0.0014852224849164486, 0.0104347700253129, -0.006005427800118923, -0.018709218129515648, 0.00860732700675726, 0.018057044595479965, 0.025788012892007828, -0.003464669920504093, 0.007812490686774254, 0.016630414873361588, 0.010319281369447708, -0.013532592914998531, -0.021168453618884087, -0.01576085202395916, 0.04277168959379196, -0.009735043160617352, 0.0032676593400537968, -0.01376357115805149, -0.013797538354992867, 0.009415749460458755, -0.0223369300365448, -0.003255770541727543, 0.027798879891633987, 0.020665736868977547, -0.012065202929079533, -0.006161677651107311, 0.00864808727055788, -0.026711925864219666, -0.0003691826423164457, 0.00130519550293684, -0.0004712970112450421, -0.003634506603702903, -0.010319281369447708, 0.02135867066681385, -3.975241634179838e-05, -0.014551613479852676, 0.03190213814377785, 0.005703118164092302, 0.006474177353084087, -0.02544833905994892, -0.006542111746966839, 0.011107323691248894, 0.05489123985171318, 0.0055638523772358894, -0.017948348075151443, 0.01068612840026617, 0.003576762042939663, -0.008668468333780766, -0.0014724846696481109, -0.023600516840815544, 0.01222824677824974, -0.021018996834754944, 0.01217389851808548, -0.0030706485267728567, 0.004473500419408083, -0.021018996834754944, 0.006158280652016401, 0.015665743499994278, 0.005023771431297064, -0.014374983496963978, -0.001109883189201355, -0.044972773641347885, -0.001871601096354425, 0.0003906245401594788, 0.010326074436306953, 0.022608669474720955, 0.002805703319609165, -0.00174592190887779, 0.019959215074777603, 0.031684745103120804, 0.0149728087708354, -0.021086931228637695, 0.018668456003069878, 0.010292107239365578, -0.004181380849331617, 0.0008016295032575727, 0.0037601857911795378, 0.004864124581217766, -0.01376357115805149, 0.017038023099303246, 0.007167111150920391, 0.0035529849119484425, -0.01834237016737461, 0.004429342690855265, 0.018179327249526978, -0.0049490430392324924, 0.014334222301840782, 0.0028651461470872164, -8.279542089439929e-05, 0.017554327845573425, -0.018695630133152008, -0.000829652592074126, 0.03366843983530998, -0.002635866403579712, -0.025013558566570282, -0.006066569127142429, -0.009062489494681358, 0.03372278809547424, 0.01122281327843666, -0.000994394184090197, -0.007323361001908779, -0.02942931279540062, -0.028586922213435173, -0.005485727451741695, 0.0008012048783712089, -0.00892661977559328, 0.0029942221008241177, -0.027635836973786354, -0.010088303126394749, -0.016413023695349693, -0.010495911352336407, -0.000945141538977623, 0.021453779190778732, -0.025230947881937027, -0.03774452209472656, -0.0001061479706550017, 0.030298877507448196, -0.004344424232840538, 0.025665730237960815, 0.017010848969221115, -0.0039028488099575043, 0.023165734484791756, -0.007180698215961456, -0.015108677558600903, -0.004395375493913889, -0.03255430981516838, 0.005944286473095417, 0.00991167314350605, -0.004473500419408083, -0.022975517436861992, -0.020964648574590683, -0.002571328543126583, 0.002814195118844509, 0.007201078347861767, 0.027649424970149994, 0.013478245586156845, 0.008987761102616787, 0.03100539930164814, -0.0003810712369158864, 0.021480953320860863, -0.0029840318020433187, -0.01376357115805149, 0.0203804112970829, -0.020665736868977547, 0.004147413652390242, -0.020570628345012665, -0.01577443815767765, 0.00026112401974387467, -0.0007111914455890656, 0.023084212094545364, -0.0038960552774369717, -0.013152158819139004, 0.007744556292891502, -0.02686138078570366, 0.019130412489175797, -0.009334228001534939, 0.006769692990928888, 0.02127714827656746, 0.018152153119444847, -0.011032596230506897, -0.03157604858279228, -0.007866838946938515, -0.004408962093293667, -0.016929328441619873, 0.011093736626207829, 0.000374702358385548, 0.001881791278719902, -0.008783956989645958, 0.0018087615026161075, 0.009463303722441196, -0.009857325814664364, 0.01524454727768898, -0.025244535878300667, 0.032309744507074356, 0.0008695641881786287, -0.03407604619860649, -0.001978598302230239, -0.028179315850138664, -0.015896720811724663, -0.013790744356811047, -0.018043456599116325, -0.0019735030364245176, -0.005540075246244669, 0.00775814289227128, -0.004656923934817314, -0.0161956325173378, -0.010366835631430149, -0.02891300991177559, -0.010910313576459885, 0.015298895537853241, 0.00519700488075614, 0.021100519225001335, -0.01345786452293396, -0.003841707482933998, -0.033777132630348206, -0.011664388701319695, -0.019633129239082336, -0.06059775501489639, -0.006042791996151209, -0.029076052829623222, 0.025108667090535164, 0.024021711200475693, 0.04154886305332184, -0.019633129239082336, 0.0037364086601883173, 0.01013585738837719, 0.004989803768694401, -0.009993194602429867, 0.010570639744400978, 0.005580835975706577, -0.02391301468014717, 0.012051616795361042, 0.002909303642809391, 0.0009188168332912028, -0.0016049573896452785, 0.00547214038670063, 0.016032589599490166, 0.03453800454735756, 0.0011124308221042156, 0.0015106979990378022, -0.011107323691248894, -0.028233662247657776, -0.021141279488801956, 0.0034884470514953136, -0.011311127804219723, -3.993817517766729e-05, -0.005618200171738863, -0.010482324287295341, 0.005006787832826376, 0.017078785225749016, 0.009809771552681923, -0.0018308402504771948, 0.01773095689713955, -0.0012049918295815587, 0.012873626314103603, 0.007669827900826931, 0.01880432665348053, -0.027010837569832802, -0.021725518628954887, -0.016535306349396706, 0.0009179676999337971, 0.014171179383993149, 0.009341021999716759, 0.01551628578454256, 0.01471465639770031, 0.01018341165035963, -0.01676628552377224, 0.004296869970858097, -0.0268749687820673, -0.007017654832452536, -0.014198352582752705, -0.018138565123081207, -0.0037364086601883173, -0.02384508028626442, -0.009055695496499538, -0.02853257581591606, 0.014904873445630074, -0.00028468886739574373, -0.02546192705631256, 0.01421193964779377, -0.011861398816108704, -0.008845098316669464, 0.011888572946190834, 0.029673878103494644, 0.0357336550951004, -0.013294821605086327, 0.019130412489175797, 0.032228223979473114, -0.008288034237921238, 0.004035321529954672, -0.023138560354709625, 0.013858679682016373, -0.004344424232840538, 0.03760865330696106, 0.011433410458266735, -0.01471465639770031, -0.007017654832452536, 0.03345104679465294, -0.02336953766644001, -0.021671170368790627, -0.03358691558241844, -0.02186138741672039, -0.005407602526247501, 0.012330148369073868, -0.021508127450942993, -0.024633122608065605, -0.011861398816108704, 0.00407608225941658, -0.020475519821047783, 0.020108671858906746, -0.03970104083418846, -0.005543471779674292, 0.0016024097567424178, 0.015122264623641968, -0.0037975499872118235, 0.025095079094171524, -0.01066574826836586, 0.01983693428337574, 0.007683414965867996, 0.007459230255335569, -0.0009808072354644537, -0.003036681329831481, -0.016168460249900818, 0.028206488117575645, -0.017513565719127655, -0.02028530277311802, -0.013288027606904507, 0.009300260804593563, -0.012642648071050644, -0.00273437169380486, -0.0020108672324568033, 0.02430703677237034, -0.01874997839331627, 0.006820644252002239, -0.00737091526389122, -0.017078785225749016, 0.05217385292053223, -0.017092371359467506, -0.004055701661854982, -0.008797544054687023, -0.014850526116788387, 0.0028940183110535145, 0.012540746480226517, 0.010529878549277782, 0.00915759801864624, -0.01624998077750206, -0.0009833548683673143, -0.01580161228775978, -0.02842387929558754, 0.0065013510175049305, 0.02637225203216076, -0.018953781574964523, -0.00860053300857544, 0.026548882946372032, 0.0208695400506258, 0.010869552381336689, 0.021589647978544235, 0.009374989196658134, -0.0027105945628136396, 0.030407574027776718, -0.011895366944372654, 0.013804331421852112, 0.049565158784389496, 0.01828802190721035, -0.015489112585783005, 0.012445637956261635, -0.002063516527414322, -0.014728243462741375, 0.0069904811680316925, -0.01778530515730381, 0.00025751497014425695, -0.016657589003443718, -0.012085583992302418, 0.028749966993927956, 0.0024694264866411686, 0.002365825930610299, 0.010427976958453655, 0.019008129835128784, 0.006328117568045855, 0.005550265312194824, -0.009211945347487926, 0.009082869626581669, -0.003590349107980728, -0.009171185083687305, 0.005383825395256281, -0.021467365324497223, 0.0035563816782087088, -0.021480953320860863, -0.01068612840026617, -0.01735052280128002, -0.023682037368416786, -0.009578793309628963, -0.007927980273962021, 0.004470103420317173, 0.006623633671551943, -0.008947000838816166, -0.0019633129704743624, -0.018994543701410294, 0.0024133804254233837, -0.01093748677521944, -0.0008542789146304131, 0.03198365867137909, -0.016059763729572296, 0.01089672651141882, 0.015421177260577679, -0.008586946874856949, -0.016997262835502625, -0.02032606303691864, 0.00040782050928100944, -0.014959221705794334, -0.027228228747844696, -0.006392655428498983, -0.00862770713865757, 0.005900129210203886, -0.0047452389262616634, -0.032690178602933884, -0.01771737076342106, -0.007914393208920956, -0.004704478196799755, -0.02341029793024063, -0.026100512593984604, -0.0015675933100283146, 0.03752712905406952, 0.014809764921665192, 0.010067922994494438, 0.03288039565086365, 0.007744556292891502, 0.010319281369447708, -0.015923894941806793, 0.009504064917564392, 0.009273086674511433, -0.024103233590722084, 0.002771735889837146, 0.022051604464650154, -0.021562475711107254, -0.0051834178157150745, 0.004660320468246937, -0.003947006072849035, -0.0010606305440887809, 0.010108684189617634, 0.0192662812769413, -0.009089663624763489, -0.006718742195516825, 0.005461950320750475, -0.007527165114879608, 0.01547552552074194, -0.008777163922786713, -0.04230973497033119, 0.023722797632217407, 0.02381790615618229, -0.007574719376862049, -0.016413023695349693, 0.01770378276705742, 0.012574713677167892, -0.0009570301044732332, 0.00017068594752345234, -0.004093065857887268, -0.02585594728589058, 0.021195627748966217, -0.03195648267865181, 0.028804313391447067, -0.007296187337487936, 0.022146712988615036, 0.018994543701410294, 0.009735043160617352, -0.030706485733389854, 0.006080155726522207, 0.010801617987453938, 0.0038756749127060175, -0.01673911139369011, 0.023695625364780426, -0.01722824014723301, -0.0019242505077272654, -0.012384496629238129, -0.00918477214872837, -0.020611388608813286, 0.005692928098142147, -0.008192924782633781, -0.007309773936867714, -0.03410322219133377, 0.001711105345748365, 0.02135867066681385, -0.0006233009044080973, 0.0077241756953299046, -0.01783965341746807, -0.008281240239739418, -0.013247267343103886, -0.0056861345656216145, 0.005054342094808817, -0.022038018330931664, -0.010821998119354248, 0.021182039752602577, -0.0010300598805770278, -0.018913021311163902, -0.005978253670036793, 0.0037703760899603367, 0.019008129835128784, 0.005927302874624729, 0.22521713376045227, -0.005577438976615667, -0.01622280664741993, 0.03260865807533264, -0.007683414965867996, -0.004938852973282337, 0.010828792117536068, -0.020203780382871628, -0.011440204456448555, 0.024279862642288208, -0.015380416996777058, 0.014307048171758652, -0.02839670516550541, -0.005135863553732634, 0.0046535274013876915, 0.013226886279881, -0.03241844102740288, -0.0124592250213027, -0.01679345779120922, 0.023002689704298973, 0.029320618137717247, -0.0013705826131626964, 0.00019945204257965088, -0.019660303369164467, 0.016426611691713333, -0.017065197229385376, 0.007955153472721577, 0.001949726021848619, -0.0080978162586689, 0.031222790479660034, -0.011365476064383984, 0.001929345540702343, -0.0036413001362234354, -0.004398772027343512, 0.0010886535746976733, -0.0057167052291333675, 0.021100519225001335, -0.008661674335598946, 0.018668456003069878, 0.01577443815767765, 0.010788030922412872, -0.007764936424791813, 0.011100530624389648, -0.007214665412902832, 0.009239119477570057, 0.016426611691713333, -0.0055910260416567326, -0.018586935475468636, -0.014048896729946136, 0.005040755029767752, -0.022255409508943558, -0.020543454214930534, 0.016644002869725227, 0.02279888652265072, -0.008566565811634064, -0.01044156402349472, -0.0038620878476649523, 0.01064536813646555, 0.015489112585783005, 0.00029912497848272324, -0.01444291789084673, -0.0002931806957349181, -0.004877711646258831, 0.01580161228775978, -0.011331508867442608, 0.003473161719739437, -0.023559754714369774, 0.043858643621206284, 0.01567932963371277, -0.003794153220951557, -0.0228939950466156, 0.002318271668627858, -0.010774443857371807, 0.015883132815361023, -0.014918460510671139, -0.00494224950671196, 0.02894018404185772, -0.007513578049838543, 0.02956518344581127, 0.029103226959705353, 0.0182200875133276, 0.00892661977559328, -0.001731485710479319, -0.015448351390659809, -0.026779860258102417, -0.024538014084100723, 0.03410322219133377, -0.01618204638361931, 0.005339667666703463, -0.006508144550025463, -0.0025832171086221933, 0.020149432122707367, -0.0074456436559557915, -0.01494563464075327, 0.013980962336063385, 0.007133143953979015, -0.008940206840634346, 0.0023794129956513643, 0.00773776276037097, 0.0023879047948867083, -0.01932062953710556, 0.038912996649742126, -0.015597808174788952, -0.010584226809442043, 0.01167118176817894, 0.016603240743279457, -0.0018749978626146913, 0.009334228001534939, 0.015883132815361023, -0.017567913979291916, 0.002686817431822419, -0.0010028860997408628, 0.021249976009130478, -0.003590349107980728, -0.012486398220062256, 0.019171172752976418, 0.0003141979977954179, -0.0007604440907016397, 0.0354619137942791, -0.014701069332659245, -0.008580152876675129, -0.01976899802684784, -0.018940195441246033, 0.013899439945816994, 0.014932047575712204, -0.026725511997938156, -0.010407596826553345, -0.002938175806775689, -0.020054323598742485, -0.023709211498498917, 0.01940215192735195, 0.0015387210296466947, -0.005937492940574884, -0.008987761102616787, -0.012411669827997684, -0.0030774420592933893, 0.006022411398589611, -0.018573347479104996, -0.008362761698663235, 0.0014121925923973322, -0.02692931704223156, -0.010489118285477161, 0.006148090586066246, -0.0013119889190420508, -0.01773095689713955, -0.021018996834754944, 0.024714644998311996, -0.0037975499872118235, -0.008980968035757542, -0.022228235378861427, -0.012995908968150616, 0.0016406230861321092, -0.013539385981857777, -0.007105969823896885, 0.008872272446751595, 0.004062495194375515, -0.03703799843788147, -0.03144017979502678, -0.018152153119444847, 0.011630421504378319, -0.028288010507822037, -0.003909642342478037, 0.007812490686774254, -0.005475536920130253, 0.008002707734704018, 0.007574719376862049, -0.1747824102640152, 0.0005230972310528159, 0.005781243089586496, -0.011297540739178658, 0.021671170368790627, 0.012533952482044697, 0.01880432665348053, -0.006976894102990627, -0.024103233590722084, -0.018967369571328163, -0.011392650194466114, -0.0026528502348810434, -0.03502713143825531, -0.02535323053598404, 0.03315213695168495, 0.0016117508057504892, -0.043940167874097824, 0.023532580584287643, 0.017065197229385376, 0.007078796159476042, 0.005261542741209269, -0.04163038730621338, 0.009252706542611122, -0.014918460510671139, 0.033695612102746964, -0.002763244090601802, -0.02228258177638054, 0.0005048397579230368, -0.001712803728878498, -0.009395369328558445, 0.006270373240113258, -0.023097798228263855, 0.04635864123702049, -0.010706509463489056, 0.023260843008756638, 0.010455151088535786, 0.01618204638361931, -0.004035321529954672, 0.0002583641617093235, -0.009497271850705147, 0.02535323053598404, 0.053532544523477554, -0.0029211922083050013, 0.003624316304922104, -0.018654869869351387, 0.015665743499994278, 0.023505406454205513, -0.02134508453309536, -0.00496942363679409, -0.024239102378487587, 0.016168460249900818, -0.030760833993554115, -0.004198364447802305, -0.004422549158334732, 0.01672552339732647, 0.0005281923222355545, -0.0026630403008311987, 0.004741842392832041, -0.02076084539294243, -0.007554338779300451, 0.003970783203840256, -0.029701052233576775, -0.0028430672828108072, -0.003451082855463028, -0.006576079409569502, -0.015285308472812176, 0.00508151575922966, -0.01063857413828373, -0.033233657479286194, 0.008328794501721859, -0.022785300388932228, 0.008980968035757542, 0.005319287069141865, 0.008172544650733471, -0.010427976958453655, 0.031222790479660034, -0.00892661977559328, 0.023070625960826874, -0.01582878641784191, -0.0027190865948796272, -0.0047758095897734165, 0.025054318830370903, 0.00938178226351738, -0.0025832171086221933, -0.00815216451883316, -0.006521731615066528, -0.009395369328558445, 0.011202432215213776, -0.001581180258654058, -0.019130412489175797, 0.02279888652265072, -0.03948364779353142, 0.0248505137860775, -0.019198346883058548, 0.014429330825805664, 0.017038023099303246, 0.0014487075386568904, 0.001919155358336866, 0.00494224950671196, -0.031277138739824295, -0.007697002030909061, 0.004127033054828644, 0.010292107239365578, 0.0018172533018514514, 0.007513578049838543, 0.02078801952302456, -0.03589669615030289, 0.01889943517744541, 0.03907604143023491, -0.023233668878674507, -0.006463986821472645, -0.0016516625182703137, 0.009571999311447144, 0.010278520174324512, -0.009748630225658417, 0.025720078498125076, -0.013301614671945572, -0.012989114969968796, -0.008070643059909344, -0.0015574031276628375, 0.0751086100935936, 0.004592386074364185, -0.017486393451690674, 0.003997957333922386, -0.011508138850331306, -0.015964655205607414, -0.10956508666276932, -0.039320606738328934, -0.013124984689056873, 0.028831487521529198, 0.008743196725845337, 0.028858661651611328, -0.0031114094890654087, 0.02135867066681385, -0.023722797632217407, 0.04309777542948723, -0.00457879900932312, -0.033315178006887436, -0.012669822201132774, -0.01831519603729248, -0.03502713143825531, -0.03570647910237312, -0.006290753372013569, -0.02226899564266205, -0.016168460249900818, 0.024524427950382233, 0.0007787015638314188, -0.016657589003443718, -0.001070820726454258, -0.014225526712834835, -0.01345786452293396, 0.007547545712441206, -0.018654869869351387, 0.004069288726896048, 0.0016109016723930836, 0.006565888877958059, 0.015108677558600903, -0.013749984093010426, -0.023138560354709625, -0.023152146488428116, -0.01569291576743126, 0.005978253670036793, 0.0167526975274086, -0.013559767045080662, 0.01680704578757286, -0.023682037368416786, 0.010427976958453655, 0.003648093668743968, 0.0007319964352063835, 0.001047892845235765, 0.00673232926055789, 0.012364115566015244, -0.03217387571930885, 0.019116826355457306, 0.002763244090601802, -0.0016966692637652159, -0.027771707624197006, -0.00045388872968032956, -0.01683421991765499, 0.012418463826179504, 0.022622255608439445, -0.002190894214436412, 0.029130401089787483, 0.019673889502882957, -0.03288039565086365, -0.004218745045363903, -0.011705148965120316, 0.003512224182486534, -0.024130405858159065, 0.0031487734522670507, -0.00430366350337863, -0.011562486179172993, -0.014048896729946136, -0.021100519225001335, 0.0067085521295666695, -0.00286174938082695, 0.004235728643834591, 0.007561132311820984, -0.004218745045363903, 0.019076064229011536, -0.01091710664331913, 0.001521737314760685, -0.016521720215678215, -0.010278520174324512, 0.02032606303691864, 0.017663022503256798, -0.021182039752602577, -0.01887226104736328, 0.004208554979413748, 0.010869552381336689, 0.027051599696278572, 0.01777171902358532, -0.01494563464075327, 0.004962630104273558, 0.011249986477196217, -0.002635866403579712, -0.006494557484984398, 0.020149432122707367, -0.005115482956171036, -0.010557052679359913, -0.0022061795461922884, 0.0046501304022967815, -0.015312481671571732, -0.010781237855553627, 0.019103238359093666, 0.03698365390300751, -0.015434764325618744, -0.009347815066576004, -0.035788003355264664, 0.03861408680677414, 0.0007659638067707419, -0.011854605749249458, -0.01474183052778244, 0.014483679085969925, 0.02942931279540062, -0.015298895537853241, 0.009402163326740265, 0.02188856154680252, -0.005363444797694683, 0.007764936424791813, -0.004408962093293667, -0.016426611691713333, -0.01985052041709423, -0.01631791517138481, 0.015339655801653862, -0.018029870465397835, 0.026277143508195877, -0.0052343690767884254, 0.021480953320860863, -0.0041677942499518394, -0.013016289100050926, 0.018573347479104996, -0.0004016639431938529, 0.016059763729572296, -0.02953800931572914, -0.026671163737773895, -0.018953781574964523, -0.01016303151845932, -0.004273092839866877, 0.0029025101102888584, -0.015285308472812176, 0.0021450382191687822, -0.0014707862865179777, 0.011154877953231335, 0.010788030922412872, 0.02240486443042755, 0.03163039684295654, 0.055162977427244186, -0.0060971397906541824, -0.03399452567100525, -0.008423903025686741, -0.005526488181203604, 0.011283954605460167, 0.005502711050212383, -0.009646727703511715, 0.004286679904907942, 0.01222824677824974, 0.0053906189277768135, 0.016970088705420494, 0.025135839357972145, 0.010081510059535503, -0.010815205052495003, -0.011936127208173275, -0.004626353271305561, -0.00961276050657034, -0.007764936424791813, -0.010380422696471214, 0.00235903263092041, 0.021562475711107254, 0.00519700488075614, 0.010699715465307236, 0.014605960808694363, 0.01735052280128002, 0.0010436468292027712, -0.021548887714743614, -0.013641288504004478, 0.01573367789387703, -0.03437495976686478, 0.0016168459551408887, -0.0037839629221707582, 0.014415743760764599, -0.00597485713660717, -0.004161000717431307, -0.01044156402349472, -0.014171179383993149, -0.012499985285103321, -0.01826084777712822, -0.009320640936493874, 0.016086937859654427, -0.01923910714685917, -0.01679345779120922, -0.0019344406900927424, 0.020978236570954323, 0.012370909564197063, 0.003104615956544876, 0.009198359213769436, 0.008254066109657288, 0.004177984315901995, 0.02744561992585659, 0.011046182364225388, -0.012105964124202728, -0.000778276938945055, -0.0012406575260683894, 0.0045720054768025875, 0.0006721289828419685, 0.020095085725188255, 0.02032606303691864, 0.02089671418070793, 0.005261542741209269, 0.018682043999433517, -0.006351894699037075, -0.02790757641196251, -0.03157604858279228, 0.029755400493741035, -0.03105974569916725, -0.024660296738147736, -0.012832865118980408, 0.027309751138091087, 0.003970783203840256, 0.020638562738895416, 0.013478245586156845, 0.00583898788318038, -0.026684751734137535, 0.026603229343891144, -0.034864090383052826, -0.031249962747097015, -0.027690185233950615, 0.02292116917669773, 0.009578793309628963, 0.007289393804967403, -0.009313847869634628, -0.007248632609844208, 0.04570646956562996, 0.025190187618136406, 0.03057061694562435, -0.024782579392194748, 0.022133126854896545, -0.014144005253911018, 0.04103256016969681, -0.00672893226146698, -0.007085589691996574, -0.011433410458266735, -0.008362761698663235, -0.004782603122293949, -0.010550259612500668, 0.01976899802684784, -0.007466023787856102, 0.07940208166837692, 0.038369521498680115, -0.01089672651141882, 0.01394020114094019, -0.016059763729572296, -0.015176612883806229, 0.007697002030909061, 0.01770378276705742, -0.03163039684295654, -0.02989126928150654, 0.021032584831118584, -0.0065013510175049305, 0.014660309068858624, -0.015951069071888924, 0.007377708796411753, 0.0009459907305426896, -0.007289393804967403, 0.038831476122140884, -0.01872280426323414, -0.0157065037637949, 0.012785310856997967, -0.007221458945423365, 0.022730952128767967, 0.008186131715774536, -0.012832865118980408, -0.013586940243840218, 0.011453790590167046, -0.0038145335856825113, -0.009769010357558727, -0.040489085018634796, 0.004137223586440086, -0.008199718780815601, -0.0198233462870121, -0.018709218129515648, 0.017459219321608543, 0.002773434156551957, -0.0023437472991645336, -0.03557061031460762, -0.008077436126768589, -0.008417109958827496, -0.016956502571702003, 0.010604606941342354, -0.011059769429266453, 0.0032897379714995623, -0.0033576725982129574, .001910663559101522, -0.0030638552270829678, 0.00661684013903141, -0.027268989011645317]

这才一句话而已。
向量出来了，各种比对，就有戏唱了。