网站首页  词典首页

请输入您要查询的词汇:

 

词汇 tokenization
释义 tokenization
noun[ U ]
(UK usuallytokenisation)uk /ˌtəʊ.kən.aɪˈzeɪ.ʃən/ us /ˌtoʊ.kən.əˈzeɪ.ʃən/

tokenizationnoun[U] (COMPUTING)


computing, language specialized
the process of dividing a series of characters(= letters, numbers, or other marks or signs used in writing or printing) into separate tokens(= units) that have a meaning: 将文本分割成离散单元的过程
Tokenization shows the text as a series of tokens or useful meaningful units that are larger than individual characters, but smaller than phrases and sentences.
The lowest-level form of annotation is tokenisation. 最低层次的注释是离散单元化。
computing specialized
the process of replacing a private piece of data with a token(= a different piece of data that represents the first one), in order to prevent private information being seen by someone who is not allowed to do so: (将含隐私信息的数据用另一信息,即令牌,替代,以此保护隐私)令牌化
Tokenization protects sensitive cardholder data by removing it from merchant systems entirely.令牌化通过将敏感的持卡人数据从商户系统中完全移除来保护这些数据。
Orthography-oriented tokenization and segmentation are tackled in the main by using orthographic hints such as blank spaces that mark the limits of words.
For languages such as Chinese and Japanese, the use of a dictionary for sentence tokenisation and segmentation is essential.
The integrated tokenization technology means that no cardholder data is stored, transmitted or processed at the property.
SMART Vocabulary: related words and phrases

Computer concepts
2FA
2SV
3-D printing
adaptive learning
additive manufacturing
haptics
HCI
hex
hexadecimal
hill climbing
infection
simulation
stack
tebibyte
telematic
telematics
telerobotics
teraflop
texture
word processing

You can also find related words, phrases, and synonyms in the topics:


Codes & decoding

tokenizationnoun[U] (PERSON)


the act of doing something that seems to support or help a group of people who are treated unfairly in society, such as giving a member of that group an important or public position, but that does not make changes that would help that group of people in a lasting way: 门面功夫
Research shows that groups who experience minority status often encounter tokenisation.研究表明那些有过成为少数族裔经历的人常常被人(优待)用来做门面功夫。
Compare
tokenism
There has been a tokenisation of minority rights without a real empowerment of minorities themselves.
Tokenization often results in token employees reporting as feeling lonely and disconnected from the majority employees.
By tokenization, an impression is created that a business is inclusive and diverse.
SMART Vocabulary: related words and phrases

Unfairness and favouring someone unfairly
ableism
ableist
agism
agist
Anglocentric
discrimination
discriminative
discriminatorily
discriminatory
drumhead
one-sided
one-sidedly
one-sidedness
one-way
the old school tie
two-tier
unbalance
unequal
unequally
uneven

Related word


tokenize
随便看

 

反思网英语在线翻译词典收录了377474条英语词汇在线翻译词条,基本涵盖了全部常用英语词汇的中英文双语翻译及用法,是英语学习的有利工具。

 

Copyright © 2005-2024 fscai.com All Rights Reserved 更新时间:2024/12/23 3:30:57