Skip to content
This repository was archived by the owner on Mar 25, 2026. It is now read-only.
This repository was archived by the owner on Mar 25, 2026. It is now read-only.

Text Pipeline 增加 Toxicity, NSFW 检测,并且适当合并不同的 stage #41

@chtlp

Description

@chtlp

System Info

https://open-dataflow.github.io/DataFlow-Doc/en/guide/textpipeline/

Text Pipeline 需要加上 Toxicity, NSFW 检测,参考如下:
Image

利用内存直接输出的模式,适当合并算子,参考 #40

Others

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions