Search results

Segmenter docs are lacking an explanation for the InvariantOptions design

C-segmentationComponent: SegmentationComponent: Segmentation

T-docs-testsType: Code change outside core libraryType: Code change outside core library

Status: Open.

#6660 In unicode-org/icu4x;

· sffc opened on Jun 12, 2025

Allow line segmenter break around quotation mark for CJ

C-segmentationComponent: SegmentationComponent: Segmentation

S-mediumSize: Less than a week (larger bug fix or enhancement)Size: Less than a week (larger bug fix or enhancement)

Status: Open.

#5595 In unicode-org/icu4x;

· peng1999 opened on Sep 25, 2024

· 

Priority Backlog ⟨P3⟩

Word segmentation is incorrect

C-segmentationComponent: SegmentationComponent: Segmentation

S-largeSize: A few weeks (larger feature, major refactoring)Size: A few weeks (larger feature, major refactoring)

U-ecma402User: ECMA-402 compatibilityUser: ECMA-402 compatibility

Status: Open.

#5015 In unicode-org/icu4x;

· robertbastian opened on Jun 6, 2024

· 

2.x Priority ⟨P2⟩

Add an segmenter option whether we use dictionary (support u-dx)

C-segmentationComponent: SegmentationComponent: Segmentation

Status: Open.

#4808 In unicode-org/icu4x;

· makotokato opened on Apr 15, 2024

· 

Priority Backlog ⟨P3⟩

Add support for sentence break suppression (<code>-u-ss</code>)

C-segmentationComponent: SegmentationComponent: Segmentation

S-smallSize: One afternoon (small bug fix or enhancement)Size: One afternoon (small bug fix or enhancement)

U-ecma402User: ECMA-402 compatibilityUser: ECMA-402 compatibility

Status: Open.

#3927 In unicode-org/icu4x;

· sffc opened on Aug 23, 2023

· 

2.x Priority ⟨P2⟩

Support -u-dx flag

C-segmentationComponent: SegmentationComponent: Segmentation

good first issueGood for newcomersGood for newcomers

S-smallSize: One afternoon (small bug fix or enhancement)Size: One afternoon (small bug fix or enhancement)

T-enhancementType: Nice-to-have but not requiredType: Nice-to-have but not required

Status: Open.

#3668 In unicode-org/icu4x;

· sffc opened on Jul 12, 2023

· 

Priority Backlog ⟨P3⟩

Add a segmenter constructor for pure rule-based line and word segmentation

C-segmentationComponent: SegmentationComponent: Segmentation

good first issueGood for newcomersGood for newcomers

S-smallSize: One afternoon (small bug fix or enhancement)Size: One afternoon (small bug fix or enhancement)

Status: Open.

#3612 In unicode-org/icu4x;

· Manishearth opened on Jul 3, 2023

· 

Backlog ⟨P4⟩

Unify rule-based segmentation rules with ICU, CLDR, Unicode spec

blockedA dependency must be resolved before this is actionableA dependency must be resolved before this is actionable

C-segmentationComponent: SegmentationComponent: Segmentation

S-epicSize: Major project (create smaller child issues)Size: Major project (create smaller child issues)

T-coreType: Required functionalityType: Required functionality

trackingThis issue tracks a ticket in another projectThis issue tracks a ticket in another project

Status: Open.

#3457 In unicode-org/icu4x;

· sffc opened on May 25, 2023

· 

2.x Priority ⟨P2⟩

Support DDLs in complex script segmentation models

C-segmentationComponent: SegmentationComponent: Segmentation

S-epicSize: Major project (create smaller child issues)Size: Major project (create smaller child issues)

T-bugType: Bad behavior, security, privacyType: Bad behavior, security, privacy

Status: Open.

#3411 In unicode-org/icu4x;

· sffc opened on May 4, 2023

· 

2.x Priority ⟨P2⟩

Continue investigating LSTM speedups

C-segmentationComponent: SegmentationComponent: Segmentation

S-mediumSize: Less than a week (larger bug fix or enhancement)Size: Less than a week (larger bug fix or enhancement)

T-enhancementType: Nice-to-have but not requiredType: Nice-to-have but not required

Status: Open.

#3305 In unicode-org/icu4x;

· sffc opened on Apr 13, 2023

· 

2.x Priority ⟨P2⟩

Support adjusting break iterator position by an offset

C-segmentationComponent: SegmentationComponent: Segmentation

help wantedIssue needs an assigneeIssue needs an assignee

S-mediumSize: Less than a week (larger bug fix or enhancement)Size: Less than a week (larger bug fix or enhancement)

T-coreType: Required functionalityType: Required functionality

U-ecma402User: ECMA-402 compatibilityUser: ECMA-402 compatibility

Status: Open.

#3247 In unicode-org/icu4x;

· aethanyc opened on Apr 4, 2023

· 

2.x Priority ⟨P2⟩

LSTM forward pass using matrix muls

C-segmentationComponent: SegmentationComponent: Segmentation

Status: Draft (not ready).

unicode-org/icu4xnumber 3219

#3219 In unicode-org/icu4x;

· pdogr opened on Mar 24, 2023