tree 65c6705d16c6e8b81955241249a2924dbc0870bd
parent 6a78fac56a3459d11902d844e326adae31c0e666
author Rui Guo <ruig2@uci.edu> 1595363549 -0700
committer Dmitry Lychagin <dmitry.lychagin@couchbase.com> 1595376294 +0000

[ASTERIXDB-2762] Use code point as the unit in substr()

This commit aims to use code point as the unit in substr().

Currently, Java char (2 bytes) is used as the unit in substr(),
however, for non-English characters such as Emoji and Korean,
one character may have multiple bytes and thus can be splitted into a
few illegal parts if we use Java char as the unit.
Instead, code point is a more natural unit to split characters.

Change-Id: I5c38cfd7abcf6f1c1f23a9f74dfd3181531d8c0f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/7263
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>