What if MySQL fails to store emoticons

Catalog

Preface

Abnormal information ：

The main reason is

  terms of settlement

---

Preface

Abnormal information ：

### The error occurred while setting parameters ### SQL: INSERT INTO news_info ( id,  title, content, author, summary, sensitives, scraping_time, level, news_type, content_text, original_columns, content_words ) VALUES ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )

### Cause: java.sql.SQLException: Incorrect string value: '\xF0\x9F\x91\x89' for column 'author' at row 1 ;

uncategorized SQLException; SQL state [HY000];

error code [1366];

Incorrect string value: '\xF0\x9F\x91\x89' for column 'author' at row 1;

nested exception is java.sql.SQLException: Incorrect string value: '\xF0\x9F\x91\x89' for column 'author' at row 1 at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:89)

The main reason is

author  Contains emoticons , The expression is 4 character , If Mysql When creating the database and tables, there is no statement that 4 byte , So it's in insert I'll make a mistake !

  terms of settlement

It needs to be done during consumption warehousing author Convert to normal binary , Two character Chinese characters , That is to eliminate the four byte expression ;

String author= ContentUtils.filterOffUtf8Mb(newsInfo.getAuthor()); newsInfo.setAuthor(author);

The main tool code

 /**
     *  The main function is to do facial expression package elimination tools 
     * @param text
     * @return
     */
    public static String filterOffUtf8Mb(String text) {
        if (StringUtils.isBlank(text)) {
            return text;
        }
        String result = text;
        try {
            byte[] bytes = text.getBytes(UTF_CHARACTOR);
            ByteBuffer buffer = ByteBuffer.allocate(bytes.length);
            int i = 0;
            while (i < bytes.length) {
                short b = bytes[i];
                if (b > 0) {
                    buffer.put(bytes[i++]);
                    continue;
                }
                //  Remove sign bit 
                b += 256;
                if (((b >> 5) ^ 0x06) == 0) {
                    buffer.put(bytes, i, 2);
                    i += 2;
                } else if (((b >> 4) ^ 0x0E) == 0) {
                    buffer.put(bytes, i, 3);
                    i += 3;
                } else if (((b >> 3) ^ 0x1E) == 0) {
                    i += 4;
                } else if (((b >> 2) ^ 0xBE) == 0) {
                    i += 5;
                } else {
                    i += 6;
                }
            }
            buffer.flip();
            result = new String(buffer.array(), UTF_CHARACTOR);
        } catch (Exception ex) {
            log.error(" Content filtering 4 Error in byte character " + ex.getMessage());
        }
        return result;
    }