Charset Trouble

Post

Posted 18th February 2018, 5:17 am

Rating:

#3990 (In Topic #792)

ironfeather

Standard member

ironfeather is in the usergroup ‘Well-settled’

Japanese suddenly wrong charset

hello,

I just updated to newest version of Composr and now my site that features a mix of English & Japanese is having trouble.

The English is all fine but the Japanese text in articles and wiki has all been converted / displaying not in utf-8?

Its weird as the Japanese in the RSS feeds and coded into panels etc is all OK. Only the wiki & news articles is changed.

I am hoping it is an easy fix and my original articles are all ok, my guess is they are fine.

Thanks for any help

Stevyn

example;

News archive - Nandalow

japanese text in RSS feed blocks on side panel are fine but article text is not

Last edit: 18th February 2018, 5:22 am by ironfeather

———–
Publisher of IronFeather Journal since 1987. Host of KGNU Colorado Radio for 20 years.
Currently in Japan & decided to focus on Composr as my number one CMS.
Composr site for community of Hokkaido: Nandalow.com
Composr site for my freelance work: Futurecode.jp
My Compsr edits : http://ironfeather.com/bbs/viewtopic.php?f=12&t=2862
Twitter: https://twitter.com/futurecodejp

Post

Posted 18th February 2018, 5:59 am

Rating:

#3994

ironfeather

Standard member

a test to see if Japanese text is OK here

ウェブサイトリンク、イベント、ニュース、ブログまた、アナウンスは、北海道の人達が、こちらに送って下さるのはとても、光栄です、もちろん無料です。ネットワークで、お互い助け合いましょう

OK update the above Japanese text is fine... and whats weird is that I posted a test article on my site the Japanese text is fine but all of old posts and wiki are all scrambled

Post

Posted 18th February 2018, 2:27 pm

Rating:

#4005

Chris Graham

Site director

Chris Graham is in the usergroup ‘Administrators’

It is possible your database was not saving data in Unicode, but some other default MySQL character set.

We did a fix to a problem setting the MySQL character set in the last release, but it could have this effect unfortunately (the fix is correct, but it reveals a hidden problem).

As a workaround you can try putting this in _config.php:

Code

$SITE_INFO['database_charset'] = '(whatever the character set is)';

https://dev.mysql.com/doc/refman/5.7/en/faqs-cjk.html

I am happy to help you resolve this, send me an email if you're still struggling.

Sorry we didn't include this in the release announcement, I didn't imagine anyone would have a MySQL default character set other than Unicode or Western European.

Become a fan of Composr on Facebook or add me as a friend. Add me on on Mastodon. Follow me on Minds (where I am most active). Support me on Patreon

Was I helpful?

If not, please let us know how we can do better (please try and propose any bigger ideas in such a way that they are fundable and scalable).
If so, please let others know about Composr whenever you see the opportunity or support me on Patreon.
If my reply is too Vulcan or expressed too much in business-strategy terms, and not particularly personal, I apologise. As a company & project maintainer, time is very limited to me, so usually when I write a reply I try and make it generic advice to all readers. I'm also naturally a joined-up thinker, so I always express my thoughts in combined business and technical terms. I recognise not everyone likes that, don't let my Vulcan-thinking stop you enjoying Composr on fun personal projects.
If my response can inspire a community tutorial, that's a great way of giving back to the project as a user.

Post

Posted 18th February 2018, 2:54 pm

Rating:

#4008

ironfeather

Standard member

howdy

the database should be utf-8 i think. the site is mostly english and maybe at times we post a bit of Japanese. Will try now and report back.

Post

Posted 18th February 2018, 3:10 pm

Rating:

#4009

ironfeather

Standard member

Hello,

Ok i set

$SITE_INFO['database_charset'] = 'utf-8';

in the _config.php

and good news mostly….. this fixes the news articles and wiki but now the other japanese in the templates recently saved show as just ?????????????? symbols

exploring it more now… mainly to have all the articles and wiki back is priority so that rocks

will report back

1 guest and 0 members have just viewed this.

Statistics

Forum statistics:	2,052 topics, 7,195 posts, 10,830 members Our newest member is Customcollective