Generate CSV via Apache CSV in UTF-8

Question

how to write CSV File in UTF-8 via Apache CSV?

I am trying generate csv by following code where Files.newBufferedWriter() encode text into UTF-8 by default, but when I open generated text in excel there are senseless characters.

I create CSVPrinter like this:

CSVPrinter csvPrinter = new CSVPrinter(Files.newBufferedWriter(Paths.get(filePath)), CSVFormat.EXCEL);

next I set headers

csvPrinter.printRecord(headers);

and next in loop I print values into writer like this

csvPrinter.printRecord("value1", "valu2", ...);

I also tried upload file into online CSV lint validator and it tells that I am using ASCII-8BIT instead of UTF-8. What I did wrong?

ASCII characters are encoded the same way in UTF8 as they are encoded in ASCII. Your code only uses ASCII characters, so there's no way to distinguish between ASCII and UTF8 when looking at the file. — JB Nizet
– JB Nizet, Commented Jul 19, 2019 at 12:27
something like this CSVPrinter printer = new CSVPrinter(new PrintWriter("nlp.csv", "UTF-8"), CSVFormat.EXCEL.withDelimiter("|".charAt(0))); @DenisStephanov — Ryuzaki L
– Ryuzaki L, Commented Jul 19, 2019 at 12:33

VGR · Accepted Answer · 2019-07-19 14:50:38Z

20

Microsoft software tends to assume windows-12* or UTF-16LE charsets, unless the content starts with a byte order mark which the software will use to identify the charset. Try adding a byte order mark at the start of your file:

try (BufferedWriter writer = Files.newBufferedWriter(Paths.get(filePath))) {

    writer.write('\ufeff');

    CSVPrinter csvPrinter = new CSVPrinter(writer);

    //...
}

answered Jul 19, 2019 at 14:50

VGR

44.9k4 gold badges52 silver badges71 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Kenston Choi Over a year ago

This may also be done as a header CSVFormat.EXCEL.withHeader('\ufeff' + "Name", "Age") so we can have CSVPrinter as part of the try.

Rezgui Baha Eddinne Over a year ago

Is this solution still works in ubuntu with the byte order mark, any idea ?

VGR Over a year ago

@RezguiBahaEddinne This will work on any system. UTF-8 is universal. However, reading the file in Ubuntu will depend on the tools you use. In my experience, many editors are smart enough to recognize a BOM, but text processing tools often are not.

Collectives™ on Stack Overflow

Generate CSV via Apache CSV in UTF-8

1 Answer 1

3 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Linked

Related