Re: Modifying encoding to UTF8 no BOM

[David Viard]

Hello Patrick,
Thanks for your answer.

I'll try to be more precise.
It seems the tendency is to use UTF8 no BOM (default) and UTF-16 with BOM. 
But *MICROSOFT* *Excel* (on My *Mac*, Saves as UTF8+BOM(default) with 
Windows CRLF (!) 😖.
Context : I have a Shell Script that :

   1. reads a CSV file with Paths to files (in a folder hierarchy of 
   various folders/subfolders), 
   2. Applies optional extension filters,
   3. downloads files to a folder as a flat structure (all on one level),
   4. The Script has also process & error logging,… 
   5. Moves the processed CSV Files with the logs (With client 
   Name/timestamp…)

I did not use AppleScript.
So either my Shell Script misses something or I need to launch BBEDIT just 
for this conversion, prior to the Script execution. 

Do BBEDIT cmd line Tools handle this? I am not sure from my quick read of 
the manual.

Would I need some AppleScript to trigger BBEdit & handle the save Dialog 
options?

Note, on my last test & log, I get a "xargs: unterminated quote" error, and 
no Files processed.

I can share the Script if that helps
Thanks a lot
Le mardi 25 juin 2024 à 17:52:40 UTC+2, Patrick Woolsey a écrit :

> This sounds to me like a job for a *text factory* with the _Change Text 
> Encoding_ action. :-)
>
> For details, please see the section titled "Text Factories" starting on 
> page 155 of the PDF manual (Help -> User Manual) and I reckon that should 
> suffice to get you started.
>
>
> Regards,
>
> Patrick Woolsey
> ==
> Bare Bones Software, Inc. 
>
>
>
>
> > On Jun 25, 2024, at 11:25, David Viard  wrote:
> > 
> > Hello BBEdit 
> > 
> > I have an issue with an export from Excel as TXT or CSV.
> > Excel adds a BOM to TXT / CSV files on export which kills my Shell 
> Script.
> > I have to :
> > • 
> > open the file in BBEdit change encoding and CTL to UNIX and Save (with 
> the right encoding) or in OpenOffice and save again…
> > • Rename the File from .csv to .txt 
> > • It's tedious
> > • I have multiple files to do this way
> > • Coworkers might forget this part of the process and generate an error 
> (File not Found)
> > So, I am inquiring of a scripting solution to handle poInts 1 & 2
> > Was thinking of a Shell Script and a BBEdit but not sure how to do it 
> and include this in my Script
> > 
> > Thanks for any input 
> > 
>
>

-- 
This is the BBEdit Talk public discussion group. If you have a feature request 
or believe that the application isn't working correctly, please email 
"supp...@barebones.com" rather than posting here. Follow @bbedit on Mastodon: 

--- 
You received this message because you are subscribed to the Google Groups 
"BBEdit Talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bbedit+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/bbedit/7a88-556a-4dbd-919a-9422a21326d2n%40googlegroups.com.

Re: Modifying encoding to UTF8 no BOM

[Patrick Woolsey]

This sounds to me like a job for a *text factory* with the _Change Text 
Encoding_ action. :-)

For details, please see the section titled "Text Factories" starting on page 
155 of the PDF manual (Help -> User Manual) and I reckon that should suffice to 
get you started.


Regards,

 Patrick Woolsey
==
Bare Bones Software, Inc. 




> On Jun 25, 2024, at 11:25, David Viard  wrote:
> 
> Hello BBEdit 
> 
> I have an issue with an export from Excel as TXT or CSV.
> Excel adds a BOM to TXT / CSV files on export which kills my Shell Script.
> I have to :
> • 
> open the file in BBEdit change encoding and CTL to UNIX and Save (with the 
> right encoding) or in OpenOffice and save again…
> • Rename the File from .csv to .txt 
> • It's tedious
> • I have multiple files to do this way
> • Coworkers might forget this part of the process and generate an error 
> (File not Found)
> So, I am inquiring of a scripting solution to handle poInts 1 & 2
> Was thinking of a Shell Script and a BBEdit but not sure how to do it and 
> include this in my Script
> 
> Thanks for any input 
> 

-- 
This is the BBEdit Talk public discussion group. If you have a feature request 
or believe that the application isn't working correctly, please email 
"supp...@barebones.com" rather than posting here. Follow @bbedit on Mastodon: 

--- 
You received this message because you are subscribed to the Google Groups 
"BBEdit Talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bbedit+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/bbedit/020F25AF-10A4-40AD-BD2D-A54F31F013F4%40barebones.com.

Modifying encoding to UTF8 no BOM

[David Viard]

Hello BBEdit 

I have an issue with an export from Excel as TXT or CSV.
Excel adds a BOM to TXT / CSV files on export which kills my Shell Script.
I have to :

   1. open the file in BBEdit change encoding and CTL to UNIX and Save 
   (with the right encoding) or in OpenOffice and save again…
   2. Rename the File from .csv to .txt 
   

   - It's tedious
   - I have multiple files to do this way
   - Coworkers might forget this part of the process and generate an error 
   (File not Found)
   
So, I am inquiring of a scripting solution to handle poInts 1 & 2
Was thinking of a Shell Script and a BBEdit but not sure how to do it and 
include this in my Script

Thanks for any input 

-- 
This is the BBEdit Talk public discussion group. If you have a feature request 
or believe that the application isn't working correctly, please email 
"supp...@barebones.com" rather than posting here. Follow @bbedit on Mastodon: 

--- 
You received this message because you are subscribed to the Google Groups 
"BBEdit Talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bbedit+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/bbedit/e8779206-dc2d-47fb-92b1-a41f25995806n%40googlegroups.com.