Hi Evan,
Just to have full knowledge:
- "provided" should be used when You expect the target cluster on
environment to have the package of interest installed so you do not have
to include it in the pipeline jar (this is to have it more lightweight
and easier to maintain coherent target jre env across organization).
- it seems that You should either install the library on You target env
or include it in your build jar. Up to Your specific use case. Typically
corporation envs provide commonly used libs in their envs like spark,
and IO libs - and this might be the reason that maven suggest this.
Best
Wiśniowski Piotr
On 21.04.2023 08:30, Moritz Mack wrote:
Hi Evan,
Not sure why maven suggests using “compileOnly”.
That’s certainly wrong, make sure to use “implementation” in your case.
Cheers, Moritz
On 21.04.23, 01:52, "Evan Galpin" <egal...@apache.org> wrote:
Hi all, I'm trying to make use of ParquetIO. Based on what's
documented in maven central, I'm including the artifact in
"compileOnly" mode (or in maven parlance, 'provided' scope). I can
successfully compile
Hi all,
I'm trying to make use of ParquetIO. Based on what's documented in
maven central, I'm including the artifact in "compileOnly" mode (or in
maven parlance, 'provided' scope). I can successfully compile my
pipeline, but when I run it I (intuitively?) am met with a
ClassNotFound exception for ParquetIO.
Is 'compileOnly' still the desired way to include ParquetIO as a
pipeline dependency?
Thanks,
Evan
*As a recipient of an email from the Talend Group, your personal
data will be processed by our systems. Please see our Privacy Notice
<https://www.talend.com/privacy-policy/>*for more information about
our collection and use of your personal information, our security
practices, and your data protection rights, including any rights you
may have to object to automated-decision making or profiling we use
to analyze support or marketing related communications. To manage or
discontinue promotional communications, use the communication
preferences portal
<https://info.talend.com/emailpreferencesen.html>. To exercise your
data protection rights, use the privacy request form
<https://talend.my.onetrust.com/webform/ef906c5a-de41-4ea0-ba73-96c079cdd15a/b191c71d-f3cb-4a42-9815-0c3ca021704cl>.
Contact us here <https://www.talend.com/contact/>or by mail to
either of our co-headquarters: Talend, Inc.: 400 South El Camino
Real, Ste 1400, San Mateo, CA 94402; Talend SAS: 5/7 rue Salomon De
Rothschild, 92150 Suresnes, France
