Hi David Thanks for the info you provided. The original purpose I asked the question is that I did need that jar file for Mysql connector for Spark. As you see the operations below:
$ pyspark --jars mysql-connector-java-8.0.27.jar Python 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] on linux Type "help", "copyright", "credits" or "license" for more information. ... Spark context available as 'sc' (master = local[*], app id = local-1638960026416). SparkSession available as 'spark'. >>> In the command line I specify the jar name which must be put in Spark's library dir. So I was looking where the file is located in the system. best regards, Piper On Wed, Dec 8, 2021 at 6:27 PM David <bouncingc...@gmail.com> wrote: > On Wed, 8 Dec 2021 at 19:21, Piper H <pott...@gmail.com> wrote: > >> Hello again, >> >> Sorry for this silly question. >> I downloaded the JDBC drive from mysql website: >> https://dev.mysql.com/downloads/connector/j/ >> > > Hi. > > Just for your information, because you might not realise: > > Debian is a huge project that attempts to ensure the > compatibility of every piece of software on your machine. > > If you download software from other sources, like you > did from mysql.com above, then you will break Debian's > methods for managing software compatibility on your > machine. > > If you get a .deb package from somewhere that is not > Debian, then that package is NOT part of Debian. > It uses Debian packaging methods to create the .deb > file, but it has NOT been integrated by Debian for compatibility > with a Debian release. > > This incompatibility can cause your installation to become > unusable, immediately, or later. > > Plus, folks from Debian won't be interested in helping you > to fix those issues. Because from their perspective, they > will see that you broke your Debian system by installing a > foreign package. > > So for a problem-free experience with Debian, the > ideal approach is to only install packages provided > by Debian through one of its official repositories. > > More information on this topic is provided here: > https://wiki.debian.org/DontBreakDebian > > Please do read that. Ask here if you have any questions. > > It is important to understand that Debian is intended to > be used by people for whom this restriction is not a problem. > Not only that, but it is the philosophy of the Debian project > and the reason why Debian is what it is. There are dozens > of different Linux distributions, several different package > management systems, and each comes with a different > approach to solving the software compatibility problem. > > I hope this information helps you. > >
