Filtering by job group in the Spark UI / API

2022-08-18 Thread Yeachan Park
Hi All, Is there a way that we can filter in all the jobs from the history server UI / in Spark's API based on the Job Group to which the job belongs to? Ideally we would like to supply a particular job group, and only see the jobs associated with that job group in the UI. Thanks, Yeachan

Re: Spark streaming

2022-08-18 Thread ミユナ (alice)
> Dear sir, > > >I want to check the logs of MySQL database using spark streaming, can > someone help me with those listening queries. > > > Thanks and regards > Akash P > you can ingest logs by fluent-bit to kafka then setup spark to read records from kafka by streaming.

Re: Data ingestion

2022-08-18 Thread Pasha Finkelshtein
But not in streaming, right? It will be a usual batch approach, but initial question was about streaming. [image: facebook] [image: twitter] [image: linkedin] [image: instagram]