t;>>>> I had a talk about internals of Spark integration in Ignite.
> >>>>>>>>> It answers on question why we should use Spark internals.
> >>>>>>>>>
> >>>>>>>>> You can take a look at my meetup talk(in
>>>>> You can take a look at my meetup talk(in Russian) [1] or read
>>> an
>>>>>>> article if you prefer text [2].
>>>>>>>>>
>>>>>>>>> [1] https://www.youtube.com/watch?v=CzbAweNKEVY
>>>>>&g
as I understand it uses Spark internals from the first
> > > > commit)))
> > > > > > > > > The reason - we take Spark SQL query execution plan and try
> > to
> > > > > > execute it
> > > > > > > > > on
plan and try
> to
> > > > > execute it
> > > > > > > > on Ignite cluster
> > > > > > > > Also we inherit a lot of Developer API related classes that
> > > could be
> > > > > > > > unstable. Spark has no
son
> > > > why we
> > > > > > > should go deeper
> > > > > > >
> > > > > > > пн, 30 сент. 2019 г. в 20:17, Ivan Pavlukhin <
> > vololo...@gmail.com>:
> > > > > > >
> > > > &g
and this is a
> reason
> > > why we
> > > > > > should go deeper
> > > > > >
> > > > > > пн, 30 сент. 2019 г. в 20:17, Ivan Pavlukhin <
> vololo...@gmail.com>:
> > > > > >
> > >
ент. 2019 г. в 20:17, Ivan Pavlukhin :
> > > > >
> > > > > > Hi Alexey,
> > > > > >
> > > > > > As an external watcher very far from Ignite Spark integration I
> > would
> > > > > > like to ask
ент. 2019 г. в 20:17, Ivan Pavlukhin :
> > > >
> > > > > Hi Alexey,
> > > > >
> > > > > As an external watcher very far from Ignite Spark integration I
> would
> > > > > like to ask a humble question for my underst
a humble question for my understanding. Why this
> > > > integration uses Spark internals? Is it a common approach for
> > > > integrating with Spark?
> > > >
> > > > пн, 30 сент. 2019 г. в 16:17, Alexey Zinoviev :
> > > > >
ration I would
> > > like to ask a humble question for my understanding. Why this
> > > integration uses Spark internals? Is it a common approach for
> > > integrating with Spark?
> > >
> > > пн, 30 сент. 2019 г. в 16:17, Alexey Zinoviev >:
> > &g
ite Spark integration I would
> > like to ask a humble question for my understanding. Why this
> > integration uses Spark internals? Is it a common approach for
> > integrating with Spark?
> >
> > пн, 30 сент. 2019 г. в 16:17, Alexey Zinoviev :
> > >
> > &
common approach for
> integrating with Spark?
>
> пн, 30 сент. 2019 г. в 16:17, Alexey Zinoviev :
> >
> > Hi, Igniters
> > I've started the work on the Spark 2.4 support
> >
> > We started the discussion here, in
> > https://issues.apache.org/jira/browse/IGNITE-12054
>
niters
> I've started the work on the Spark 2.4 support
>
> We started the discussion here, in
> https://issues.apache.org/jira/browse/IGNITE-12054
>
> The Spark internals were totally refactored between 2.3 and 2.4 versions,
> main changes touches
>
>- External
13 matches
Mail list logo
