Re: [hpx-users] GSoC 20 proposal

[Hartmut Kaiser]

Afrin,

 

We’re certainly open for proposals that focus on tasks that are not listed on 
our ideas page. Those are possible ideas after all. 

 

I personally don’t know anything about PMDK. What would you suggest as a 
possible result of integrating it with HPX? What benefits would that give?

 

Thanks!

Regards Hartmut

---

  http://stellar.cct.lsu.edu

  https://github.com/STEllAR-GROUP/hpx

 

From: Afrin Jaman  
Sent: Friday, February 28, 2020 7:35 PM
To: hartmut.kai...@gmail.com
Subject: Re: GSoC 20 proposal

 

Thanks a lot. 

 

On Sat, 29 Feb 2020, 12:07 am Hartmut Kaiser, mailto:hartmut.kai...@gmail.com> > wrote:

I’m forwarding this to hpx-us...@stellar-group.org 
  for others to be able to chime in.

 

Regards Hartmut

---

  http://stellar.cct.lsu.edu

  https://github.com/STEllAR-GROUP/hpx

 

From: Afrin Jaman mailto:mailafrinja...@gmail.com> > 
Sent: Wednesday, February 26, 2020 10:18 AM
To: hartmut.kai...@gmail.com  
Cc: thom.hel...@gmail.com  
Subject: GSoC 20 proposal

 

Hello respective mentors,


I am Afrin Jaman and I am highly interested to work for HPX. I am a GSoC winner 
2019 and my previous project was on Persistent memory development kit. I am 
willing to propose my idea to HPX. I want to integrate non-volatile programming 
into HPX. PMDK also comes in C++ library, so I guess we can look forward to 
this idea.
As we know HPX is for parallel programming, if we can add non-volatile 
programming support into it then it will be more efficient. Please feel free to 
share your thoughts on this proposal (I really need your opinion).

I don't know where I can find a mentor or support to propose own idea. Will you 
please help me out with this?

Thank you in advance.

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu, stellar-group.org
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 19] Providing a pip package for Phylanx

[Patrick Diehl]

Hi,

I do not think that you will need much knowledge of C++ and CMake. I
think you will need some knowledge how the pip packages work and good
knowledge about compilation of hpx and phylanx.

I would recommend to start to read the pic docs and generate a package
for some hello world example.

Best,

Patrick

On 2/17/19 5:58 AM, Karthik Kothuri wrote:
> Hello,
> I am interested in working on the project "Providing a pip package for
> Phylanx" for GSoC 2019. I have used CMake to a limited extent to compile
> CPP header files. What level of knowledge with CMake and C++ is required
> for this project?
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 

-- 
Patrick Diehl
www.diehlpk.de



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 19] Providing a pip package for Phylanx

[Karthik Kothuri]

Hello,
I am interested in working on the project "Providing a pip package for
Phylanx" for GSoC 2019. I have used CMake to a limited extent to compile
CPP header files. What level of knowledge with CMake and C++ is required
for this project?
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC-19

[Abhishek Kashyap]

Yes, you are absolutely right.

On Wed, 13 Feb 2019 at 01:54, Adrian Serio  wrote:

> Abhishek,
>
> I am not following your question. Is this in relation to the GSoC Project:
> "Providing a pip package for Phylanx"?
>
> Adrian
> On 2/12/2019 2:12 PM, Abhishek Kashyap wrote:
>
> I know that, i want to ask how to build package distribution of phylanx
> without knowing its implementations. So, please help me in getting
> understand the implementation.
>
> On Wed, 13 Feb 2019 at 01:28, Adrian Serio  wrote:
>
>> Oops here is the link:
>> https://github.com/STEllAR-GROUP/phylanx/wiki/Build-Instructions
>>
>> Adrian
>> On 2/12/2019 1:58 PM, Adrian Serio wrote:
>>
>> Abhishek,
>>
>> This might be a good place for you to start.
>>
>> Adrian
>> On 2/12/2019 1:24 PM, Abhishek Kashyap wrote:
>>
>> Where is stuff related to Phylanx to build distribution package system?
>> How to build any idea.
>>
>> ___
>> hpx-users mailing 
>> listhpx-us...@stellar.cct.lsu.eduhttps://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>>
>> --
>> Adrian Serio
>> Scientific Program Coordinator
>> 2118 Digital Media Center
>> 225.578.8506
>>
>>
>> ___
>> hpx-users mailing 
>> listhpx-us...@stellar.cct.lsu.eduhttps://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>>
>> --
>> Adrian Serio
>> Scientific Program Coordinator
>> 2118 Digital Media Center
>> 225.578.8506
>>
>> --
> Adrian Serio
> Scientific Program Coordinator
> 2118 Digital Media Center
> 225.578.8506
>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC-19

[Adrian Serio]

Abhishek,

I am not following your question. Is this in relation to the GSoC
Project: "Providing a pip package for Phylanx"?

Adrian

On 2/12/2019 2:12 PM, Abhishek Kashyap wrote:
> I know that, i want to ask how to build package distribution of
> phylanx without knowing its implementations. So, please help me in
> getting understand the implementation.
>
> On Wed, 13 Feb 2019 at 01:28, Adrian Serio  > wrote:
>
> Oops here is the link:
> https://github.com/STEllAR-GROUP/phylanx/wiki/Build-Instructions
>
> Adrian
>
> On 2/12/2019 1:58 PM, Adrian Serio wrote:
>>
>> Abhishek,
>>
>> This might be a good place for you to start.
>>
>> Adrian
>>
>> On 2/12/2019 1:24 PM, Abhishek Kashyap wrote:
>>> Where is stuff related to Phylanx to build distribution package
>>> system?
>>> How to build any idea.
>>>
>>> ___
>>> hpx-users mailing list
>>> hpx-users@stellar.cct.lsu.edu 
>>> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>> -- 
>> Adrian Serio
>> Scientific Program Coordinator
>> 2118 Digital Media Center
>> 225.578.8506
>>
>> ___
>> hpx-users mailing list
>> hpx-users@stellar.cct.lsu.edu 
>> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
> -- 
> Adrian Serio
> Scientific Program Coordinator
> 2118 Digital Media Center
> 225.578.8506
>
-- 
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC-19

[Adrian Serio]

Oops here is the link:
https://github.com/STEllAR-GROUP/phylanx/wiki/Build-Instructions

Adrian

On 2/12/2019 1:58 PM, Adrian Serio wrote:
>
> Abhishek,
>
> This might be a good place for you to start.
>
> Adrian
>
> On 2/12/2019 1:24 PM, Abhishek Kashyap wrote:
>> Where is stuff related to Phylanx to build distribution package system?
>> How to build any idea.
>>
>> ___
>> hpx-users mailing list
>> hpx-users@stellar.cct.lsu.edu
>> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> -- 
> Adrian Serio
> Scientific Program Coordinator
> 2118 Digital Media Center
> 225.578.8506
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

-- 
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC-19

[Adrian Serio]

Abhishek,

This might be a good place for you to start.

Adrian

On 2/12/2019 1:24 PM, Abhishek Kashyap wrote:
> Where is stuff related to Phylanx to build distribution package system?
> How to build any idea.
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

-- 
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2019

[Adrian Serio]

Hi Aditya,

 

The first step to contributing to HPX is to clone the repo and try
compiling the library and running the examples on your own machine.
Afterward, you can browse some entry level projects here:
https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-2019-Project-Ideas.

 

I would also suggest that you join the IRC channel (#ste||ar on
freenode) as many of us are available to answer questions there.

 

Please remember that GSoC is a self directed experience. Don't wait for
someone to give you a list of tasks, rather find a project which
interests you and start implementing a solution!

 

Adrian


On 2/12/2019 12:50 PM, Aditya Chondke wrote:
>
> Dear sir,
>
> I am Aditya Chondke from India. Currently, I am pursuing Masters in
> Geoinformatics from CSRE, Indian Institute of Technology Bombay
> (IITB). I have my bachelors in Computer Science. I have extensive
> knowledge in C++ and Python and is very passionate about parallel
> computing. Presently we are developing an application using C++ for
> applying various filters, enhancements and Fast Fourier transform on
> images using parallel computing. I would love to contribute to STE||AR
> Group in the upcoming Google Summer of Code 2019. I would be very
> grateful to get any directions to start with so that I can pursue and
> participate in the Google Summer of Code 2019 with your organization.
>
>
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

-- 
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC-19

[Abhishek Kashyap]

Where is stuff related to Phylanx to build distribution package system?
How to build any idea.
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2019

[Aditya Chondke]

Dear sir,

I am Aditya Chondke from India. Currently, I am pursuing Masters in
Geoinformatics from CSRE, Indian Institute of Technology Bombay (IITB). I
have my bachelors in Computer Science. I have extensive knowledge in C++
and Python and is very passionate about parallel computing. Presently we
are developing an application using C++ for applying various filters,
enhancements and Fast Fourier transform on images using parallel computing.
I would love to contribute to STE||AR Group in the upcoming Google Summer
of Code 2019. I would be very grateful to get any directions to start with
so that I can pursue and participate in the Google Summer of Code 2019 with
your organization.
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2019

[Adrian Serio]

Hi Parashuram,

The first step to contributing to HPX is to clone the repo and try
compiling the library and running the examples on your own machine.
Afterward, you can browse some entry level projects here:
https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-2019-Project-Ideas.

I would also suggest that you join the IRC channel (#ste||ar on
freenode) as many of us are available to answer questions there.

Please remember that GSoC is a self directed experience. Don't wait for
someone to give you a list of tasks, rather find a project which
interests you and start implementing a solution!

Adrian


On 2/12/2019 8:45 AM, Shourya IIT B wrote:
>
> Respected Sir,
>
>
>    I am Parashuram Shourya from India. Currently, I am doing my
> Master’s in Geoinformatics from Centre of Studies in Resources
> Engineering(CSRE), Indian Institute of Technology Bombay(IITB). I have
> a Bachelor's degree in Computer Science and Engineering.
>
> Currently, I am learning Machine Learning and High-Performance
> Computing. I have vast programming experience in C, C++, Python
>
>
>   I would love to contribute to The Stellar Group in the upcoming
> Google Summer of Code 2019. I would be very grateful to get any
> directions to start with so that I can pursue and participate in GSoC
> 2019 with your organization.
>
>
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

-- 
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2019

[Simberg Mikael]

Hi,

I'm forwarding this to the hpx-users mailing list to keep the discussion public 
and to let others chime in as well.

I'd suggest you start getting familiar with HPX itself by building it, running 
examples, trying to write some small programs of your own. Once you've done 
that you can start looking at the current functionality we have for writing csv 
files, both interface and implementation. Since this is most likely quite an 
easy project technically, there will be more freedom for you to choose 
something interesting to do with the output. The project description already 
has some ideas, but you're free to come up with your own ideas there.

Lastly, I suggest you join us on IRC (#ste||ar on freenode) or Slack (#hpx 
channel on the cpplang Slack) since it can be easier to discuss details there. 
The mailing list is also good. The important thing is we keep these discussions 
open so that they can benefit others interested in the same projects.

Kind regards,
Mikael


From: Mohita Bipin [mohitabi...@gmail.com]
Sent: Wednesday, December 19, 2018 8:01 AM
To: Simberg Mikael
Subject: GSoC 2019

Sir

I had seen a project proposal to augment CSV files under GSoC 2019 and I was 
hoping to get involved with with particular project

With a reasonable base in c++ and I am familiar with python and the basics of 
pandas I was hoping you could point me in the right direction and give me a 
starting point.

Hope to hear from you soon
Mohita Liza Bipin
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc 2019

[Simberg Mikael]

Hi,

I'm forwarding this to our mailing list so that others in our community can 
respond as well.

A good place to start is to have a look at our git repositories at 
https://github.com/STEllAR-GROUP, clone for example HPX and set up a 
development environment to get familiar with the codebase. We also have a page 
with project ideas for GSoC which you can find here: 
https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-2018-Project-Ideas.

The mailing list archives may also contain some useful information given to and 
from previous GSoC students: http://envelope.cct.lsu.edu/pipermail/hpx-users/. 
You can also join the IRC channel (#ste||ar on freenode) and discuss with us 
over there.

Kind regards,
Mikael


From: Shubham Verma [shubhu...@gmail.com]
Sent: Friday, August 24, 2018 7:29 AM
To: Simberg Mikael
Subject: Gsoc 2019


 Hello sir,
I am a engineering student and I am interested in your organisation for doing 
some good project .so
I wanna take part in gsoc next year. What do you suggest I should do for doing 
better in project.
Thankyou
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc project

[Patrick Diehl]

Hi,

you missed the deadline for this year. You can apply next year. Please
check the Google Summer of Code website for next year's deadline.

Best,

Patrick

On Mon, Jul 23, 2018, 10:09 AM priyam agarwal 
wrote:

> Hi my name is priyam and i am doing my btech from srm university, i am a
> 1st year student , i have  a little bit knowledge about c++ and i really
> wanted to join this project.i want to give my best for  this
> project...pls give me one chance
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] Gsoc project

[priyam agarwal]

Hi my name is priyam and i am doing my btech from srm university, i am a
1st year student , i have  a little bit knowledge about c++ and i really
wanted to join this project.i want to give my best for  this
project...pls give me one chance
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] Gsoc 2019

[Fun Tv]

Hello sir
I am interested in gsoc and I am a 2nd yr engineering student and I want to
join this for 2019 so what I do if I am beginner.
Thankyou
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Are there any Programming Competency Test?

[Recolic Keghart]

Hi,

I'm Bensong Liu, a second year undergraduate student. I'm currently
finishing my proposal to HPX::PythonBindings. But I'm not sure how could
I fill the area "Programming Competency".

I noticed that some organizations/projects provided some application
tasks/programming competency tests, and are there any similar tests for
this project?

Thanks a lot for your help.
Bensong Liu



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC Proposal for Runtime Replacement system

[Nikunj Gupta]

Dear mentors,

This is the pre-final proposal for my GSoC project. Please provide me your
feedback so that I could submit my final proposal to Google.

Here is the link:
https://docs.google.com/document/d/12oOz-y5YSWMzVdTJ2jM-Rt40CMMaOTCFx1BdVbfxkqU/edit?usp=sharing

Regards
Nikunj Gupta
(IRC nickname: Nikunj Gupta)
‌
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hello Patrick Diehl:

Thank you very much for taking time reading my proposal. The opinion you
give is really helpful. I read the irc history and make some change on my
proposal draft. If you have time, can you go over it again and give me more
advises. The shared link is not changed.

Furthermore, when I am writing my proposal today, I come up with a
question: What will happen if a task runs on an hpx thread and it call some
non-hpx thread. Today, I try to write a small program using VideoCapture in
the main hpx thread. I initialize the hpx run time, in the hpx_main
function, I open my webcam and use highgui to display the captured image. I
look at the windows resource manager, the program has 21 threads. It seems
VideoCapture generates so many threads. I believe they can not be
hpx-thread, right? But it seems nothing bad happens, the small example just
works as I think.

Best Regards
Jin Li

2018-03-25 4:07 GMT+08:00 Patrick Diehl <patrickdie...@gmail.com>:

> Hi,
>
> I read your proposal and please look into the archive of the mailing
> list and our irc channel. We discussed several things there and plenty
> of them are missing in your proposal. Please include them and address
> our concerns we had for reading image from webcams and synchronize QT
> threads.
>
> Best,
>
> Patrick
>
> On 03/24/2018 02:29 PM, Lee Jin wrote:
> > Hi,
> >
> >   I have submitted my proposal draft to GSoC and make it shared. I
> > think that you can see it in the system. Please make comments on my
> > proposal. Your suggestions will be very useful for me.
> >
> >   Here is the shared link:
> >
> > https://docs.google.com/document/d/1QNVCvUpe-
> WSdmIMSmYdoEqybEVFknEljqo6bao7uFgA/edit?usp=sharing
> >
> > Best regards
> > Jin Li
> >
> > 2018-03-18 16:38 GMT+08:00 Lee Jin <lijin199...@gmail.com
> > <mailto:lijin199...@gmail.com>>:
> >
> > Hi  Patrick
> >
> >Thank you for reminding. I am aware of the proposal deadline.
> >
> > Best Regards
> > Jin Li
> >
> > 2018-03-17 22:55 GMT+08:00 Patrick Diehl <patrickdie...@gmail.com
> > <mailto:patrickdie...@gmail.com>>:
> >
> > Hi Jin Li,
> >
> > so you know that you have to submit a proposal until 27.03.2018?
> >
> > Best,
> >
> > Patrick
> >
> > On 03/17/2018 10:31 AM, Lee Jin wrote:
> > > Hello:
> > >
> > > Thank you very much for your advice. It will be much easier to
> learn
> > > through video tutorials. I will try my best to understand the
> library
> > > before the project starts.
> > >
> > > Best regards
> > > Jin Li
> > >
> > > 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A. <
> biddi...@cscs.ch <mailto:biddi...@cscs.ch>
> > > <mailto:biddi...@cscs.ch <mailto:biddi...@cscs.ch>>>:
> > >
> > > Hi Jin Li
> > >
> > > __ __
> > >
> > > I must apologise for self promotion, but we put some
> tutorial videos
> > > on youtube that might be of use to you
> > >
> > > https://www.youtube.com/results?search_query=CSCS+HPX
> > <https://www.youtube.com/results?search_query=CSCS+HPX>
> > > <https://www.youtube.com/results?search_query=CSCS+HPX
> > <https://www.youtube.com/results?search_query=CSCS+HPX>>
> > >
> > > __ __
> > >
> > > The full set from 2016 tutorial are there, and the first
> couple from
> > > the 2017 tutorial too - the content is the same, but
> perhaps the
> > > 2017 version is slightly more up to date.
> > >
> > > __ __
> > >
> > > For the openCV project it will be important to understand
> thread
> > > pools and how to use the new resource partitioner to allow
> HPX to
> > > work on one set of threads, whilst things like Qt gui
> threads,
> > > webcam capture threads, etc work on non hpx threads.
> > >
> > > __ __
> > >
> > > JB
> > >
> > > __ __
> > >
> > > *From:*hpx-users-boun...@stellar.cct.lsu.edu
> >     <mailto

[hpx-users] GSoC travel absence

[John Biddiscombe]

Could I please ask students who have been in contact with me over the 
last couple of weeks to use the hpx-users mailing list for communication.

 From the end of this week and next week I am away (and most of the week 
after) and it is better to send your questions to the mailing list so 
that someone else can help answer them as I may be slow to respond. With 
the GSoC deadlines approaching, it is not a good idea to rely on my 
answering emails quickly.

JB

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Andreas Schäfer]

Hey Alanas,

thanks for getting in touch.

On 19:45 Fri 16 Mar , Alanas Plascinskas wrote:
> Hey,
> 
> I wanted to ask about the availability of your projects for GSoC 2018.
> 
> I would mainly be interested in these projects: All to All Communications,
> Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
> any suggestions as well.

The Newtonian Physics Sandbox project is available until someone
solves it. :-)

> Have any of these received any serious proposals and if so do you have any
> other projects that would be important for you and are still open?

I haven't seen any proposal this year yet. In my experience they
usually come in hours before the deadline. That said, acceptance is,
as with probably all GSoC projects, conditional to a vote from all
mentors. So having no competition doesn't mean a free ticket. The
proposal still needs to be good. Let me know if I can answer any
questions on it.

Thanks
-Andi


-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though.
All mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC'18 LibGeoDecomp Support

[Andreas Schäfer]

Hey,

On 16:23 Wed 21 Mar , John Biddiscombe wrote:
> I think the libgeocomp project must have been deprecated by now. The 
> chap who was in charge of it has since left the HPX group and is no 
> longer involved.

I didn't work on LibGeoDecomp while I was ramping up at Google. It's
not deprecated though. ATM I'm working on getting it to work with HPX
trunk again.

Cheers
-Andi

ps: John, ping me if you ever pass through Zürich. :-)


-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though.
All mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC'18 LibGeoDecomp Support

[Andreas Schäfer]

Hey Evgeny,

I'm the maintainer of LibGeoDecomp and LibFlatArray.

On 22:17 Wed 21 Mar , Evgeny wrote:
> Hello, who can I ask about some LibGeoDecomp specific questions? I quite
> good understand how things are there, but some times documentation and
> source code do not provide enough information to quickly understand. I
> tried to ask in IRC few times, but seems like there I can get some HPX
> support only, and I can't got answer.

Yeah, I'm rarely on IRC these days, sorry about that. Documentation is
sparse, I believe the best source for that is usually the unit tests.
How can I help you, what do you need to know?

Thanks
-Andi


-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though.
All mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC'18 LibGeoDecomp Support

[John Biddiscombe]

Evgeny


I think the libgeocomp project must have been deprecated by now. The 
chap who was in charge of it has since left the HPX group and is no 
longer involved.


I'm not sure it's a good idea to pursue this one - any other mentors 
disagree?



JB


On 03/21/2018 04:17 PM, Evgeny wrote:
Hello, who can I ask about some LibGeoDecomp specific questions? I 
quite good understand how things are there, but some times 
documentation and source code do not provide enough information to 
quickly understand. I tried to ask in IRC few times, but seems like 
there I can get some HPX support only, and I can't got answer.


Sincerely,
Dedov Evgeny


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC'18 LibGeoDecomp Support

[Evgeny]

Hello, who can I ask about some LibGeoDecomp specific questions? I quite
good understand how things are there, but some times documentation and
source code do not provide enough information to quickly understand. I
tried to ask in IRC few times, but seems like there I can get some HPX
support only, and I can't got answer.

Sincerely,
Dedov Evgeny
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC [All-to-All Communication project]

[Patrick Diehl]

Hi Ahmed,

please find the template for the proposal here [0] and the hint for a
successful proposal here [1]. Have in mind that the deadline for
submitting a proposal is at the 27.03.

Best,

Patrick

[0] https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-Submission-Template
[1] https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals

On 20/03/18 07:44 AM, Ahmed Samir wrote:
> Hi,
> 
> I have had some experience in threading, MPI, sockets programming and
> networks. I have been using C++ for over 3 years. I have followed John
> Biddiscombe and Thomas Heller HPX sessions on youtube and I somehow got
> comfortable with the code. I have done some reading about FFlib library
> paper and the OFIWG libfabric layer. Now I am planning to tackle the
> FFlib library code.
> I am interested in joining the All-to-All communication project. I need
> some pointers on my proposal and if there is a task that I should
> finish, please tell me.
> 
> Thanks in advance
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC'18 : Implement a Faster Associative Container for GIDs

[Anushi Maheshwari]

Hi,

I am sorry you face the trouble. I have added you to the shared person's
list. Please feel free to review the proposal

now.

I remember once mentors said not to make link shareable since other
students might copy some ideas.That is why I haven't done that. You can
still request the permission but if you think I should make it shareable
please ping me back.

*Warm Regards*
*Anushi Maheshwari*
**

 Sent with Mailtrack

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC [All-to-All Communication project]

[Ahmed Samir]

Hi,

I have had some experience in threading, MPI, sockets programming and networks. 
I have been using C++ for over 3 years. I have followed John Biddiscombe and 
Thomas Heller HPX sessions on youtube and I somehow got comfortable with the 
code. I have done some reading about FFlib library paper and the OFIWG 
libfabric layer. Now I am planning to tackle the FFlib library code.
I am interested in joining the All-to-All communication project. I need some 
pointers on my proposal and if there is a task that I should finish, please 
tell me.

Thanks in advance
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC '18 - Implement a Faster Associative Container for GIDs

[Anushi Maheshwari]

Hey,

Thanks for the recommendation. I have installed HPX and active on IRC with
nick .

I have shared my initial proposal for your perusal.
https://docs.google.com/document/d/1pdsrntB0fyqc3D-JPiHW5lgy82F7Z5y3So4grE9sPOg/edit?usp=sharing

I shall be grateful if you could review my proposal and suggest me some
edits.
I have not completed figures, not included the implementation for N-ary
Tree and pseudocode for other DS as well.I am working on these and shall
complete it within a day.But I thought to share it with you at my earliest
since I am already a bit late (some health issue) and you are already busy
with other stuff as well.

Looking forward to your suggestions.
‌
Thanks

*Warm Regards*
*Anushi Maheshwari*
*GitNick : *


On Thu, Mar 15, 2018 at 7:53 PM, Patrick Diehl 
wrote:

> Hi Anushi,
>
> welcome to the community. A good start is to compile hpx and look at the
> examples. You also could join our irc channel #ste||ar at the freenode
> server.
>
> I would recommend you to look into the code and find the places where
> GIDs are used ad start to ask questions.
>
> Please keep in midn that the deadline for submitting the proposal is soon.
>
> Best,
>
> Patrick
>
> On 15/03/18 02:14 AM, Anushi Maheshwari wrote:
> > Dear Mentors,
> >
> > I am Anushi Maheshwari, final year student of Harcourt Butler Technical
> > University(HBTU, Kanpur).Before contributing to open-source I used to do
> > Sports Coding (Codechef://anushi, Codeforces://Anushi1998).Therefore, I
> > have a good understanding of Algorithms and STL Containers.I also
> > possess some beginner skills in Open MP as well.
> >
> > I find this project "Implement a Faster Associative Container for GIDs"
> > intriguing and I would like to contribute to it through GSoC 2018.I am
> > familiar with the implementation of tries and I think suffix trees
> > provide memory efficient implementation when compared to tries.I was
> > looking this folder (hpx/src/runtime/agas/) to get a better
> > understanding of the current implementation of GID lookup system.
> >
> > I would be grateful if you provide some directions for this project.
> >
> > Thanks
> >
> > *Warm Regards*
> > *Anushi Maheshwari*
> > *B.Tech (ECE)*
> > *HBTU, Kanpur-208002*
> > *
> > *
> >
> >
> >
> > ‌
> >  Sent with Mailtrack
> >  signature_campaign=signaturevirality&>
> >
> >
> >
> > ___
> > hpx-users mailing list
> > hpx-users@stellar.cct.lsu.edu
> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> >
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[권태국]

Hi,

I'm Taeguk Kwon who participated in GSoC 2017 last year.

Like you, I also had only 1-2 weeks until deadline last year. I started to
select organizations in student application period. That period was the
first time that I heard about HPX.
Although there is only a few time to prepare, I think you can do if you do
your best with efficient strategy.

Good luck,

taeguk

2018. 3. 17. 오전 10:21에 "Alanas Plascinskas" 님이
작성:

> Hey,
>
> I wanted to ask about the availability of your projects for GSoC 2018.
>
> I would mainly be interested in these projects: All to All Communications,
> Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
> any suggestions as well.
>
> Have any of these received any serious proposals and if so do you have any
> other projects that would be important for you and are still open?
>
> A little bit about my background (the first part of the form that you ask
> to fill):
>
>
>- Name: Alanas Plascinskas
>- College/University: University of Toronto (Year Abroad), University
>of Edinburgh (Home)
>- Course/Major: Computer Science & Mathematics
>- Degree Program: BSc
>- Email: alanas.plascins...@gmail.com
>- Homepage: https://www.linkedin.com/in/alanaspla/
>- Availability:
>   - Available for the whole duration of the project (mid-May to
>   late-August)
>   - What are your intended start and end dates? 14 May to 14 August
>   - What other factors affect your availability (exams, courses,
>   moving, work, etc.)? I will be available throughout without any major
>   disruptions
>
> Best,
> Alanas
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Biddiscombe, John A.]

Alanas

We haven’t had anyone else interested in the all-to-all communications project 
yet.
The description on the web page dates back to last year - but we’ve had some 
new ideas since then (or at least I have had), not so sure about the other 
potential mentors.

We added a libfabric parcelport last year that gives very high performance 
using rdma methods - its quite low level, working right off the network layer 
and integrating into the HPX parcelport framework.

A chap at ETHZ has developed a library for All-toAll communication that would 
fit very nicely with our libfabric implementation - it uses tree methods to 
minimize the total number of messges sent and also supports offloading od some 
operations to the network - if the network has logic capability (modern 
networks have this capability in the switches). If the network doesn’ then an 
abstraction can be created to handle it.
There’s a paper and code here
https://spcl.inf.ethz.ch/Research/Parallel_Programming/FFlib/

This woukd require pretty good knowledge of both the libfabric layer and also 
the library mentioned, so it would be quite a hard project - but if you took it 
on and were able to get even 1 of the algorithms (allGather/AllReduce/etc) 
working inside HPX, then it would be a fantastic contribution. I have not had 
time to work on it myself, but it’s been high on my to-do list for some time.

Have a skim through that material and look at the libfabric web pages - if 
you’re willing to try, please let us know, there’s not much time till the 
project dedline

JB

From: hpx-users-boun...@stellar.cct.lsu.edu 
<hpx-users-boun...@stellar.cct.lsu.edu> On Behalf Of Alanas Plascinskas
Sent: 17 March 2018 00:46
To: hpx-users@stellar.cct.lsu.edu
Subject: [hpx-users] GSoC 2018

Hey,

I wanted to ask about the availability of your projects for GSoC 2018.

I would mainly be interested in these projects: All to All Communications, 
Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to any 
suggestions as well.

Have any of these received any serious proposals and if so do you have any 
other projects that would be important for you and are still open?

A little bit about my background (the first part of the form that you ask to 
fill):


  *   Name: Alanas Plascinskas
  *   College/University: University of Toronto (Year Abroad), University of 
Edinburgh (Home)
  *   Course/Major: Computer Science & Mathematics
  *   Degree Program: BSc
  *   Email: alanas.plascins...@gmail.com<mailto:alanas.plascins...@gmail.com>
  *   Homepage: https://www.linkedin.com/in/alanaspla/
  *   Availability:

 *   Available for the whole duration of the project (mid-May to 
late-August)
 *   What are your intended start and end dates? 14 May to 14 August
 *   What other factors affect your availability (exams, courses, moving, 
work, etc.)? I will be available throughout without any major disruptions
Best,
Alanas
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Patrick Diehl]

Hi Alanas,

some students are interested to these proposals. Also you are very late
on contacting us and the deadline for submitting a proposal is at the
27.03.2018.

Best,

Patrick

On 16/03/18 07:45 PM, Alanas Plascinskas wrote:
> Hey, 
> 
> I wanted to ask about the availability of your projects for GSoC 2018. 
> 
> I would mainly be interested in these projects: All to All
> Communications, Conflict (Range-Based) Locks and Newtonian Physics
> Sandbox but I"m open to any suggestions as well.
> 
> Have any of these received any serious proposals and if so do you have
> any other projects that would be important for you and are still open?
> 
> A little bit about my background (the first part of the form that you
> ask to fill): 
> 
>   * Name: Alanas Plascinskas
>   * College/University: University of Toronto (Year Abroad), University
> of Edinburgh (Home)
>   * Course/Major: Computer Science & Mathematics
>   * Degree Program: BSc
>   * Email: alanas.plascins...@gmail.com
> 
>   * Homepage: https://www.linkedin.com/in/alanaspla/
>   * Availability:
>   o Available for the whole duration of the project (mid-May to
> late-August)
>   o What are your intended start and end dates? 14 May to 14 August
>   o What other factors affect your availability (exams, courses,
> moving, work, etc.)? I will be available throughout without any
> major disruptions
> 
> Best, 
> Alanas
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2018

[Alanas Plascinskas]

Hey,

I wanted to ask about the availability of your projects for GSoC 2018.

I would mainly be interested in these projects: All to All Communications,
Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
any suggestions as well.

Have any of these received any serious proposals and if so do you have any
other projects that would be important for you and are still open?

A little bit about my background (the first part of the form that you ask
to fill):


   - Name: Alanas Plascinskas
   - College/University: University of Toronto (Year Abroad), University of
   Edinburgh (Home)
   - Course/Major: Computer Science & Mathematics
   - Degree Program: BSc
   - Email: alanas.plascins...@gmail.com
   - Homepage: https://www.linkedin.com/in/alanaspla/
   - Availability:
  - Available for the whole duration of the project (mid-May to
  late-August)
  - What are your intended start and end dates? 14 May to 14 August
  - What other factors affect your availability (exams, courses,
  moving, work, etc.)? I will be available throughout without any major
  disruptions

Best,
Alanas
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hello:

I am Jin Li, a postgraduate from Beihang University, China. I am interested
in working on "HPX Backend for OpenCV" project.

I majored in image processing and patter recognition. So I need to use
OpenCV frequently, I have viewed the code of parallel.cpp before to
understand how OpenCV accelerate with multi-core architecture. I am
familiar with C++ and I have some knowledge on thread library like pthread
and VC thread,

However, I am not quite familiar with the HPX library. So maybe I need to
spend some time getting familiar with the APIs.

Do you have any suggestion on what should I do to apply for this project?

Best regards.
Jin Li
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC '18 - Implement a Faster Associative Container for GIDs

[Patrick Diehl]

Hi Anushi,

welcome to the community. A good start is to compile hpx and look at the
examples. You also could join our irc channel #ste||ar at the freenode
server.

I would recommend you to look into the code and find the places where
GIDs are used ad start to ask questions.

Please keep in midn that the deadline for submitting the proposal is soon.

Best,

Patrick

On 15/03/18 02:14 AM, Anushi Maheshwari wrote:
> Dear Mentors,
> 
> I am Anushi Maheshwari, final year student of Harcourt Butler Technical
> University(HBTU, Kanpur).Before contributing to open-source I used to do
> Sports Coding (Codechef://anushi, Codeforces://Anushi1998).Therefore, I
> have a good understanding of Algorithms and STL Containers.I also
> possess some beginner skills in Open MP as well.
> 
> I find this project "Implement a Faster Associative Container for GIDs"
> intriguing and I would like to contribute to it through GSoC 2018.I am
> familiar with the implementation of tries and I think suffix trees
> provide memory efficient implementation when compared to tries.I was
> looking this folder (hpx/src/runtime/agas/) to get a better
> understanding of the current implementation of GID lookup system.
> 
> I would be grateful if you provide some directions for this project.
> 
> Thanks
> 
> *Warm Regards*
> *Anushi Maheshwari*
> *B.Tech (ECE)*
> *HBTU, Kanpur-208002*
> *
> *
> 
> 
> 
> ‌
>  Sent with Mailtrack
> 
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC'18] Introduction - Kunal Agarwal

[Patrick Diehl]

Hi Kunal,

welcome to the community. A good start would be to compile hpx and run
the examples and understand some of them. For your project, it would be
helpful to start to use the performance counters in one of the examples.
The stencil example could be a good start to play around with the
performance counters.

Please have in mind that the deadline for submitting a proposal comes soon.

> Students can register and submit their applications to mentor
> organizations. All proposals must be submitted by March 27, 2018 12:00
> (EDT).

It would also be good to join our irc channel #ste||ar at freenode and
get into contact with the community and ask questions.

Best,

Patrick


On 14/03/18 05:44 AM, Kunal Agarwal wrote:
> Hello everyone,
> 
> I am a third year Undergraduate student at Indian Institute of
> Technology Bombay, pursuing my majors in Chemical Engineering and Minors
> in Computer Science & Engineering.
> 
> 
> I found the project about Augment CSV Files interesting and would like
> to contribute towards it for GSoC '18. I am rather new to the Stellar
> Group and it would be of great help, if you can give me some pointers on
> how to proceed.
> 
> I have worked with C++ and python in past. I am already familiar with
> .csv files and pandas during my course on ML and am keen to learn more
> about it. Apart from this I have some knowledge of C and MATLAB.
> 
> Thanking you in advance
> 
> Yours Sincerely
> Kunal Agarwal
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC'18] Introduction - Kunal Agarwal

[Kunal Agarwal]

Hello everyone,

I am a third year Undergraduate student at Indian Institute of Technology
Bombay, pursuing my majors in Chemical Engineering and Minors in Computer
Science & Engineering.

I found the project about Augment CSV Files interesting and would like to
contribute towards it for GSoC '18. I am rather new to the Stellar Group
and it would be of great help, if you can give me some pointers on how to
proceed.

I have worked with C++ and python in past. I am already familiar with .csv
files and pandas during my course on ML and am keen to learn more about it.
Apart from this I have some knowledge of C and MATLAB.

Thanking you in advance
Yours Sincerely
Kunal Agarwal
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC '18] Introduction - Kunal Agarwal

[Hartmut Kaiser]

Hey,

 

Please send your questions to the hpx-users@stellar.cct.lsu.edu 
  mailing list (cc’ed) for others to be 
able to chime is as well.

 

Thanks!

Regards Hartmut

---

  http://boost-spirit.com

  http://stellar.cct.lsu.edu

 

From: Kunal Agarwal [mailto:kunalagarwa...@gmail.com] 
Sent: Tuesday, March 13, 2018 1:37 PM
To: hartmut.kai...@gmail.com
Subject: [GSoC '18] Introduction - Kunal Agarwal

 

  

 

Dear Hartmut,

I am a third year Undergraduate student at Indian Institute of Technology 
Bombay, pursuing my majors in Chemical Engineering and Minors in Computer 
Science & Engineering. 

 

I found the project about Augment CSV Files interesting and would like to 
contribute towards it for GSoC '18. I am rather new to the Stellar Group and it 
would be of great help, if you can give me some pointers on how to proceed.

I have worked with C++ and python in past. I am already familiar with .csv 
files and pandas during my course on ML and am keen to learn more about it. 
Apart from this I have some knowledge of C and MATLAB.

Thanking you in advance

Yours Sincerely

Kunal Agarwal



‌

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC Peridynamics Project

[Ho Shan LAM]

Hi,


I'm Sharon, a CS undergraduate from Hong Kong. I'm interested in the project - 
Domain decomposition and load balancing for crack and fracture mechanics code. 
I'd like to understand the domain decomposition part more first.


I looked at Patrick Diehl's thesis related to simulation for peridynamics in 
brittle materials (hss.ulb.uni-bonn.de/2017/4631/4631.pdf), which I believe 
discusses the code to be extended. From my understanding, the modeling method 
in the paper relies heavily on fast neighbor search on GPU. First it maps all 
the spatial points of a material with a key, and then find the nearest 
neighbors of all points with respect to the sorted keys. In the implementation, 
HPXCL-CUDA was used to utilize GPU clusters. If I'm right, during execution 
each GPU is allocated with a chunk from a single memory address space, running 
futurized calls.

In the project we're going to implement it on distributed memory. My rough idea 
is to extend all the four steps in neighbor search one by one, namely:

  1.  generating keys;
  2.  sorting keys;
  3.  range scan;
  4.  geometrical validation.

My questions are, is the original code available to look at? Are there any HPX 
libraries to handle data distribution so that we do not use other message 
passing libraries? I looked online it seems that AGAS is the way to go. Right 
now, I'm still very confused about the overall architecture, it's nice if you 
can share some links to example code/paper that helps introducing HPX and tools 
that the project needs.

I'm still new to parallel programming, thanks a lot for reading this email. My 
IRC alias is sharonhsl, hoping to hearing back soon!


Cheers,

Sharon Lam
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2018

[Parimi Viraj]

Hi everyone!

I am interested in contributing to HPX during Summer 2018 through GSOC.

Firstly, I would like to introduce myself. I have been working on parallel
programming over the last couple of months. During this time I have made a
static and dynamic task mapping runtimes which provides an easy interface
to work on compared to Pthreads. Also, I have been learning CUDA by
implementing parallel DFS. I find parallel programming paradigm quite
intriguing.

I looked up your project ideas for GSOC 2018 and found 2 projects that
seemed to align perfectly with my interests.


   1. HPX Backend for OpenCV
   2. Concurrent Data structure Support

Can you guys point me to some issues which I could solve so that I can get
a better understanding of your codebase?

Regards,
Viraj Parimi 
‌
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2018, question about "smart executors" paper

[Zahra Khatami]

Hi Ray,

In my research, these parameters are also heuristicaly found. Basically we
tested our framework on hpx for-each using different selected chunk sizes
each time. These loops had different parameters ( static and dynamic) which
reacted differently for those chunk size candidates. Then, we determined
which chunk size resulted in better performance on each of those loops.
That’s how we collected our training data, which we trained our model using
them. You can find training data in HPXML on hpx GitHub.

Thanks,
Zahra,

On Wed, Feb 21, 2018 at 4:21 AM 김규래  wrote:

> Hi Zahra,
> I've read your amazong paper for quite a while.
> There's one thing I cannot find answers.
>
> What were the label data that the models were trained on?
> I cannot find explanation about how 'optimal chunk size' and 'optimal
> prefetching distance' labels were collected.
>
> Previous work mostly states heuristically found labels.
> In the case of your paper, how was this done?
>
> My respects.
> msca8h at naver dot com
> msca8h at sogang dot ac dot kr
> Ray Kim
>
-- 
Best Regards, Zahra Khatami | PhD Student Center for Computation &
Technology (CCT) School of Electrical Engineering & Computer Science
Louisiana State University 2027 Digital Media Center (DMC) Baton Rouge, LA
70803
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2018, question about "smart executors" paper

[김규래]

Hi Zahra,
I've read your amazong paper for quite a while.
There's one thing I cannot find answers.

What were the label data that the models were trained on?
I cannot find explanation about how 'optimal chunk size' and 'optimal 
prefetching distance' labels were collected.

Previous work mostly states heuristically found labels.
In the case of your paper, how was this done?

My respects.
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSOC 2018] Add More Arithmetic Performance Counters

[surya priy]

Hello all !

I , SURYA PRIY would like to work on *"Add More Arithmetic Performance
Counters and Adding PARALLEL ALGORITHMS " *in the coming GSOC 2018 with
STELLAR GROUP. I am B.TECH student with Computer Science stream and have
previously worked with Chapel  .
Sorry for being late in introducing myself in this group . Actually, I am
studying about HPX framework and learning them . I have introduced myself
on IRC with username *victor_ludorum*  .  So, As per the issue
 , there should be
implementation of some more arithmetic performance counters having
statistical properties. I have done some research on this and found the
statistical functions in BOOST

.
Some of them have been already implemented but many of them are left .I
would mention some of the functions that should be implemented here like

   - COUNT
   - COVARIANCE
   - DENSITY
   - ERROR OF MEANS
   - KURTOSIS
   - MOMENT
   - TAIL
   - SKEWNESS

and some important numeric functions too like

   - LOG
   - EXPONENT
   - ABS

I have also thought to implement some *PARALLEL ALGORITHMS* left
unimplemented from the List
 like

   - PARTIAL_SORT
   - NTH_ELEMENT
   - STABLE SORT

and more important should be suggested that should be work on .
Please suggest how do I start my work on this .

Thanks .

Regards
Surya Priy

Github profile Link - victor-ludorum 
My work in Chapel - PR

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Histogram Performance Counter

[Simberg Mikael]

Hi Saurav,

I'd also be happy to hear more about HdrHistogram. It seems to me that the main 
feature is the HDR-ness. This means roughly the same as having exponentially 
spaced bins in the histogram?

More generally, if HdrHistogram offers compelling features over the one we 
already have, it is definitely a useful addition. Concurrency is in any case a 
must. If you haven't already seen the "More Arithmetic Performance Counters" 
and "Augment CSV Files" projects have a look at them as parts of those can 
(more likely should) be combined into one project. "More Arithmetic Performance 
Counters" has already been done by Hartmut in PR 2745, but more operations 
could potentially be useful (log, exp?). If you'd like to do more data analysis 
you should look at "Augment CSV Files". You could mix and match parts of these 
into a nice package.

Looking at the histogram implementation that Hartmut linked is a good place to 
start, as is the rest of the performance counter framework. That should give 
you a better idea of what we already have and what we might be lacking.

Hop onto IRC (#ste||ar on freenode) if you have more detailed questions!

Kind regards,
Mikael

From: hpx-users-boun...@stellar.cct.lsu.edu 
[hpx-users-boun...@stellar.cct.lsu.edu] on behalf of Hartmut Kaiser 
[hartmut.kai...@gmail.com]
Sent: Monday, February 19, 2018 10:57 PM
To: hpx-users@stellar.cct.lsu.edu; 'Saurav Sachidanand'
Subject: Re: [hpx-users] [GSoC 2018] Histogram Performance Counter

Hey Saurav,

> My name is Saurav Sachidanand and I wish to participate in GSoC 2018.
> I'm intrigued with the Histogram Performance Counter project. I've
> previously worked with HdrHistorgram [1], which is a histogram
> implementation that can record integer and float values with high range
> and precission, with fixed space and time costs. Implementations in
> several languages exist, but not in C++. The reference Java version [2]
> provides several more features, including a concurrent version of the
> histogram. Would implementing a generic C++ concurrent HdrHistgram
> perforamance counter, supporting all features from the Java version and
> utilizing HPX's APIs, be a useful addition?
>
> This idea came to mind beacuse I participated in GSoC last year [3], where
> I built a Performance Co-Pilot instrumentation library in Rust, and I had
> to integrate HdrHistogram into the API [4].
>
> Any guidance and feedback will be greatly appreciated.

I don't know anything about the HdrHistgram you're referring to. Would you care 
to elaborate?

We have a histogram implementation in HPX 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/util/histogram.hpp) which 
is currently used for a special performance counter in the parcel (message) 
coalescing layer. But this does not have to be used for a general purpose 
counter.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu

>
> Thanks,
> Saurav
>
> [1] - https://hdrhistogram.github.io/HdrHistogram/
> [2] - https://github.com/HdrHistogram/HdrHistogram
> [3] -
>  https://summerofcode.withgoogle.com/archive/2017/projects/479329678209843
> 2/
> [4] - https://github.com/performancecopilot/hornet#histogram

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patricia Grubel]

As far as performance counters you may wish to experiment with the overhead 
counter in addition to the idle-rate counter.

Pat
> On Feb 19, 2018, at 12:26 PM, Zahra Khatami  wrote:
> 
> Hi Ray,
> 
> If you refer to the published paper, you could get more information. 
> Generally talking, this project uses compiler and runtime system to gather 
> both static and dynamic information to set HPX algorithm parameters such as 
> chunk sizes efficiently. Static information are gathered by a compiler, which 
> we used clang and we developed a new class for clang for this purpose. 
> Dynamic information are gathered by new HPX policies that we developed for 
> this purpose. You can look at the example in HPXML in HPX GitHub.
> 
> Thanks,
> Zahra
> 
> On Mon, Feb 19, 2018 at 9:04 AM 김규래  > wrote:
> Hi Adrian,
> 
> Thanks for clarifying.
> 
> I think I pretty much get the picture.
> 
>  
> Looking forward to get in touch with Patrick in IRC within this week.
> 
>  
> Thanks everyone.
> 
>  
> msca8h at naver dot com
> 
> msca8h at sogang dot ac dot kr
> 
> Ray Kim
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu 
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users 
> 
> -- 
> Best Regards, Zahra Khatami | PhD Student Center for Computation & Technology 
> (CCT) School of Electrical Engineering & Computer Science Louisiana State 
> University 2027 Digital Media Center (DMC) Baton Rouge, LA 70803
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Zahra Khatami]

Hi Ray,

If you refer to the published paper, you could get more information.
Generally talking, this project uses compiler and runtime system to gather
both static and dynamic information to set HPX algorithm parameters such as
chunk sizes efficiently. Static information are gathered by a compiler,
which we used clang and we developed a new class for clang for this
purpose. Dynamic information are gathered by new HPX policies that we
developed for this purpose. You can look at the example in HPXML in HPX
GitHub.

Thanks,
Zahra

On Mon, Feb 19, 2018 at 9:04 AM 김규래  wrote:

> Hi Adrian,
>
> Thanks for clarifying.
>
> I think I pretty much get the picture.
>
>
>
> Looking forward to get in touch with Patrick in IRC within this week.
>
>
>
> Thanks everyone.
>
>
>
> msca8h at naver dot com
>
> msca8h at sogang dot ac dot kr
>
> Ray Kim
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
-- 
Best Regards, Zahra Khatami | PhD Student Center for Computation &
Technology (CCT) School of Electrical Engineering & Computer Science
Louisiana State University 2027 Digital Media Center (DMC) Baton Rouge, LA
70803
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

Hi Adrian,
Thanks for clarifying.
I think I pretty much get the picture.
 
Looking forward to get in touch with Patrick in IRC within this week.
 
Thanks everyone.
 
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Adrian Serio]

Patrick and Ray,

Just for clarity's sake I will point out that Zahra's work did include 
information gathered at compile time. She used a custom Clang plugin to 
gather this information.


That being said, we may want to only utilize runtime information in the 
context of this project. However, I will deffer that decision to the 
mentors assigned to the project.


Adrian


On 2/18/2018 4:10 PM, Patrick Diehl wrote:

Hi Ray Kim,


But the original GSoC project description and the paper[1]  both mention
*compiler provided* *static data*.
 From my belief this cannot be acquired from HPX performance counters
(excuse me if they actually do)
If this project should be independent of compiler (or libray), than I
suppose I may not be bothered?

Yes, this was mentioned in the project description. But since we wrote
the description, I looked into the blaze library and how they decide to
use single core or omp execution, depending on the parameters, like the
input size. They measuring the threshold when a parallel execution is
faster as the single core execution. These thresholds for different
algorithms are provided in a header file as constants.

I was thinking that something similar could be done with machine
learning for the different algorithms. Instead of a threshold we would
have function learned by the machine learning algorithm.

This is just my thinking how to do this. For sure, there are many other
approaches out there. it is your task to propose any solution, you think
could solve this problem.


In case of not doing any machine learning during run time,
What form of implementation are you expecting?

I was thinking to have for different parallel algorithms one function

f_i(length of input, amount of cpus, ...) -> (chunk_size, used amount of
cpus)

So during run time, your function get input parameters, like the amount
of cpus and the length of the input, and maybe many more. And the
function returns the optimal chunk size and maybe the  used amount of
cpus. Where used amount is the amount of cpu used by hpx. For example
one wants to run hpx with 3 cpus, but the input size is very small and
it would be faster to just use one cpu. So your function would predict
this.

I was thinking that one could use performance counters to obtain, e.g.
the /threads/idle-rate for different input parameters. So one would have
an d-dimensional input space, which could be used to learn a function
approximating this points.


A separate program that does prediction and sets all the parameters?

1) A shell script, which runs the hpx applications and save all data to
a csv file.

2) A python script, which uses this data to learn the function f_i.

3) These functions should be implemented and a possible smart executor
could use the function for each parallel algorithm to predict the best
chunk size and parallel or serial execution, depending on your input
parameters.


Or a meta program that does the job in compile time?

If you think this is necessary, please provide a explanation why and how
you want to do this.


Or is this up to my proposition?

Yes, you should look into how the task could be solved and propose to
the community any solution, you think could do this. We will discuss
with you your proposed solution and improve it.

I am happy to discuss with you next week on irc. I think it will be
easier to clarify things.

Best,

Patrick

On 02/18/2018 02:15 PM, 김규래 wrote:

​Hi again Patrick,
​Thanks for keeping track of me.

But the original GSoC project description and the paper[1]  both mention
*compiler provided* *static data*.
 From my belief this cannot be acquired from HPX performance counters
(excuse me if they actually do)
If this project should be independent of compiler (or libray), than I
suppose I may not be bothered?

/> If you collect data and try to generate a model and use the > trained
model without any machine learning during run time,/

In case of not doing any machine learning during run time,
What form of implementation are you expecting?
A separate program that does prediction and sets all the parameters?
Or a meta program that does the job in compile time?
Or is this up to my proposition?

Thanks for all
Ray Kim

[1] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf, p4 fig2




___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users


--
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Histogram Performance Counter

[Saurav Sachidanand]

Hello all,

My name is Saurav Sachidanand and I wish to participate in GSoC 2018.
I'm intrigued with the Histogram Performance Counter project. I've
previously worked with HdrHistorgram [1], which is a histogram
implementation that can record integer and float values with high range and
precission, with fixed space and time costs. Implementations in several
languages exist, but not in C++. The reference Java version [2] provides
several more features, including a concurrent version of the histogram.
Would implementing a generic C++ concurrent HdrHistgram perforamance
counter, supporting all features from the Java version and utilizing HPX's
APIs, be a useful addition?

This idea came to mind beacuse I participated in GSoC last year [3], where
I built a Performance Co-Pilot instrumentation library in Rust, and I had
to integrate HdrHistogram into the API [4].

Any guidance and feedback will be greatly appreciated.

Thanks,
Saurav

[1] - https://hdrhistogram.github.io/HdrHistogram/
[2] - https://github.com/HdrHistogram/HdrHistogram
[3] -
https://summerofcode.withgoogle.com/archive/2017/projects/4793296782098432/
[4] - https://github.com/performancecopilot/hornet#histogram
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

​Hi again Patrick,​Thanks for keeping track of me.

But the original GSoC project description and the paper[1]  both mention 
compiler provided static data.From my belief this cannot be acquired from HPX 
performance counters (excuse me if they actually do)If this project should be 
independent of compiler (or libray), than I suppose I may not be bothered? 
If you collect data and try to generate a model and use the
 trained model without any machine learning during run time,In case of not 
doing any machine learning during run time,What form of implementation are you 
expecting?A separate program that does prediction and sets all the 
parameters?Or a meta program that does the job in compile time?Or is this up to 
my proposition?
Thanks for allRay Kim
[1] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf, p4 fig2___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patrick Diehl]

Hi Ray Kim,

>> The literature mostly talks about feature acquisition through libclang.
>> 
>> Than under this project, is the HPX distribution including tooling based
>> on libclang?

No, the project's solution should be independent on any library. One
requirement would be, that it works independent on the compiler. HPX
itself provide performance counters [0]. These ones could be used for
acquisition of data. Or just data you could measure during run time.

>> And I guess part of a machine learning framework -such as xgboost,
>> tinydnn, etc...
>> 
>>  will also need to be included in the distribution.

No, I think this would be not needed. It really depends on your
approach. If you collect data and try to generate a model and use the
trained model without any machine learning during run time, I would
recommend to use scikit-learn [1]. It is easy to use and you can easily
play around with different models.

For the case when you want to use machine learning during run time, I
would recommend to use scikit-learn to find a suitable model. Once, you
found this model, you should have a look into the model and implement
these algorithms by yourself. I think that we do not need a very
sophisticated model and it would be easy to implement this model.

In addition, I recommend to read the previous mentioned paper to get
some more details.

Best,

Patrick


[0]
http://stellar.cct.lsu.edu/files/hpx_0.9.5/html/hpx/manual/performance_counters/counters.html
[1] http://scikit-learn.org/stable/

On 02/17/2018 12:14 AM, 김규래 wrote:
> Hello Patrick,
> 
> Thank you for your guidance.
> 
> I have few more questions on the subject.
> 
>  
> 
> The literature mostly talks about feature acquisition through libclang.
> 
> Than under this project, is the HPX distribution including tooling based
> on libclang?
> 
> (And custom build system stuff for the additional compile time
> computations?)
> 
>  
> 
> And I guess part of a machine learning framework -such as xgboost,
> tinydnn, etc...
> 
>  will also need to be included in the distribution.
> 
> Am I understanding this project correctly?
> 
>  
> 
> Great regards,
> 
> Ray Kim
> 
>  
> 
> -Original Message-
> *From:* "Patrick Diehl"<patrickdie...@gmail.com>
> *To:* "김규래"<msc...@naver.com>; <hpx-users@stellar.cct.lsu.edu>;
> *Cc:*
> *Sent:* 2018-02-16 (금) 07:17:52
> *Subject:* Re: [hpx-users] GSoC 2018, on "applying machine learning
> technques ..." project
>  
> 
> Hi Ray,
> 
> welcome to the community. A good starting point for this project would
> be to read this publication [0]:
> 
> Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
> Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
> International Workshop on Extreme Scale Programming Models and
> Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,
> 
>>> Then is the goal to analyze data? or also implement the algorithms?
> 
> The goal is to provide a new execution policy [1], which utilizes
> machine learning techniques to optimize the computational time.
> 
> So the first step would be to analyze the data.
> 
> In my opinion there are two different ways, one can integrate machine
> learning.
> 
> 1) You could collect the data and train a model to obtain parameters for
> your function f(x,y,z) -> chunk size. In this case you could use any
> existing machine learning library to get these parameters for your function.
> 
> Here, you will implement this function in the execution policy to
> estimate e.g. the "best" chunk size for given x,y,z.
> 
> 2) You could train your model at run time to obtain e.g. the "best"
> chunk size. In this case you have to implement your chosen machine
> learning algorithm for the integration in hpx.
> 
> Best,
> 
> Patrick
> 
> 
> [0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
> [1]
> https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html
> 
> On 15/02/18 01:53 PM, 김규래 wrote:
>> HI, my name is Ray Kim.
>>
>> I'm a junior EE student in Sogang Univ. Korea.
>>
>> I have a little experience in C++ and HPC applications and machine
> learning.
>>
>> Here is a link to my github profile for some of my personal projects.
>>
>> https://github.com/Red-Portal
>>
>>  
>>
>> I'm interested in the project "Applying Machine Learning Techniques on
>> HPX Parallel Algorithms",
>>
>> however I would like to have more details about it.
>>
>> The description talks about implementing the algorithms and analyzing
>> the per

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

Hello Patrick,
Thank you for your guidance.
I have few more questions on the subject.
 
The literature mostly talks about feature acquisition through libclang.
Than under this project, is the HPX distribution including tooling based on 
libclang?
(And custom build system stuff for the additional compile time computations?)
 
And I guess part of a machine learning framework -such as xgboost, tinydnn, 
etc...
 will also need to be included in the distribution.
Am I understanding this project correctly?
 
Great regards,
Ray Kim
 
-Original Message-
From: "Patrick Diehl"patrickdie...@gmail.com 
To: "김규래"msc...@naver.com; hpx-users@stellar.cct.lsu.edu; 
Cc: 
Sent: 2018-02-16 (금) 07:17:52
Subject: Re: [hpx-users] GSoC 2018, on "applying machine learning technques 
..." project
 
Hi Ray,

welcome to the community. A good starting point for this project would
be to read this publication [0]:

Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
International Workshop on Extreme Scale Programming Models and
Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,

 Then is the goal to analyze data? or also implement the algorithms?

The goal is to provide a new execution policy [1], which utilizes
machine learning techniques to optimize the computational time.

So the first step would be to analyze the data.

In my opinion there are two different ways, one can integrate machine
learning.

1) You could collect the data and train a model to obtain parameters for
your function f(x,y,z) - chunk size. In this case you could use any
existing machine learning library to get these parameters for your function.

Here, you will implement this function in the execution policy to
estimate e.g. the "best" chunk size for given x,y,z.

2) You could train your model at run time to obtain e.g. the "best"
chunk size. In this case you have to implement your chosen machine
learning algorithm for the integration in hpx.

Best,

Patrick


[0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
[1]
https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html

On 15/02/18 01:53 PM, 김규래 wrote:
 HI, my name is Ray Kim.
 
 I'm a junior EE student in Sogang Univ. Korea.
 
 I have a little experience in C++ and HPC applications and machine 
learning.
 
 Here is a link to my github profile for some of my personal projects. 
 
 https://github.com/Red-Portal 
 
  
 
 I'm interested in the project "Applying Machine Learning Techniques on
 HPX Parallel Algorithms",
 
 however I would like to have more details about it.
 
 The description talks about implementing the algorithms and analyzing
 the performance of these algorithms.
 
 Then is the goal to analyze data? or also implement the algorithms?
 
  
 
 Great admirations for everyone working on HPX.
 
 It would be an honor if I could work with you all.
 
 msca8h at naver dot com
 
 msca8h at sogang dot ac dot kr
 
 Ray Kim
 
 
 
 ___
 hpx-users mailing list
 hpx-users@stellar.cct.lsu.edu
 https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patrick Diehl]

Hi Ray,

welcome to the community. A good starting point for this project would
be to read this publication [0]:

Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
International Workshop on Extreme Scale Programming Models and
Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,

>> Then is the goal to analyze data? or also implement the algorithms?

The goal is to provide a new execution policy [1], which utilizes
machine learning techniques to optimize the computational time.

So the first step would be to analyze the data.

In my opinion there are two different ways, one can integrate machine
learning.

1) You could collect the data and train a model to obtain parameters for
your function f(x,y,z) -> chunk size. In this case you could use any
existing machine learning library to get these parameters for your function.

Here, you will implement this function in the execution policy to
estimate e.g. the "best" chunk size for given x,y,z.

2) You could train your model at run time to obtain e.g. the "best"
chunk size. In this case you have to implement your chosen machine
learning algorithm for the integration in hpx.

Best,

Patrick


[0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
[1]
https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html

On 15/02/18 01:53 PM, 김규래 wrote:
> HI, my name is Ray Kim.
> 
> I'm a junior EE student in Sogang Univ. Korea.
> 
> I have a little experience in C++ and HPC applications and machine learning.
> 
> Here is a link to my github profile for some of my personal projects. 
> 
> https://github.com/Red-Portal 
> 
>  
> 
> I'm interested in the project "Applying Machine Learning Techniques on
> HPX Parallel Algorithms",
> 
> however I would like to have more details about it.
> 
> The description talks about implementing the algorithms and analyzing
> the performance of these algorithms.
> 
> Then is the goal to analyze data? or also implement the algorithms?
> 
>  
> 
> Great admirations for everyone working on HPX.
> 
> It would be an honor if I could work with you all.
> 
> msca8h at naver dot com
> 
> msca8h at sogang dot ac dot kr
> 
> Ray Kim
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC : "HPX Backend for OpenCV"

[Biddiscombe, John A.]

Just an update on the project from my ‘wish list’

Task #1 : have a lookm at opencv and how the threading backends are implemented
Task #2: Get a good understanding of the HPX threading framework. Make sure you 
appreciate the difference between kernel level threads and lightweight HPX 
threads. Reading from a webcam or other device might make low level calls that 
need to be done on a kernel thread rather than an hpx worker/task thread.
Task #3: Implement an HPX backend to replace OpenMP/TBB in openCV and test out 
standard opencv algorithms
Task #4: make sure that the threading implementation doesn’t violate the terms 
of #2 and that hpc threads are not blocking in wait staes whilst polling for 
camera/image data
Task #5: understand that HPX supports thread pools and we can create a custom 
thread for any opencv camera poll work so that the problems I just alluded to 
do not happen
Task #6: Together a simple Qt demo with a GUI that displays images in a nice 
GUI window and overlays some image processing data etc. I have an application I 
wrote for monitoring wildlife in my garden that can be adapted for this - it 
tracks movement by doing pixel comparisons after applying  bunch of filters to 
the webcam images - when movement is detected, it starts recording so I can see 
what happened whilst I was asleep etc (infra-red cameras for night vision).
Task #7: Understand that Qt GUI threads can’t always be run on hpx task threads 
and/or tht Qt guis are not generally thread safe and we may need a special 
thread for GUI updates (or careful use of Qt synchronization), so a thread pool 
dedicated for that might/would be a good idea.

Task #0 - learn as much as you can about all of the above before gsoc starts 
and write a decent proposal “in your own words” that describes how you plan to 
do the above (and insert extra tasks because I wrote  this fast and skipped 
lots of details).

Feel free to ask questions on IRC or here - I’ll update the task list above if 
I think of more - and note that #1-#5 are the main essentials and #6-#7 are 
bonus work for anyone who makes good progress on the first tasks.

JB




From: Marcin Copik [mailto:mco...@gmail.com]
Sent: 15 February 2018 18:02
To: Ashish Jha ; hpx-users@stellar.cct.lsu.edu
Cc: Patrick Diehl ; Biddiscombe, John A. 

Subject: Re: GSoC : "HPX Backend for OpenCV"

Dear Ashish,

cc'ing this message to the mailing list to let the other mentors and the 
community to chime in and propose their suggestions.

The project idea gives a link to the existing implementation of parallel task 
processing in OpenCV. It's a good starting point since understanding how OpenCV 
currently handles the parallelization is necessary to propose an integration 
scheme for HPX. You may also want to take a look at the guide to writing a 
successful proposal[1].

Best regards,
Marcin Copik

[1] - https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals
śr., 14 lut 2018 o 16:38 użytkownik Ashish Jha 
> napisał:
[https://api.openbracket.co/track/f8842b410f36ecfb3fc588d5bf81c7c9.gif]
Respected Sir,
I am Ashish Jha, 3rd-year computer science undergrad at NIT Rourkela.

I have worked on OpenMP project and has recently been introduced to OpenCV.  I 
will love to work on the project HPX Backend for OpenCV.

Can you please guide me where to start?
I am having exam until 27th February so I can devote up to 1 or 2 hour to the 
project and after that, I can devote full time on the project

​Attached is my CV.​

-
​​
-
Thanking you,
Ashish Kumar Jha
3rd year CSE Undergrad,
National Institute of Technology, Rourkela.
Contact: +91-9430682550
Facebook  | 
LinkedIn
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

HI, my name is Ray Kim.
I'm a junior EE student in Sogang Univ. Korea.
I have a little experience in C++ and HPC applications and machine learning.
Here is a link to my github profile for some of my personal projects. 
https://github.com/Red-Portal 
 
I'm interested in the project "Applying Machine Learning Techniques on HPX 
Parallel Algorithms",
however I would like to have more details about it.
The description talks about implementing the algorithms and analyzing the 
performance of these algorithms.
Then is the goal to analyze data? or also implement the algorithms?
 
Great admirations for everyone working on HPX.
It would be an honor if I could work with you all.
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC : "HPX Backend for OpenCV"

[Marcin Copik]

Dear Ashish,

cc'ing this message to the mailing list to let the other mentors and the
community to chime in and propose their suggestions.

The project idea gives a link to the existing implementation of parallel
task processing in OpenCV. It's a good starting point since understanding
how OpenCV currently handles the parallelization is necessary to propose an
integration scheme for HPX. You may also want to take a look at the guide
to writing a successful proposal[1].

Best regards,
Marcin Copik

[1] -
https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals

śr., 14 lut 2018 o 16:38 użytkownik Ashish Jha 
napisał:

> Respected Sir,
> I am Ashish Jha, 3rd-year computer science undergrad at NIT Rourkela.
>
> I have worked on OpenMP project and has recently been introduced to
> OpenCV.  I will love to work on the project HPX Backend for OpenCV.
>
> Can you please guide me where to start?
> I am having exam until 27th February so I can devote up to 1 or 2 hour to
> the project and after that, I can devote full time on the project
>
> ​Attached is my CV.​
>
> -
> ​​
> -
> Thanking you,
> Ashish Kumar Jha
> 3rd year CSE Undergrad,
> National Institute of Technology, Rourkela.
> Contact: +91-9430682550 <+91%2094306%2082550>
> Facebook | LinkedIn
> 
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC '18 - Concurrent Data Structures

[Patrick Diehl]

Hi Shikar,

welcome to the community. Have you seen the hints for writing a
successful proposals [0]?

Best,

Patrick

[0] https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals

On 15/02/18 12:14 AM, Shikhar S wrote:
> Hi, 
> I am an engineering student doing my Bachelors from Bits Pilani,
> currently working as an intern for Microsoft Research and working on
> LevelDB (a concurrent API for persistent storage of string key-value
> pairs). I want to work on Concurrent Data Structures project. I went
> through issue #2235 and the code for concurrent vector in the Concurrent
> Data Structure branch. I have built hpx and ran tests successfully. What
> other data structures are expected to be implemented in hpx? Am I right
> in assuming that we will also need lockfree implementations for vector
> and unordered set/map ?
> 
> 
> Regards
> Shikhar Bharadwaj 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC '18 - Concurrent Data Structures

[Shikhar S]

Hi,
I am an engineering student doing my Bachelors from Bits Pilani, currently
working as an intern for Microsoft Research and working on LevelDB (a
concurrent API for persistent storage of string key-value pairs). I want to
work on Concurrent Data Structures project. I went through issue #2235 and
the code for concurrent vector in the Concurrent Data Structure branch. I
have built hpx and ran tests successfully. What other data structures are
expected to be implemented in hpx? Am I right in assuming that we will also
need lockfree implementations for vector and unordered set/map ?


Regards
Shikhar Bharadwaj
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC Generic Histogram performance counter project

[Biddiscombe, John A.]

just as a "by the way" - some time back, someone proposed a boost histogram 
class, that I played with (no idea if it was accepted into boost), but I added 
it to the libfabric parcelport on my branch so that I could dump out histograms 
of the parcel sizes that were passing through the parcelport.

Would be very nice to see something like this available off the shelf in 
hpx/perf counters

JB

-Original Message-
From: hpx-users-boun...@stellar.cct.lsu.edu 
[mailto:hpx-users-boun...@stellar.cct.lsu.edu] On Behalf Of Hartmut Kaiser
Sent: 04 February 2018 19:22
To: 'Tanmay Tirpankar' <tanmayp...@gmail.com>
Cc: hpx-users@stellar.cct.lsu.edu
Subject: Re: [hpx-users] GSOC Generic Histogram performance counter project

Hey Tanmay,

> I was going through your GSOC 2018 project ideas and I was thinking of 
> working on these 2 projects 1)Add More Arithmetic Performance Counters
> 
> 2)Create Generic Histogram Performance Counter I don't have a lot of 
> experience in parallel computing but I would like to learn more about 
> it through this project.

Cool! I think the first (the arithmetic counters) have been implemented by now, 
but the generic histogram counter is a nice, small, and self-contained project.

I'm cc'ing this response to hpx-users@stellar.cct.lsu.edu and I'd suggest that 
all follow-on discussions are done over there. Feel free to post your questions 
on that list as this may yield response from other people as well.

Alternatively, our main communication platform is IRC, feel free to hop on at 
#ste||ar on freenode.net (see here for more communication possibilities: 
https://github.com/STEllAR-GROUP/hpx/blob/master/.github/SUPPORT.md)

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC Generic Histogram performance counter project

[Hartmut Kaiser]

Hey Tanmay,

> I was going through your GSOC 2018 project ideas and I was thinking of
> working on these 2 projects
> 1)Add More Arithmetic Performance Counters
> 
> 2)Create Generic Histogram Performance Counter
> I don't have a lot of experience in parallel computing but I would like to
> learn more about it through this project.

Cool! I think the first (the arithmetic counters) have been implemented by now, 
but the generic histogram counter is a nice, small, and self-contained project.

I'm cc'ing this response to hpx-users@stellar.cct.lsu.edu and I'd suggest that 
all follow-on discussions are done over there. Feel free to post your questions 
on that list as this may yield response from other people as well.

Alternatively, our main communication platform is IRC, feel free to hop on at 
#ste||ar on freenode.net (see here for more communication possibilities: 
https://github.com/STEllAR-GROUP/hpx/blob/master/.github/SUPPORT.md)

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2017 Activity Report For 2nd Evaluation by ABresting

[Abhimanyu Rawat]

Hi All,
My work report so far and expected future work. I have tried summing up the
work, feel free to review it.

https://docs.google.com/document/d/1NO_kRk5opuQ9lcCIUFgrc5tbGNzTHL-8guwIQCfgVDA/edit?usp=sharing

*Regards,*
*ABresting*
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC report

[Praveen Velliengiri]

My GSoC Report
Please provide your opinion
Thanks
pree


GSoC Distributed Component Placement Project.pdf
Description: Adobe PDF document
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC Distributed Component Placement Project - Invitation to edit

[Praveen Velliengiri (via Google Docs)]

I've shared an item with you:

GSoC Distributed Component Placement Project
https://docs.google.com/a/stellar.cct.lsu.edu/document/d/1Xhdn_R6QBFc4i_uYHLt7Ena87gydf4jB501cYWf_big/edit?usp=sharing=5973d64c

It's not an attachment -- it's stored online. To open this item, just click  
the link above.


GSoC report
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2017 Activity Report For 2nd Evaluation by taeguk

[권태국]

Hi,
My main work is implementing parallel algorithms in C++17 standard.
I implemented some algorithms until now.
And I will implement all of remained algorithms even after GSoC is over.
I want to see that #1141 is closed.

This is my activity report until now.

https://docs.google.com/document/d/16sJEbHNsK3n-lhcLOFKDnE8D_yPeQVHAnr-k-JEfbbw/edit?usp=sharing

​
 GSoC Activity Report - 2nd Evaluation - taeguk

​
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2017 Progress Report - Ajai V George

[Ajai George]

Hi,

Please find attached my progress report for GSoC 2017.
I am working on extending segmented algorithms as described in #1338.

Link to Google Doc


Regards,

Ajai V George
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC

[Hartmut Kaiser]

> I want to start coding from tomorrow (29-May-2017)(sunday).

Cool!

> This is my first phase plan:
>   Implementing cyclic domain map : That is creating cyclic
> distribution policy for the creating components on different
> localities.The class that takes Component type and the target localities
> using overloads of (hpx::find_here(), hpx::find_all_localities) as a
> template parameters. And creates the instance of component type on all
> localities using parallel for loops as the operation is completely
> independent of each other.
> And other possible overloads are create ' n ' number of components on
> given localities.
>1)  If n < localities.size() ->
> Create components n on the localities (i.e create  5 component  instance
> of type T over 10 localities means - The domain map class creates 5
> component instance on 5 localities (one per each localities). In this case
> the cyclic property does not hold.
>2)  If n > localities.size()  ->
> (i.e create 5 component instance  of type T over 4 localities means - The
> domain map class creates 5 component instance on  4 localities ( one per
> each locality and then again cycles , create an instance in 1 locality
> once again ).
> The class domain maps contains a vector of id's of components - it
> contains the component - id's  of components created under cyclic
> distribution policy.
> And also want to create an iterator over the vector for accessing the
> component instance created.And also want to maintain an unordered map to
> support the functionality of find_owner(). It returns the locality id for
> the given component id.

A distribution_policy is a type which exposes a certain fixed interface. Please 
have a look at the existing distribution policies to see what functions you 
will have to implement. As outlined before, currently those are two groups of 
functions: a) functions for creating components, and b) functions for invoking 
actions. The former (a) is what you should focus on as the latter (b) might get 
removed from the Concept of a distribution policy in the future.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC] Question about the intended behaviour of waiting on futures

[Denis Blank]

Hi,

during my research, for the unwrapped GSoC proposal, I recognized that there is
an issue with my intended plan on providing mapper and traversal functions
for futures which are nested inside arbitrary variadic packs.
My plans are that I want to implement the two utility functions:

 - `map_futures` which can map futures inside arbitrary packs and containers.
 - `traverse_futures` which can visit futures inside arbitrary packs
   and containers (basically the same as the mapper functions however we
   don't return anything from the callable object).

The two functions could replace a lot of duplicated code in `unwrapped` as
well as many functions which are waiting on futures like `wait_all` or 
`when_all`.
A possible use-case could look like the following:

int my_value = ...;
hpx::future my_future = ...;
hpx::tuple my_tuple = ...;

// Can map futures to arbitrary values for unwrapping
// we just call future::get...
struct Mapper {
  template
  T operator()(hpx::future future) {
return future.get();
  }
};

// Intended function for applying the given mapping to futures
// which are nested in arbitrary packs
hpx::tuple> result =
  map_futures(Mapper{}, my_value, my_future, my_tuple);

// Basically a mapper which maps nothing,
// the nicer way would be to use C++14 variadic lambdas.
struct Visitor {
  template
  void operator()(hpx::future& future) {
// ...
  }
};

// Also there is a visitor function to let the given visitor
// visit all futures, also further count limited visits shall be supported
traverse_futures(Visitor{}, my_value, my_future, my_tuple);

However, `wait_all`, `when_all` and its similar functions, in which I planned
to use the proposed API, are currently implemented in a way that we start to 
wait
for the next future in a pack or container as soon as the previous one was 
resolved [0]:

[request] -> future -> future -*
 |
  [ready] <- future <-- *

This approach requires that the wait functionality is suspendable and 
re-entrant able
which is difficult to implement in an efficient way, also the deferred execution
is requested sequentially and I guess that is not the intended behavior
when waiting for multiple futures at once.

Thus waiting for futures inside nested packs and containers becomes
much easier when we request the deferred execution for all futures and then
continue when all futures became ready (we could use an atomic counter
instead of the continuous usage of continuation handlers).
Basically this could be changed so that we are able to
use the API I proposed above:

* [request] *
||  |
VV  V
future   future   future
 \\ /
  \v   /
   *---> [ready] <*

Is it possible to change the current request behavior of `when_all` and 
`wait_all`
so that we request the deferred execution of all futures, we wait on,
at once and then call the final continuation handler when all futures became 
ready?

I would highly appreciate it if you could return me a short feedback
if you think that the API I proposed above could be improved.

Best regards,
Denis

- [0] 
https://github.com/STEllAR-GROUP/hpx/blob/6941187bf1f3bf2c7c295d5f451d141f39ead6ec/hpx/lcos/wait_all.hpp#L247-L272
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc

[Hartmut Kaiser]

Praveen,

> I'm getting familiar with some code base day by day.Each day I'm trying to
> do  my best .I find that the code base is larger but I can't able to
> correctly figure it out which parts of the library I will use for
> distributed component placement project. I have also installed chapel in
> rostam so I can use it for learning the behaviors of domain maps over a
> clusters. I want to design the outline and implementation details of the
> project as soon as possible. For that I want to know what exactly hpx
> wants from domain maps of course yes,I designed my proposal by referencing
> so many things and got a OVERALL plan.But I'm lacking many things I guess.
> Yes, I do have plans about the project but I don't know how to fix it with
> hpx.
> Next is building allocators over domain maps. Actually I didn't use any
> custom allocators for my college projects,Can you please share some good
> reading on those topics.I believe that soon I will design the project
> (mostly in terms of diagrams so it can speak well than words). Any
> suggestions and advices about project is highly welcomed. I hope I will do
> my best to complete the project.

The key for this project is to understand distribution policies. The plan is to 
use those to manage the distribution of components. They are also used (amongst 
other things) by partitioned vector to determine where its partitions are 
allocated.

We have several distribution policies implemented in HPX:

default_distribution_policy 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/runtime/components/default_distribution_policy.hpp)
binpacking_distribution_policy 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/runtime/components/binpacking_distribution_policy.hpp)
target_distribution_policy 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/runtime/components/target_distribution_policy.hpp)

A distribution policy is an object which exposes two functions:

struct example_distribution_policy
{
template 
hpx::future create(Ts&&... vs) const
{
// Create an instance of the given Component.
// The policy decides where to create the component 
// instance.
// Return a future referring to the newly 
// created instance
}

// A bulk_locality_result holds all id_types for the newly
// created Component instances associated with the locality
// where they were created.
using bulk_locality_result = 
std::pair;

template 
hpx::future
bulk_create(std::size_t count, Ts&&... vs) const
{
// Create multiple Component instances on the localities 
// associated by this policy.
}

// this might not be necessary
std::size_t get_num_localities() const
{
// Return the number of localities this policy knows about.
}

// this might not be necessary
hpx::id_type get_next_target() const
{
// Return the locality which is anticipated to be used for 
// the next create operation.
}
};

The existing distribution policies also expose a couple of function related to 
task execution (async, async_cb, etc.), but I think those sdon't belong here 
and should be removed (and encapsulated by special executors). So for now I'd 
suggest you ignore those for your work. 

The bottom line is that for you project you should consider creating one (or 
more) distribution policies which encapsulate the functionality you envision.

HTH
Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc 2017

[Hartmut Kaiser]

> This is my blog for gsoc 2017  ->
> https://parallellisa.blogspot.in/  please watch out suggest some
> corrections.

Cool, thanks! Keep it coming!

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Adrian Serio]

Preveen,

Please use Patricia Grubel 

Adrian


On 5/5/2017 11:33 AM, Praveen Velliengiri wrote:

Hi
I want to ensure that whether this ' pagru...@nmsu.edu 
 ' is the active email id of Patrica Grubel 
Madam.

Thank You
Praveen velliengiri

 
	Virus-free. www.avg.com 
 



<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users


--
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2017

[Praveen Velliengiri]

Hi
   Thanks all of you for accepting my project(distributed component
placement) proposal. And also I would like to thank everyone for helping me
to start with hpx and clarifying my doubts regarding the design of my
project proposal.I would like to maintain a good relationship with all of
you beyond google summer of code 2017.
Once again thank you very much and I will do my best to complete the
project within my work schedule.
Thank you
Praveen velliengiri
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC

[Hartmut Kaiser]

Praveen,

> In distributed component placement project the project states that we had
> to implement EDSL for placement policies for components. I'm struck in
> designing EDSL for this project and I'm in need of some more information
> in this context like clues and references.Only few days are remaining for
> the proposal submission.Could anyone please help me?

After thinking a bit more about this, I believe while the project idea refers 
to a EDSL, this does not imply that it has to be implemented using template 
meta-programming techniques. I think what is meant by EDSL is rather a 
well-defined API which integrates well with the HPX distribution policies and 
the distributed data structures with the goal to have a means of defining the 
placement of the partitions across the system. As a bonus those could define 
data layout as well, such as striping and striding.

If you look at what chapel provides you'll get a nice overview of what would be 
a good feature set.

HTH
Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC

[Praveen Velliengiri]

Hello all
In distributed component placement project the project states that we had
to implement EDSL for placement policies for components. I'm struck in
designing EDSL for this project and I'm in need of some more information in
this context like clues and references.Only few days are remaining for the
proposal submission.Could anyone please help me?
Thank you
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2017] Proposal for re-implementing hpx::util::unwrapped

[#SESHADRI MADHAVAN#]

Hi Zahra,

I have proposed the idea for working on HPXCL with Patrick, hence I shall not 
be proposing this as my GSoC project, but I would love to jump into "Applying 
machine learning techniques on HPX algorithms". The project seems interesting 
and I have had some background implementing Machine Learning algorithms on 
Hadoop, predominantly in Java. But I have been through the process of designing 
and optimizing algorithms for execution in parallel which I believe will be 
useful for this. Let me know how I can get started.

Best Regards,
Madhavan

From: hpx-users-boun...@stellar.cct.lsu.edu 
[mailto:hpx-users-boun...@stellar.cct.lsu.edu] On Behalf Of Zahra Khatami
Sent: Thursday, March 30, 2017 11:56 PM
To: denis.bl...@outlook.com
Cc: hpx-users@stellar.cct.lsu.edu
Subject: Re: [hpx-users] [GSoC 2017] Proposal for re-implementing 
hpx::util::unwrapped

Hi Denis,

I am so glad that you are interested in HPX GSOC.
I have looked at your github and your projects seems so interesting for me. 
Feel free to write your proposal and submit it before April 3rd. I would be 
happy to be your mentor, as I have found your background match with my current 
projects as well. If you go through

https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-2017-Project-Ideas#re-implement-hpxutilunwrapped

You will find a project "Applying machine learning techniques on HPX 
algorithms", which I think it could be a good fit for you too. Our team has 
been working on it since 2-3 months ago and so far we have got interesting 
results, which are going to be prepared for a conference paper. In this project 
we are using LLVM and Clang LibTooling to implement a machine learning 
techniques on an HPX parallel algorithm, and we have applied and tested them on 
an hpx loop.
So as another option, you could look at this GSOC project idea and write a 
brief proposal about how you can implement it.

Best Regards,

Zahra Khatami | PhD Student
Center for Computation & Technology (CCT)
School of Electrical Engineering & Computer Science
Louisiana State University
2027 Digital Media Center (DMC)
Baton Rouge, LA 70803


On Thu, Mar 30, 2017 at 10:55 AM, Patrick Diehl 
<patrickdie...@gmail.com<mailto:patrickdie...@gmail.com>> wrote:
Hi Denis,

the ides sounds good, for GSoC, you should submit your proposal at their
official website. You can use this template [0] and our guidelines [1]
to prepare your proposal.  The deadline for the submission is

> April 3 16:00 UTC Student application deadline

We are looking forward to review your proposal.

Best,

Patrick

[0] https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-Submission-Template

[1] https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals

On 30/03/17 11:29 AM, Denis Blank wrote:
> Hello HPX Developers,
>
> I'm Denis, an Informatics Student at the Technical University of Munich, 
> Germany.
>
> In the summer semester, I'm transitioning to my master's program and
> thus I will finally have enough time to have a chance on participating at 
> GSoC.
>
> I'm very keen on Open-Source because you always learn something new about 
> various topics
> not covered in studies, and you get connected to other developers around the 
> world.
>
> Thus I'm highly active on GitHub (https://github.com/Naios), also, I recently 
> started
> to attend various conferences such as the MeetingC++ or EuroLLVM.
>
> In my spare time, I'm working on side projects very related to the field HPX 
> is covering,
> like a library for compile-time known continuation chaining - continuable [0].
>
> I'm also a member of the TrinityCore [1] Open-Source project where I'm 
> contributing
> for 6 years now (beside of other projects like fmtlib or ANTLR).
>
> HPX is very attractive for me as a potential GSoC project,
> because of its high-quality codebase as well as its impact on
> the today's important infrastructure for parallel computing.
>
> During my work on previous side projects and contributions, I gathered
> significant knowledge in C++ template meta-programming as well as designing 
> good API's.
> My bachelor's thesis was also about improving meta-programming in static 
> languages.
>
> Thus I want to work on improving the API of HPX especially the 
> `hpx::util::unwrapped` function.
> While browsing the issue tracker I spotted other related issues,
> not mentioned in the existing proposal, such as the requirement
> of a unified waiter API for arbitrary objects (#1132 [2]).
>
> My plans for a potential GSoC stipend embrace a complete rewrite of the
> `hpx::util::unwrapped` function, in order to use a new designed waiter
> and unwrapping internal API which picks up the ideas mentioned in #1132,
> to fully support the requirements of issue #1404, #1400 and #1126.
> The API should also replace the existing internal solutions of:
>
&g

Re: [hpx-users] [GSoC 2017] Proposal for re-implementing hpx::util::unwrapped

[Patrick Diehl]

On 30/03/17 11:55 AM, Patrick Diehl wrote:
> Hi Denis,
>
> the ides sounds good, for GSoC, you should submit your proposal at their
> official website. You can use this template [0] and our guidelines [1]
> to prepare your proposal.  The deadline for the submission is
>
>> April 3 16:00 UTC Student application deadline
> We are looking forward to review your proposal.
>
> Best,
>
> Patrick
>
> [0] https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-Submission-Template
>
> [1] https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals
>
> On 30/03/17 11:29 AM, Denis Blank wrote:
>> Hello HPX Developers,
>>
>> I'm Denis, an Informatics Student at the Technical University of Munich, 
>> Germany.
>>
>> In the summer semester, I'm transitioning to my master's program and
>> thus I will finally have enough time to have a chance on participating at 
>> GSoC.
>>
>> I'm very keen on Open-Source because you always learn something new about 
>> various topics
>> not covered in studies, and you get connected to other developers around the 
>> world.
>>
>> Thus I'm highly active on GitHub (https://github.com/Naios), also, I 
>> recently started
>> to attend various conferences such as the MeetingC++ or EuroLLVM.
>>
>> In my spare time, I'm working on side projects very related to the field HPX 
>> is covering,
>> like a library for compile-time known continuation chaining - continuable 
>> [0].
>>
>> I'm also a member of the TrinityCore [1] Open-Source project where I'm 
>> contributing
>> for 6 years now (beside of other projects like fmtlib or ANTLR).
>>
>> HPX is very attractive for me as a potential GSoC project,
>> because of its high-quality codebase as well as its impact on
>> the today's important infrastructure for parallel computing.
>>
>> During my work on previous side projects and contributions, I gathered
>> significant knowledge in C++ template meta-programming as well as designing 
>> good API's.
>> My bachelor's thesis was also about improving meta-programming in static 
>> languages.
>>
>> Thus I want to work on improving the API of HPX especially the 
>> `hpx::util::unwrapped` function.
>> While browsing the issue tracker I spotted other related issues,
>> not mentioned in the existing proposal, such as the requirement
>> of a unified waiter API for arbitrary objects (#1132 [2]).
>>
>> My plans for a potential GSoC stipend embrace a complete rewrite of the
>> `hpx::util::unwrapped` function, in order to use a new designed waiter
>> and unwrapping internal API which picks up the ideas mentioned in #1132,
>> to fully support the requirements of issue #1404, #1400 and #1126.
>> The API should also replace the existing internal solutions of:
>>
>>   - `dataflow`
>>   - `wait_all`
>>   - `when_all`
>>
>> in order to remove a lot of duplicated code (`when_all_frame` and 
>> `wait_all_frame`),
>> as well as to make the API consistent across these functions.
>> Also we could make the following mapping for the following parameter types 
>> available
>> to all functions I mentioned above:
>>
>>   - Args...  -> Args... (Ready types)
>>   - Tuple   -> Args... (Ready fixed-range)
>>   - hpx::future  -> Args... (Waitable fixed-range 
>> futures)
>> > Where Tuple is an object that is unwrappable through a sequenced call
>> > of std::get(tuple)..., which includes `std::pair`, `std::tuple`,
>> > `hpx::tuple` and potentially `std::array`.
>>   - Container  -> Container
>> > Where Container is an object satisfying the range requirements
>> > (`begin()` and `end()`), which makes it possible to use
>> > any arbitrary standard or user-given container.
>>
>> The new internal API could use function overloading instead of heavy SFINAE,
>> so we can also slightly improve the build performance there (issued in #950 
>> [3]).
>>
>> Because of my current knowledge I'm sure to complete these features,
>> as well as appropriate unit-tests, in 2 months.
>> Also since I've implemented similar capabilities into my continuable library 
>> [4] before.
>>
>> For the remaining month, I plan to propose generic project improvements into 
>> the timeline.
>>
>> How do you think about the proposed changes?
>>
>> Are there any other similar defects or requirements related to
>> template meta-programming, at which,
>> I could possibly work for the planned remaining time?
>>
>> Kind regards
>> Denis
>>
>> - [0] https://github.com/Naios/continuable
>> - [1] https://github.com/TrinityCore/TrinityCore
>> - [2] https://github.com/STEllAR-GROUP/hpx/issues/1132
>> - [3] https://github.com/STEllAR-GROUP/hpx/issues/950
>> - [4] 
>> https://github.com/Naios/continuable/blob/6d9680905acc8a7ba3812eddf02f2d69f3172e3f/include/continuable/continuable-base.hpp#L856
>> ___
>> hpx-users mailing list
>> hpx-users@stellar.cct.lsu.edu
>> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] Gsoc 2017

[Praveen Velliengiri]

Sorry I tried to upload a pdf of  size larger than 40kb. Here is a link to
my proposal please review it and suggest improvements and figure out
mistakes made.

https://docs.google.com/document/d/11eE-HNlGV4nd4GmNImgR9NnXX3s2j8vFxYOSIY67HSI/edit?usp=drivesdk
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2017

[Praveen Velliengiri]

I have attached my proposal.It is not complete.Could anyone review it and
suggest some ideas and help me to find errors.
Thanks
Praveen v


Gsoc_proposal.pdf
Description: Adobe PDF document
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Hartmut Kaiser]

Praveen,

> I think now I have understood what was the scope of the project and I'm
> starting to write proposal for distributed component placement Project.But
> I have some doubts about implementing EDSL whether I can go for a library
> based solution or I have to design the whole Expression templates model ?

As already mentioned. A library based solution might be advantageous depending 
on the complexity of the EDSL. In any case, I'd advise against Boost.Proto as 
it's too heavyweight. There are other libraries available which are more 
lightweight, if you need one.

> And I also need some Previous gsoc proposals that comes for Stellar
> group  so that I can design my proposal well.

That will not be possible, sorry.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc 2017

[Hartmut Kaiser]

Praveen,

> The abstract of distributed component placement project says that we can
> select at least one placement police.But I  want to know which placement
> police hpx needs mostly from the user's point of view so that we can give
> it higher priority to implement first. And also suggest me some placement
> policies which are easily integrated with hpx via domain maps.

You might want to look at Chapel for inspirations:

http://chapel.cray.com/tutorials/SC16/03-DataPar.pdf
http://chapel.cray.com/docs/latest/modules/layoutdist.html

HTH
Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2017

[Praveen Velliengiri]

Whether we can use boost.proto framework for designing a EDSL for
distributed component placement Project or we have to implement our own
expression templates and design our own evaluation methods?
Please reply..
Thanks
Praveen v
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Hartmut Kaiser]

> TURN HPX INTO A REPLACEMENT FOR C++ RUNTIME.
> I didn't able to understand it clearly.

HPX currently implements only features of the C++ Standard related to 
concurrency and parallelism. This project targets filling the missing gaps such 
that in the end HPX can be used a s a replacement (or as an alternative) to the 
standard library implementation which comes with your compiler. 

This will probably will boil down to integrate HPX seamlessly with at least one 
of the existing standard library implementations. I'd assume that an important 
precondition for this would be for the student to demonstrate a solid knowledge 
of any of those (libstdc++, libc++, the Microsoft standard library or similar).

> what I have understood is we have to dynamically link hpx libraries to the
> applications during runtime.But it is actually done by dynamic linker
> itself.Please correct me if I am wrong. And please explain me the
> statement to some extend.

Hmmm, that's a misunderstanding. HPX is normally statically linked to an 
application in the same way as is any other C++ library. HPX itself may be used 
as a shared library, though, which might have caused the misconception of it 
being dynamically linked.

HTH
Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2017 Proposal Work on Parallel Algorithms for HPX

[Thomas Heller]

Hi again

I've been through the full proposal now, and I think what I wrote below still 
holds.

On Dienstag, 21. März 2017 19:53:10 CET you wrote:
> On Dienstag, 21. März 2017 19:46:39 CET you wrote:
> > Hi Aja,
> > 
> > I think you should focus your proposal. As it stands right now, you will
> > not be able to complete everything. I strongly advice to pull together
> > some form of time plan on when you plan to have each part implemented,
> > given the vast number of algorithms you want to implement, it would be
> > great if you can in addition put in some references to already existing
> > solutions.
> > 
> > Please work on focusing your proposal.
> 
> Please ignore the previous email ... I only read the abstract on the mentors
> dashboard... I have to go through the full proposal again ;)
> 
> > On Samstag, 18. März 2017 15:20:28 CET Ajai George wrote:
> > > Hello,
> > > 
> > > I am Ajai V George, I had previously expressed my interest in doing a
> > > GSoC
> > > project with HPX. For the past week I was going through the hpx
> > > documentation and tutorial. I have been testing out examples and trying
> > > to
> > > write my own applications. I have also looked through the relevant
> > > codebase
> > > needed to resolve issues #1141 and #1338. I also read through the two
> > > papers on ParalleX for understanding the philosophy behind HPX. I
> > > believe
> > > that I can definitely complete this project and continue contributing
> > > further.
> > > 
> > > Please have a look at my GSoC application and help me make it better.
> > > Here
> > > is a link
> > >  > > 8Q
> > > KT BieY/edit?usp=sharing> to it.
> > > 
> > > Regards,
> > > 
> > > Ajai V George
> > > 
> > > On Mon, Mar 13, 2017 at 2:21 AM, Ajai George 
> > > 
> > > wrote:
> > > > Hello,
> > > > 
> > > > I am Ajai V George from BITS Pilani, Goa Campus, India. My major is
> > > > Electrical and Electronics Engineering. I currently work with
> > > > Professor
> > > > Santonu Sarkar from Centre for High Performance and Dependable Systems
> > > > (Department of Computer Science and Information Systems). My project
> > > > is
> > > > Building 2D Algorithms with shared memory in Thrust which is a CUDA
> > > > library. I am implementing Berkeley Structured Grid Dwarf by extending
> > > > Thrust.
> > > > 
> > > > Due to this project, I have significant experience with CUDA and with
> > > > implementing STL like data structures in CUDA. I have created a
> > > > block_2d
> > > > data
> > > > structure for Thrust for 2d data storage. I created a Thrust and thus
> > > > STL
> > > > compatible iterator for this. I also created an abstraction layer for
> > > > accessing windows (as described in structured grid dwarf) within this
> > > > data structure and an accompanying iterator which lazily generates
> > > > these
> > > > windows. I have created highly optimized for_each, transform, reduce,
> > > > and
> > > > transform_reduce functions for both the thrust 1D device vector and my
> > > > block_2d data structure. These algorithms use shared memory
> > > > efficiently
> > > > with proper memory access coalescence and no shared memory bank
> > > > conflicts. The reduction algorithm also uses a highly optimized tree
> > > > based approach. I have also created this framework such that it can be
> > > > extended to be used with cuFFT and cuBLAS libraries easily.
> > > > 
> > > > Due to the above background I believe, I can work on the Parallel
> > > > Algorithms for HPX project for GSoC 2017, specifically on extending
> > > > algorithms like scan, reduce, transform, for_each, fill, etc to work
> > > > with
> > > > hpx::vector. I have already cloned the repo and have built hpx and am
> > > > currently looking through the source code to see what would be
> > > > impacted
> > > > by
> > > > the project and what changes would be required.
> > > > 
> > > > I request help from the community in crafting my proposal, and in
> > > > understanding hpx codebase.
> > > > 
> > > > Regards,
> > > > 
> > > > Ajai V George


___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Hartmut Kaiser]

> I'm interested in c++ runtime replacement project. But I'm missing some
> key piece of information. Information at GSOC projects ideas page is not
> sufficient for me to write a proposal.Could you please share me some more
> resources on that? How many project proposals can each student is eligible
> to submit?

What kind of information are you looking for?

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2017

[Praveen Velliengiri]

I'm interested in c++ runtime replacement project. But I'm missing some key
piece of information. Information at GSOC projects ideas page is not
sufficient for me to write a proposal.Could you please share me some more
resources on that? How many project proposals can each student is eligible
to submit?
Thank You
Praveen velliengiri
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Hartmut Kaiser]

> I had some doubts regarding hpx.
> 1. whether hpx supports lock free programming and relays on sequential
> consistency ?

I'm not sure what you mean. HPX is 'just' a C++ library and it can be used with 
any type of C++ code.
It does not rely on sequential consistency but you can write code which does so.

> 2. which type of c++ memory model hpx is using?

HPX uses the memory model provided by your C++ environment.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2017

[Praveen Velliengiri]

Hi
I had some doubts regarding hpx.
1. whether hpx supports lock free programming and relays on sequential
consistency ?
2. which type of c++ memory model hpx is using?
Thank you
Praveen velliengiri
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2017 Proposal Work on Parallel Algorithms for HPX

[Ajai George]

Hello,

I am Ajai V George, I had previously expressed my interest in doing a GSoC
project with HPX. For the past week I was going through the hpx
documentation and tutorial. I have been testing out examples and trying to
write my own applications. I have also looked through the relevant codebase
needed to resolve issues #1141 and #1338. I also read through the two
papers on ParalleX for understanding the philosophy behind HPX. I believe
that I can definitely complete this project and continue contributing
further.

Please have a look at my GSoC application and help me make it better. Here
is a link

to it.

Regards,

Ajai V George

On Mon, Mar 13, 2017 at 2:21 AM, Ajai George 
wrote:

> Hello,
>
> I am Ajai V George from BITS Pilani, Goa Campus, India. My major is Electrical
> and Electronics Engineering. I currently work with Professor Santonu
> Sarkar from Centre for High Performance and Dependable Systems
> (Department of Computer Science and Information Systems). My project is
> Building 2D Algorithms with shared memory in Thrust which is a CUDA
> library. I am implementing Berkeley Structured Grid Dwarf by extending
> Thrust.
>
> Due to this project, I have significant experience with CUDA and with 
> implementing
> STL like data structures in CUDA. I have created a block_2d data
> structure for Thrust for 2d data storage. I created a Thrust and thus STL
> compatible iterator for this. I also created an abstraction layer for
> accessing windows (as described in structured grid dwarf) within this
> data structure and an accompanying iterator which lazily generates these
> windows. I have created highly optimized for_each, transform, reduce, and
> transform_reduce functions for both the thrust 1D device vector and my
> block_2d data structure. These algorithms use shared memory efficiently
> with proper memory access coalescence and no shared memory bank
> conflicts. The reduction algorithm also uses a highly optimized tree
> based approach. I have also created this framework such that it can be
> extended to be used with cuFFT and cuBLAS libraries easily.
>
> Due to the above background I believe, I can work on the Parallel
> Algorithms for HPX project for GSoC 2017, specifically on extending
> algorithms like scan, reduce, transform, for_each, fill, etc to work with
> hpx::vector. I have already cloned the repo and have built hpx and am
> currently looking through the source code to see what would be impacted by
> the project and what changes would be required.
>
> I request help from the community in crafting my proposal, and in
> understanding hpx codebase.
>
> Regards,
>
> Ajai V George
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc : Stack Overflow Detection for Linux

[Bryce Lelbach]

This is a fairly tricky one; familiarity with the Linux kernel would be good.

On Thu, Mar 9, 2017 at 7:30 AM, Hartmut Kaiser  wrote:
>
>> Hello, I am 3rd year Computer Science student and am interested in the
>> project "Stack Overflow detection for Linux". I have some background in
>> hpc/parallel computing from my internship where I worked on a matrix
>> library for mobile devices(c++ and OpenGL).
>
> This is not a trivial task requiring some understanding on how low-level 
> memory management works.
>
>> I have read the github page for Stellar, am I correct in assuming that I
>> am supposed to research further on the topic I have chosen and post to the
>> mailing list for feedback on my ideas?
>
> Well, in the end you will have to write a proposal outlining what you would 
> like to do, how you would like to approach the issue, etc. If you have 
> concrete questions you can always come back to this mailing list or our IRC 
> for help.
>
>> Secondly, do I need to perform some qualification task for submitting my
>> proposal?
>
> None, we make the final decision based on ranking the proposals we receive.
>
>> Also, any advice and further pointers are appreciated. Thanks.
>
> Regards Hartmut
> ---
> http://boost-spirit.com
> http://stellar.cct.lsu.edu
>
>
>



-- 
Bryce Adelstein Lelbach aka wash
Lawrence Berkeley National Laboratory
ISO C++ Committee Member
CppCon and C++Now Program Chair

PROGRAM CHAIRING MODE ACTIVATED
--
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC questions about project

[Andreas Schäfer]

Hey Александр,

On 12:10 Mon 13 Mar , Александр Юрьевич Кондратьев wrote:
> I have a question about the project "Extension LibGeoDecomp::Region as an
> alternative adjacency container to BGL".
> I correctly understand that the purpose of the project is to implement the
> class Region in BGL without external dependencies to LibGeoDecomp?

no, the goal is to do the opposite: utilize LibGeoDecomp::Region
insilde BGL as an adjacency container. The motivation behind this is
that LibGeoDecomp::Region is highly efficient for storing coordinate
sets. And the edges of a directed graph with an integer vertex set can
be considered 2D coordinates. Does that make sense?

Thanks!
-Andreas


-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though.
All mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC questions about project

[Александр Юрьевич Кондратьев]

Good afternoon.
My name is Alexander Kondratyev. I am a third year student of IT department
in Novosibirsk State University.
My interests are HPC and math modeling, that's why I'm interested in your
projects.
I have experience in programming in such languages as: С, С++ 11.

I have a question about the project "Extension LibGeoDecomp::Region as an
alternative adjacency container to BGL".
I correctly understand that the purpose of the project is to implement the
class Region in BGL without external dependencies to LibGeoDecomp?

-- 
Sincerely,

*Kondratyev Alexander*
Novosibirsk State University
IT department
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2017 Proposal Work on Parallel Algorithms for HPX

[Hartmut Kaiser]

Ajai,

> I am Ajai V George from BITS Pilani, Goa Campus, India. My major
> is Electrical and Electronics Engineering. I currently work with Professor
> Santonu Sarkar from Centre for High Performance and Dependable Systems
> (Department of Computer Science and Information Systems). My project is
> Building 2D Algorithms with shared memory in Thrust which is a CUDA
> library. I am implementing Berkeley Structured Grid Dwarf by extending
> Thrust.

Welcome!

> Due to this project, I have significant experience with CUDA and
> with implementing STL like data structures in CUDA. I have created
> a block_2d data structure for Thrust for 2d data storage. I created
> a Thrust and thus STL compatible iterator for this. I also created
> an abstraction layer for accessing windows (as described in
> structured grid dwarf) within this data structure and an accompanying
> iterator which lazily generates these windows. I have created highly
> optimized for_each, transform, reduce, and transform_reduce functions for
> both the thrust 1D device vector and my block_2d data structure.
> These algorithms use shared memory efficiently with proper memory
> access coalescence and no shared memory bank conflicts. The
> reduction algorithm also uses a highly optimized tree based approach. I
> have also created this framework such that it can be extended to be
> used with cuFFT and cuBLAS libraries easily.
> 
> Due to the above background I believe, I can work on the Parallel
> Algorithms for HPX project for GSoC 2017, specifically on extending
> algorithms like scan, reduce, transform, for_each, fill, etc to work with
> hpx::vector. I have already cloned the repo and have built hpx and am
> currently looking through the source code to see what would be impacted by
> the project and what changes would be required.

That would be really cool! We have already a couple of our algorithms working 
with CUDA (for_each, copy, transform, for_loop, maybe others). But we 
definitely will need help with all of the algorithms based on scan, and 
everything related to sort.

> I request help from the community in crafting my proposal, and in
> understanding hpx codebase.

We have some guideline for writing proposals here: 
https://github.com/STEllAR-GROUP/hpx/wiki/GSoC-Submission-Template

also, some suggestions for how to write a successful proposal:
https://github.com/STEllAR-GROUP/hpx/wiki/Hints-for-Successful-Proposals

Also, what help do you need wrt the HPX source code? 

In addition to communicating on this mailing list, you might want to join our 
IRC channel (#ste||ar at freenocde) for more timely responses.

Let me know what else you would like to know.
Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2017 Proposal Work on Parallel Algorithms for HPX

[Ajai George]

Hello,

I am Ajai V George from BITS Pilani, Goa Campus, India. My major is Electrical
and Electronics Engineering. I currently work with Professor Santonu Sarkar
from Centre for High Performance and Dependable Systems (Department of
Computer Science and Information Systems). My project is Building 2D
Algorithms with shared memory in Thrust which is a CUDA library. I am
implementing Berkeley Structured Grid Dwarf by extending Thrust.

Due to this project, I have significant experience with CUDA and with
implementing
STL like data structures in CUDA. I have created a block_2d data structure
for Thrust for 2d data storage. I created a Thrust and thus STL compatible
iterator for this. I also created an abstraction layer for accessing
windows (as described in structured grid dwarf) within this data structure
and an accompanying iterator which lazily generates these windows. I have
created highly optimized for_each, transform, reduce, and transform_reduce
functions for both the thrust 1D device vector and my block_2d data
structure. These algorithms use shared memory efficiently with proper
memory access coalescence and no shared memory bank conflicts. The
reduction algorithm also uses a highly optimized tree based approach. I
have also created this framework such that it can be extended to be used with
cuFFT and cuBLAS libraries easily.

Due to the above background I believe, I can work on the Parallel
Algorithms for HPX project for GSoC 2017, specifically on extending
algorithms like scan, reduce, transform, for_each, fill, etc to work with
hpx::vector. I have already cloned the repo and have built hpx and am
currently looking through the source code to see what would be impacted by
the project and what changes would be required.

I request help from the community in crafting my proposal, and in
understanding hpx codebase.

Regards,

Ajai V George
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017 - Newtonian Physics Sandbox Project

[Andreas Schäfer]

CCing HPX Users. Let's keep this discussion public so others can chime
in.

Thanks!
-Andreas


On 09:32 Fri 10 Mar , Andreas Schäfer wrote:
> Hey Neeladree,
> 
> On 15:19 Thu 09 Mar , Neeladree Choudhury wrote:
> > I'm Neeladree from National Institute of Technology, Warangal in India. I
> > am interested in the Newtonian Physics Sandbox Project .
> 
> Cool!
> 
> > I'm quite proficient in writing code in C++. I have participated in 2 ACM
> > ICPC Regionals in 2016.
> > 
> > I have also studied Physics courses at the higher secondary level and am
> > familiar with concepts of Newtonian Physics.
> 
> Wow, both should give you a huge advantage.
>  
> > I would like to know more about the kind and extent of physical modelling
> > required in this project.
> 
> Actually the physics part doesn't have to be all too complex. I'd be
> good with a linear dashpot model and an Euler integrator. In my
> experience the major challenge here is to get comfortable with the
> tooling we'll use. Have you tried compiling HPX yet? Also, what OS is your
> primary work machine running? Windows, Linux, macOS?
> 
> Cheers
> -Andreas
> 
> 
> -- 
> ==
> Andreas Schäfer
> 
> PGP/GPG key via keyserver
> http://www.libgeodecomp.org
> ==
> 
> (\___/)
> (+'.'+)
> (")_(")
> This is Bunny. Copy and paste Bunny into your
> signature to help him gain world domination!

-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though,
all mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] Gsoc : Stack Overflow Detection for Linux

[Hartmut Kaiser]

> Hello, I am 3rd year Computer Science student and am interested in the
> project "Stack Overflow detection for Linux". I have some background in
> hpc/parallel computing from my internship where I worked on a matrix
> library for mobile devices(c++ and OpenGL).

This is not a trivial task requiring some understanding on how low-level memory 
management works.

> I have read the github page for Stellar, am I correct in assuming that I
> am supposed to research further on the topic I have chosen and post to the
> mailing list for feedback on my ideas?

Well, in the end you will have to write a proposal outlining what you would 
like to do, how you would like to approach the issue, etc. If you have concrete 
questions you can always come back to this mailing list or our IRC for help.

> Secondly, do I need to perform some qualification task for submitting my
> proposal?

None, we make the final decision based on ranking the proposals we receive.

> Also, any advice and further pointers are appreciated. Thanks.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC

[Артем Алексеевич Федин]

Good afternoon. My name is Fedin Artem. I am a third year student of IT
department in Novosibirsk State University (NSU).
I really like programming in C/C++ languages that's why I chose your
project.
I have experience with parallel programming openMP, MPI, and with
multithreading  programming POSIX
Also, I have experience  with  Qt framework (1 year)  and STL library.

I have already started to learn HPX through docs and tutorials in your
website.
Plus I've tried to write some small examples.
I'm interesting in 2 projects: Port Mantevo MiniApps to HPX and  Implement
a Faster Associative Container for GIDs and  I have some questions.

General:
Which C++ style and technique do you use?

Container:
In document said, that You want to implement  n-ary trees, tries or radix
trees, and what about AVL trees? I think it would be better in that case.
Should I store pointers to objects in data structures? or is there special
techniques?

Port Mantevo:
How many apps should I import to HPX?


Which recommendations/ advice  could you give to me?

Sincerely,


Fedin Artem
Novosibirsk State University
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] Gsoc : Stack Overflow Detection for Linux

[Amit Rege]

Hello, I am 3rd year Computer Science student and am interested in the
project "Stack Overflow detection for Linux". I have some background in
hpc/parallel computing from my internship where I worked on a matrix
library for mobile devices(c++ and OpenGL).
I have read the github page for Stellar, am I correct in assuming that I am
supposed to research further on the topic I have chosen and post to the
mailing list for feedback on my ideas?
Secondly, do I need to perform some qualification task for submitting my
proposal?
Also, any advice and further pointers are appreciated. Thanks.
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2017

[Patrick Diehl]

Hi Praveen,

a good start would be to read the documentation [0] and compile HPX [1].

Best,

Patrick

[0] http://stellar-group.github.io/hpx/docs/html/hpx.html
[1]
http://stellar-group.github.io/hpx/docs/html/hpx.html#hpx.manual.build_system.building_hpx

On 03/06/2017 12:55 PM, Praveen Velliengiri wrote:
> HI
>I'm Praveen v studying masters of data science.I'm interested in
> participating in gsoc 2017. This was the first time in stellar,I want to
> know how the HPX is internal designed so that I can derive my project
> design for that.Please suggest me some reading.
> Thank you
> Praveen v
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 

-- 
Patrick Diehl
Institut für Numerische Simulation
Rheinische Friedrich-Wilhelms Universität Bonn
Wegelerstrasse 4 , Room 0.001
D-53115 Bonn Germany
Tel : +49 228 733846
Mail: di...@ins.uni-bonn.de



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2016 [Implement a Map/Reduce Framework]

[Hartmut Kaiser]

> > 2) Along with Dataflow model, I would also borrow some of the features
> > from MillWheel [1] and FlumeJava [2] (features such as Fault-tolerance,
> > running efficient data parallel pipelines, etc).
> 
> Perfect. Do you have something more concrete in mind? Any use cases?
> Design ideas?
> 
>  Following is my brief design idea that incorporates features from both
> FlumeJava and MillWheel:
> 
> Let us assume each steps in stream processing to be a directed acyclic
> graph with output corresponded by directed edges, now for stream
> processing each output would have three parameters, i.e; key, value,
> timestamp (Key here refers to as processing request, value as its output
> and timestamp the time we received request) . Assuming each
> processFunction(user defined) to be node of the directed acyclic graph, we
> would send back the ACK(acknowledgment) signal once the data in i+1- th
> node is received from i - th node (this property ensures data is not lost
> in the process). Data on a given node is stored in a std::map std::string>. A point worth ,mentioning here is that each map would exist
> for a defined time period (few millisecond) in case ACK is not received
> for that time period, map for that specific node will be cleared. Now in
> case there are many parallel data pipelines directed edges of final output
> from each each pipeline will be concatenated using "join()" function and
> then further processed by the resulting function (analogous to reduce).
> A point worth to mention here is that instead of ACK model, we can also
> consider Uber's RingPOP RPC model here: https://eng.uber.com/intro-to-
> ringpop/
> 
> PS:There is a Data-flow based framework under development known as Apache
> Beam: https://github.com/apache/incubator-beam, and can be looked  for
> inspiration.

All of this sounds like a good first step in the right direction. Several 
comments:

Do we need explicit graphs representing the execution flow? Wouldn't something 
implicit work as well? What I have in mind is to pass along future objects 
representing/holding the result of a computational step and using those as 
'tokens' representing the data dependency on this result. This would allow to 
simply use hpx::dataflow to trigger the required operation once all futures 
have become ready.

Not sure if we should build an explicit ACK feedback in the first step. We run 
in tightly coupled scenarios where failures usually lead to full application 
crashes anyways :) But I agree having something like that in the design might 
be a good idea.

I'd ask you to keep poking at the problem and to develop keep developing your 
design. It might be a good idea if you tried to outline things in a bit more 
detail for us to really grasp what you're up to.

> > We definitely will be here to discuss things as you start putting out
> > ideas, questions, suggestions, etc. I think you have already started
> > looking at HPX itself, if not - it might be a good time to start doing so.
> 
> Along with adding Framework for Dataflow/Map-Reduce to HPX i also plan to
> have a pluggable storage and cache interface provided so that  framework
> user can store data into various storage system like(BigTable, Cassandra,
> etc), for pluggable cache interface user can store data into any cache
> system available (Redis/Memcache). PS: there won't be external plugin
> needed for  both these functions just two unix port for communications.

Please keep in mind that HPX has to be portable, i.e. direct usage of *nix 
interfaces is not an option.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC with stellar group

[Hartmut Kaiser]

Cc'ing hpx-users for others to be able to chime in.

> My name is Prakhar Pratyush. I am a 3rd year Electronics & Communication
> Eng. undergraduate student at Indian Institute of Technology (IIT)
> Roorkee, India. My primary areas of interests are Cryptography, Network
> security, and Data structure & Algorithms.
> I'm interested in participating in gsoc'16 with the stellar group. I
> looked into the idea page and I like the project "implement a plugin
> mechanism for thread schedulers". I have all the required prerequisite and
> I would be glad if I could get some pointers regarding the code base and
> reference documents.

The point here is to convert the currently statically linked thread schedulers 
in HPX into separate modules which can be loaded at runtime as needed. Some of 
this work has already be done in the code, but most of the required refactoring 
is still to be done. This is a nice GSoC project as it is not too hard, does 
not require too intimate knowledge of HPX, but at the same time, might have a 
big impact on HPX's usability.

You might want to start with checking out HPX, building it, making the examples 
run. You might want to dig into what HPX actually is (read the docs and 
publications) to get an idea what we try to achieve. Once you have a better 
understanding you should start to look into HPX itself to understand the 
current structure and to understand how schedulers are built into it today. 

> Also, I would like to know if there is any Qualification task like
> submitting patch that we need to do .

Well, you will have to write a proposal and submit it through the GSoC website 
for us to evaluate. You'd be well advised to start with that as soon as 
possible in close discussion with us. These discussions can happen either on 
the hpx-users mailing list or on our IRC channel.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu



___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2016

[Ankit Aggarwal]

Hi Everyone

I am a fourth year student at PEC,University of Technology,India. I am
interested in the doing in the "Implement a Plugin Mechanism" and
"Coroutine like Interface" for GSoC 2016.

Among needed skills I am comfortable with C++ as I have been using it for
last 3  years including libraries like BOOST,OpenCV, Zeromq and many others.

I also participated in GSoC 2015 - MBDyn 
(Project-2 "INTERNAL LIBRARY UPDATES) which I successfully completed and
was also based on C++ language including Boost library ,STL etc. I have
also attached the letter of reference obtained from the mentor for
consideration.

I would really appreciate the know the starting point for this project and
any other requirements for this project.

Any suggestion will be helpful.

Thanking you

Ankit Aggarwal

ankit.ankit.aggar...@gmail.com


LOR.pdf
Description: Adobe PDF document
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users